[2025-10-03T17:00:02.516810] [INFO ] [MAIN ] Using last completed trading day: 2025-10-03 [2025-10-03T17:00:02.713976] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-03T17:00:02.714241] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-03T17:00:02.917500] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-03T17:00:02.918300] [WARN ] [STATE ] State set to: RUNNING [2025-10-03T17:00:02.918399] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-03T17:00:02.918453] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-03T17:00:02.918556] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-03T17:00:02.918678] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-03T17:00:04.495037] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-03T17:00:04.495227] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-03T17:00:04.495456] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-03T17:00:04.496621] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-03T17:00:04.496713] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-03T17:00:04.496754] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-03T17:00:04.496812] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-03T17:00:04.496846] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-03T17:00:04.496913] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-03T17:00:04.497286] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-03T17:00:04.497323] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-03T17:00:04.497476] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-03T17:00:04.497509] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-03T17:00:04.497542] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-03T17:00:04.497575] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-03T17:00:04.522602] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-03T17:00:04.547939] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-03T17:00:04.548031] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-03T17:00:04.548079] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-03T17:00:04.548110] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-03T17:00:04.548163] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-03T17:00:04.548507] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-03T17:00:04.548542] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-03T17:00:04.548573] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-10-03T17:00:04.548601] [INFO ] [MAIN ] Running in parallel mode [2025-10-03T17:00:04.548854] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-10-03T17:00:05.212593] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.344988] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.353694] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-03T17:00:05.351053] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.370449] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-03T17:00:05.399690] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-03T17:00:05.416287] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-03T17:00:05.440190] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:05.440339] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-03T17:00:05.440698] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-03T17:00:05.440621] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-03T17:00:05.440786] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-03T17:00:05.452363] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-03T17:00:05.476505] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-03T17:00:05.505565] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-03T17:00:05.524099] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-03T17:00:06.080963] [DEBUG] [LOCAL ] AA: Loaded 54005 existing records from primary storage. [2025-10-03T17:00:06.088018] [DEBUG] [LOCAL ] A: Loaded 51103 existing records from primary storage. [2025-10-03T17:00:06.188348] [INFO ] [MAIN ] AA: Loaded 54005 existing records. [2025-10-03T17:00:06.162314] [INFO ] [MAIN ] A: Loaded 51103 existing records. [2025-10-03T17:00:06.337038] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:06.390527] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-03T17:00:06.649155] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:06.661569] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-03T17:00:06.762121] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:06.811687] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-03T17:00:06.827388] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-03T17:00:06.835804] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:06.836154] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-03T17:00:06.836294] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-03T17:00:06.837624] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-03T17:00:06.837710] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-03T17:00:06.842963] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-03T17:00:06.913403] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-03T17:00:06.908032] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:00:06.956618] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-03T17:00:07.009180] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:00:07.055028] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-03T17:00:07.098153] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:00:07.126331] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-03T17:00:07.138304] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-03T17:00:07.178111] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-03T17:00:07.216104] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-03T17:00:07.299541] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAMI took 2.7s. Estimated remaining: 1h 48m 37s. Rate: 21.8 symbols/min [2025-10-03T17:00:07.374924] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:00:07.519086] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-03T17:00:07.806983] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:07.874277] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-03T17:00:07.893402] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:07.918581] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:07.920864] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-03T17:00:07.993349] [DEBUG] [LOCAL ] AAP: Loaded 52300 existing records from primary storage. [2025-10-03T17:00:07.993855] [INFO ] [MAIN ] AAP: Loaded 52300 existing records. [2025-10-03T17:00:08.102191] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T17:00:08.104010] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-03T17:00:08.185425] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:08.185747] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-03T17:00:08.185810] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-03T17:00:08.187023] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-03T17:00:08.187088] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-03T17:00:08.561929] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:08.562439] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-03T17:00:08.607858] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T17:00:08.609268] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-03T17:00:08.923039] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-03T17:00:08.924177] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-03T17:00:09.547340] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T17:00:09.549499] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-03T17:00:09.740802] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T17:00:09.751260] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-03T17:00:09.933727] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-03T17:00:09.934867] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-03T17:00:10.171473] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:00:10.184206] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-03T17:00:10.188490] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-03T17:00:10.189761] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-03T17:00:10.491487] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-10-03T17:00:10.503047] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-03T17:00:10.518918] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T17:00:10.519890] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-03T17:00:10.781804] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-03T17:00:10.783006] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-03T17:00:11.033494] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T17:00:11.034554] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-03T17:00:11.283699] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:00:11.294776] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-03T17:00:11.410450] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T17:00:11.411261] [INFO ] [REMOTE ] AAM: Full fetch complete (947 records). [2025-10-03T17:00:11.411340] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-03T17:00:11.618469] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-03T17:00:11.618746] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:11.618823] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:11.618907] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-03T17:00:11.618980] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-03T17:00:11.619029] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-03T17:00:11.619082] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-03T17:00:11.619168] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AAM took 7.0s. Estimated remaining: 2h 19m 31s. Rate: 17.0 symbols/min [2025-10-03T17:00:11.805203] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:11.849330] [DEBUG] [LOCAL ] AAT: Loaded 30621 existing records from primary storage. [2025-10-03T17:00:11.849625] [INFO ] [MAIN ] AAT: Loaded 30621 existing records. [2025-10-03T17:00:12.052546] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:12.052853] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-03T17:00:12.052918] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-03T17:00:12.054006] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-03T17:00:12.054077] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-03T17:00:12.474171] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:12.474778] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-03T17:00:12.510068] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T17:00:12.521431] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-03T17:00:12.636147] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-03T17:00:12.649225] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-03T17:00:13.501839] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T17:00:13.509118] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-03T17:00:13.654727] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-03T17:00:13.670559] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-03T17:00:14.168351] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:00:14.180909] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-03T17:00:14.212767] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:00:14.224155] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-03T17:00:15.220509] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:00:15.232689] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-03T17:00:15.417914] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:00:15.423968] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-03T17:00:16.364991] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T17:00:16.378313] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-03T17:00:16.396272] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:00:16.403447] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-03T17:00:16.697203] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-03T17:00:16.709772] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-03T17:00:17.621152] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-03T17:00:17.636936] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-03T17:00:17.684383] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:00:17.691384] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-03T17:00:18.220734] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:00:18.234139] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-03T17:00:18.416957] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:00:18.428998] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-03T17:00:19.191495] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:00:19.202800] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-03T17:00:19.510501] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:00:19.529037] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-03T17:00:19.808518] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:00:19.827436] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-03T17:00:20.059908] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:00:20.079520] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-03T17:00:20.462453] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:00:20.473373] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-03T17:00:20.899571] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T17:00:20.911169] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-03T17:00:21.698754] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:00:21.713691] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-03T17:00:21.779886] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:00:21.793433] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:00:21.791967] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-03T17:00:21.809865] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-03T17:00:22.426042] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:00:22.439763] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-03T17:00:23.009909] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:00:23.018583] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-03T17:00:23.309148] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:00:23.324015] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-03T17:00:23.673581] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:00:23.687001] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-03T17:00:23.843342] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:00:23.857838] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-03T17:00:24.314864] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:00:24.324002] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-03T17:00:25.191258] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:00:25.206371] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-03T17:00:25.275832] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:00:25.289061] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-03T17:00:25.366923] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:00:25.381631] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-03T17:00:25.588179] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:00:25.596472] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-03T17:00:26.711264] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:00:26.713343] [INFO ] [REMOTE ] AAT: Full fetch complete (42823 records). [2025-10-03T17:00:26.713577] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-03T17:00:26.989159] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:00:27.058748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:00:27.084241] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-03T17:00:27.119927] [INFO ] [REMOTE ] A: Full fetch complete (73141 records). [2025-10-03T17:00:27.120375] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-03T17:00:27.358795] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-03T17:00:27.359142] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-03T17:00:27.365573] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-03T17:00:27.401465] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-03T17:00:27.550691] [DEBUG] [LOCAL ] AAT: Trimmed 42823 records to 30838 (keeping 200 days of data) [2025-10-03T17:00:27.568379] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T17:00:27.646377] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-03T17:00:27.887173] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-03T17:00:27.887294] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-03T17:00:27.888760] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-03T17:00:27.889181] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-03T17:00:27.894599] [DEBUG] [LOCAL ] A: Trimmed 73141 records to 51488 (keeping 200 days of data) [2025-10-03T17:00:28.127686] [DEBUG] [LOCAL ] AAT: Primary data saved (30838 records). [2025-10-03T17:00:28.128536] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-03T17:00:28.128925] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. AAT took 16.5s. Estimated remaining: 5h 10m 5s. Rate: 7.6 symbols/min [2025-10-03T17:00:28.368011] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:28.435368] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-03T17:00:28.444138] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-03T17:00:28.471077] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-03T17:00:28.471963] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-03T17:00:28.476009] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-03T17:00:28.479937] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-03T17:00:28.617213] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:00:28.643828] [INFO ] [REMOTE ] AAP: Full fetch complete (75014 records). [2025-10-03T17:00:28.664330] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-03T17:00:29.229176] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:29.292554] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-03T17:00:29.524355] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-03T17:00:29.526936] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-03T17:00:29.528335] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-03T17:00:29.528770] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-03T17:00:29.533857] [DEBUG] [LOCAL ] AAP: Trimmed 75014 records to 52648 (keeping 200 days of data) [2025-10-03T17:00:29.535170] [DEBUG] [LOCAL ] A: Primary data saved (51488 records). [2025-10-03T17:00:29.535702] [INFO ] [MAIN ] A: Full history saved. [2025-10-03T17:00:29.536526] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. A took 25.0s. Estimated remaining: 4h 6m 20s. Rate: 9.6 symbols/min [2025-10-03T17:00:29.649844] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:00:29.711254] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-03T17:00:29.740278] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:00:29.752370] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T17:00:29.764924] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-03T17:00:29.780945] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:00:29.813165] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-10-03T17:00:29.848268] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-03T17:00:29.848418] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-03T17:00:29.857289] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-03T17:00:29.856094] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:29.858128] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-03T17:00:29.863798] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-03T17:00:29.877751] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 19m 41s. Rate: 11.8 symbols/min [2025-10-03T17:00:30.271571] [DEBUG] [LOCAL ] AB: Loaded 27632 existing records from primary storage. [2025-10-03T17:00:30.314680] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:30.352109] [INFO ] [MAIN ] AB: Loaded 27632 existing records. [2025-10-03T17:00:30.759438] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-03T17:00:30.782465] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-03T17:00:30.788720] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-03T17:00:30.789237] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-03T17:00:30.787471] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:30.790957] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-03T17:00:30.792501] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-03T17:00:30.806877] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-03T17:00:30.807516] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-03T17:00:30.919819] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54395 (keeping 200 days of data) [2025-10-03T17:00:31.127608] [DEBUG] [LOCAL ] ABBV: Loaded 54074 existing records from primary storage. [2025-10-03T17:00:31.220369] [INFO ] [MAIN ] ABBV: Loaded 54074 existing records. [2025-10-03T17:00:31.716377] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:31.747366] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-03T17:00:31.757846] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-03T17:00:31.765202] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:31.767582] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-03T17:00:31.768605] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-03T17:00:31.769568] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-03T17:00:32.222795] [DEBUG] [LOCAL ] AAP: Primary data saved (52648 records). [2025-10-03T17:00:32.255637] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-03T17:00:32.279737] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAP took 24.9s. Estimated remaining: 3h 2m 6s. Rate: 13.0 symbols/min [2025-10-03T17:00:32.378329] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:32.393537] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-03T17:00:32.633015] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:32.677154] [DEBUG] [LOCAL ] AA: Primary data saved (54395 records). [2025-10-03T17:00:32.677321] [INFO ] [MAIN ] AA: Full history saved. [2025-10-03T17:00:32.677782] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AA took 28.1s. Estimated remaining: 2h 38m 16s. Rate: 14.9 symbols/min [2025-10-03T17:00:32.690988] [DEBUG] [LOCAL ] ABCB: Loaded 30713 existing records from primary storage. [2025-10-03T17:00:32.746178] [INFO ] [MAIN ] ABCB: Loaded 30713 existing records. [2025-10-03T17:00:33.030984] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:33.111625] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:33.112480] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-03T17:00:33.112673] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-03T17:00:33.113545] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-03T17:00:33.113628] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-03T17:00:33.273791] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:00:33.337875] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-03T17:00:33.458273] [DEBUG] [LOCAL ] ABEV: Loaded 53668 existing records from primary storage. [2025-10-03T17:00:33.484249] [INFO ] [MAIN ] ABEV: Loaded 53668 existing records. [2025-10-03T17:00:33.723725] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:33.729941] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-03T17:00:33.810858] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:33.811115] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-03T17:00:33.811165] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-03T17:00:33.812291] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-03T17:00:33.812357] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-03T17:00:34.236761] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:34.237353] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-03T17:00:34.554048] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:00:34.571082] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-03T17:00:34.820212] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:00:34.829613] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-03T17:00:34.888591] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:00:34.899112] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-03T17:00:35.903701] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:00:35.913745] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-03T17:00:35.990467] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:00:36.002342] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-03T17:00:36.104474] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:00:36.116776] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-03T17:00:36.377082] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:00:36.386899] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-03T17:00:36.795045] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T17:00:36.802046] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-03T17:00:37.661904] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:00:37.673083] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-03T17:00:37.865221] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:00:37.876252] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-03T17:00:37.960568] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:00:37.972198] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-03T17:00:37.995438] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T17:00:38.003976] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-03T17:00:38.965038] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T17:00:38.978060] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-03T17:00:39.005763] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:00:39.014669] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-03T17:00:39.310246] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:00:39.319172] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-03T17:00:39.624849] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:00:39.636758] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-03T17:00:40.179083] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T17:00:40.186236] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-03T17:00:40.427407] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:00:40.434890] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-03T17:00:40.920267] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:00:40.932515] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-03T17:00:41.298026] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:00:41.304409] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-03T17:00:41.638429] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T17:00:41.650890] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-03T17:00:41.697190] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T17:00:41.703923] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-03T17:00:42.215131] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:00:42.222966] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-03T17:00:42.367781] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:00:42.379774] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-03T17:00:43.085810] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:00:43.094899] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-03T17:00:43.151736] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T17:00:43.157543] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-03T17:00:43.879885] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:00:43.892142] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-03T17:00:44.034844] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:00:44.047505] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-03T17:00:44.066882] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:00:44.075219] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-03T17:00:44.415612] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T17:00:44.424089] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-03T17:00:44.998620] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:00:45.000444] [INFO ] [REMOTE ] AB: Full fetch complete (45529 records). [2025-10-03T17:00:45.000574] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-03T17:00:45.447620] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-03T17:00:45.448201] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-03T17:00:45.448985] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-03T17:00:45.449161] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-03T17:00:45.450411] [DEBUG] [LOCAL ] AB: Trimmed 45529 records to 27775 (keeping 200 days of data) [2025-10-03T17:00:45.677556] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T17:00:45.695553] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-03T17:00:45.706583] [DEBUG] [LOCAL ] AB: Primary data saved (27775 records). [2025-10-03T17:00:45.706889] [INFO ] [MAIN ] AB: Full history saved. [2025-10-03T17:00:45.707115] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AB took 16.2s. Estimated remaining: 3h 22m 32s. Rate: 11.7 symbols/min [2025-10-03T17:00:45.916282] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:00:45.983200] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-03T17:00:46.017330] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:00:46.051456] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:46.053720] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-03T17:00:46.078606] [DEBUG] [LOCAL ] ABG: Loaded 18742 existing records from primary storage. [2025-10-03T17:00:46.079139] [INFO ] [MAIN ] ABG: Loaded 18742 existing records. [2025-10-03T17:00:46.299802] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:46.300043] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-03T17:00:46.300096] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-03T17:00:46.300461] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-03T17:00:46.300540] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-03T17:00:46.692708] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:46.693079] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-03T17:00:47.121334] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:00:47.123237] [INFO ] [REMOTE ] ABCB: Full fetch complete (44533 records). [2025-10-03T17:00:47.123394] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-03T17:00:47.645114] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-03T17:00:47.645597] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-03T17:00:47.646846] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-03T17:00:47.646951] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-03T17:00:47.648736] [DEBUG] [LOCAL ] ABCB: Trimmed 44533 records to 30916 (keeping 200 days of data) [2025-10-03T17:00:47.715704] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:00:47.721357] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-03T17:00:47.892535] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T17:00:47.909908] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-03T17:00:47.928220] [DEBUG] [LOCAL ] ABCB: Primary data saved (30916 records). [2025-10-03T17:00:47.928396] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-03T17:00:47.933905] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. ABCB took 15.6s. Estimated remaining: 3h 9m 41s. Rate: 12.4 symbols/min [2025-10-03T17:00:48.110957] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:00:48.165790] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-03T17:00:48.185909] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:48.187037] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-03T17:00:48.187103] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-03T17:00:48.187232] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-03T17:00:48.187279] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-03T17:00:48.187323] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-03T17:00:48.187358] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-03T17:00:48.605081] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:48.605459] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-03T17:00:48.813468] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:00:48.818499] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-03T17:00:49.780089] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:00:49.796525] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-03T17:00:49.851261] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:00:49.863928] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-03T17:00:49.920425] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:00:49.930066] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-03T17:00:49.941719] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:00:49.946323] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-03T17:00:51.073814] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T17:00:51.080009] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-03T17:00:51.110308] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:00:51.118150] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-03T17:00:51.276422] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T17:00:51.289135] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-03T17:00:51.935797] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:00:51.949019] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-03T17:00:51.972167] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:00:51.979913] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-03T17:00:52.020128] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T17:00:52.026852] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-03T17:00:52.916555] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T17:00:52.920582] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-03T17:00:53.405167] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:00:53.413291] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-03T17:00:53.420091] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-03T17:00:53.423005] [INFO ] [REMOTE ] ABEV: Full fetch complete (77215 records). [2025-10-03T17:00:53.423123] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-03T17:00:53.636770] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:00:53.721066] [INFO ] [REMOTE ] ABBV: Full fetch complete (77330 records). [2025-10-03T17:00:53.739421] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-03T17:00:53.782072] [FATAL] [VALIDATOR ] ABBV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:00:53.787197] [FATAL] [MAIN ] ABBV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:53.792565] [WARN ] [MAIN ] ABBV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:53.803700] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-03T17:00:53.815420] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T17:00:53.815703] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-03T17:00:53.830165] [INFO ] [LOCAL ] ABBV: Starting deletion of derivative data. [2025-10-03T17:00:53.851936] [DEBUG] [LOCAL ] ABBV: Deleted derivative data file. [2025-10-03T17:00:53.846759] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-03T17:00:53.878382] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 24.0s. Estimated remaining: 3h 14m 2s. Rate: 12.2 symbols/min [2025-10-03T17:00:54.022375] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-03T17:00:54.045746] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-03T17:00:54.050685] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-03T17:00:54.051131] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-03T17:00:54.138222] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:54.114872] [DEBUG] [LOCAL ] ABEV: Trimmed 77215 records to 54058 (keeping 200 days of data) [2025-10-03T17:00:54.309319] [DEBUG] [LOCAL ] ABR: Loaded 52372 existing records from primary storage. [2025-10-03T17:00:54.366525] [INFO ] [MAIN ] ABR: Loaded 52372 existing records. [2025-10-03T17:00:54.633717] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:54.635414] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-03T17:00:54.639160] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-03T17:00:54.646993] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-03T17:00:54.648458] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-03T17:00:54.899133] [DEBUG] [LOCAL ] ABEV: Primary data saved (54058 records). [2025-10-03T17:00:54.932805] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-03T17:00:54.970312] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABEV took 22.3s. Estimated remaining: 3h 0m 13s. Rate: 13.1 symbols/min [2025-10-03T17:00:55.290339] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:00:55.352834] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:55.376224] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-03T17:00:55.363717] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-03T17:00:55.433336] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:55.437018] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T17:00:55.446107] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-03T17:00:55.515926] [DEBUG] [LOCAL ] ABT: Loaded 54010 existing records from primary storage. [2025-10-03T17:00:55.516283] [INFO ] [MAIN ] ABT: Loaded 54010 existing records. [2025-10-03T17:00:55.727115] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:55.727376] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-03T17:00:55.727433] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-03T17:00:55.728727] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-03T17:00:55.728797] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-03T17:00:56.130206] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:56.130577] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-03T17:00:56.288543] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:00:56.294293] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-03T17:00:56.393712] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:00:56.400060] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-03T17:00:57.226429] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T17:00:57.231108] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-03T17:00:57.378399] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:00:57.390280] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-03T17:00:57.803588] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:00:57.804960] [INFO ] [REMOTE ] ABG: Full fetch complete (26497 records). [2025-10-03T17:00:57.805060] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-03T17:00:57.805537] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:00:57.805625] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:00:57.805722] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:00:57.805825] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-03T17:00:57.805913] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-03T17:00:57.805983] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-03T17:00:57.806570] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-03T17:00:57.806706] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABG took 12.1s. Estimated remaining: 2h 54m 25s. Rate: 13.5 symbols/min [2025-10-03T17:00:57.979926] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:00:58.007526] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:00:58.022222] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-03T17:00:58.078881] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:00:58.081168] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-03T17:00:58.106216] [DEBUG] [LOCAL ] ACA: Loaded 23486 existing records from primary storage. [2025-10-03T17:00:58.106507] [INFO ] [MAIN ] ACA: Loaded 23486 existing records. [2025-10-03T17:00:58.313335] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:00:58.313592] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-03T17:00:58.313664] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-03T17:00:58.314107] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-03T17:00:58.314165] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-03T17:00:58.749713] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:00:58.750374] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-03T17:00:58.823553] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:00:58.834831] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-03T17:00:59.376301] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T17:00:59.388681] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-03T17:00:59.551076] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T17:00:59.556197] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-03T17:01:00.102569] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T17:01:00.116521] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-03T17:01:00.252019] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T17:01:00.258144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-03T17:01:00.665473] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:01:00.676912] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-03T17:01:00.706164] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T17:01:00.714034] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-03T17:01:01.293235] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:01:01.299275] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-03T17:01:01.628841] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:01:01.645458] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-03T17:01:02.247103] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:01:02.258134] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-03T17:01:02.360525] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:01:02.368485] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-03T17:01:02.481333] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:01:02.494137] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-03T17:01:03.239739] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:01:03.253250] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-03T17:01:03.460938] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:01:03.463901] [INFO ] [REMOTE ] ABM: Full fetch complete (44981 records). [2025-10-03T17:01:03.464054] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-03T17:01:03.859810] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T17:01:03.917513] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-03T17:01:03.980618] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-10-03T17:01:03.980882] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-10-03T17:01:03.981941] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-10-03T17:01:03.982102] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-10-03T17:01:03.984324] [DEBUG] [LOCAL ] ABM: Trimmed 44981 records to 32469 (keeping 200 days of data) [2025-10-03T17:01:04.151035] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:01:04.177117] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-03T17:01:04.274593] [DEBUG] [LOCAL ] ABM: Primary data saved (32469 records). [2025-10-03T17:01:04.274814] [INFO ] [MAIN ] ABM: Full history saved. [2025-10-03T17:01:04.274909] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABM took 16.3s. Estimated remaining: 3h 0m 29s. Rate: 13.1 symbols/min [2025-10-03T17:01:04.473728] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:04.528082] [DEBUG] [LOCAL ] ACCO: Loaded 37574 existing records from primary storage. [2025-10-03T17:01:04.528473] [INFO ] [MAIN ] ACCO: Loaded 37574 existing records. [2025-10-03T17:01:04.737368] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:04.741980] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-03T17:01:04.742103] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-03T17:01:04.742417] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-03T17:01:04.742484] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-03T17:01:05.114279] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:01:05.196279] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:05.192316] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-03T17:01:05.212606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-03T17:01:05.219407] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T17:01:05.232285] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-03T17:01:05.807116] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:01:05.820165] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-03T17:01:05.922453] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:01:05.928686] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-03T17:01:06.651972] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:01:06.660606] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-03T17:01:06.947772] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T17:01:06.953977] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-03T17:01:07.255055] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T17:01:07.268397] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-03T17:01:07.385706] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:01:07.397316] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-03T17:01:08.036910] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:01:08.045094] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-03T17:01:08.173550] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T17:01:08.179862] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-03T17:01:09.049708] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T17:01:09.078598] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T17:01:09.079423] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-03T17:01:09.086726] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-03T17:01:09.316388] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:01:09.387226] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:01:09.590727] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-03T17:01:10.067383] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:01:10.069021] [INFO ] [REMOTE ] ACA: Full fetch complete (34375 records). [2025-10-03T17:01:10.069113] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-03T17:01:10.405319] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-03T17:01:10.533766] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-03T17:01:10.533868] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-03T17:01:10.534284] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-03T17:01:10.534370] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-03T17:01:10.535719] [DEBUG] [LOCAL ] ACA: Trimmed 34375 records to 23677 (keeping 200 days of data) [2025-10-03T17:01:10.694181] [DEBUG] [LOCAL ] ACA: Primary data saved (23677 records). [2025-10-03T17:01:10.694437] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-03T17:01:10.694549] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ACA took 12.9s. Estimated remaining: 3h 5m 31s. Rate: 12.7 symbols/min [2025-10-03T17:01:10.896403] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:10.896744] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-03T17:01:10.896822] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-03T17:01:10.897023] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-03T17:01:10.897071] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-03T17:01:10.897117] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-03T17:01:10.897154] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-03T17:01:11.224506] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T17:01:11.287727] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-03T17:01:11.360782] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:11.887374] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:01:11.990724] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-03T17:01:12.699136] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:01:12.790725] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-03T17:01:13.047042] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T17:01:13.564360] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (4.48 seconds). [2025-10-03T17:01:13.590682] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-03T17:01:14.063902] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:01:14.390708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-03T17:01:15.190711] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-03T17:01:15.609875] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T17:01:15.657810] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T17:01:15.990678] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-03T17:01:16.126563] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T17:01:16.790706] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-03T17:01:17.508351] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T17:01:17.590701] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-03T17:01:17.913194] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:01:18.390742] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-03T17:01:19.118789] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T17:01:19.190765] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-03T17:01:19.624939] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:01:19.990724] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-03T17:01:20.476180] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T17:01:20.790735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-03T17:01:21.131997] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:01:21.135457] [INFO ] [REMOTE ] ABR: Full fetch complete (75255 records). [2025-10-03T17:01:21.135689] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-03T17:01:21.596407] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-03T17:01:21.630360] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-03T17:01:21.630460] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-03T17:01:21.631407] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-03T17:01:21.631499] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-03T17:01:21.633690] [DEBUG] [LOCAL ] ABR: Trimmed 75255 records to 52754 (keeping 200 days of data) [2025-10-03T17:01:21.987608] [DEBUG] [LOCAL ] ABR: Primary data saved (52754 records). [2025-10-03T17:01:21.987824] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-03T17:01:21.987938] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 28.1s. Estimated remaining: 3h 22m 38s. Rate: 11.6 symbols/min [2025-10-03T17:01:22.186703] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:22.249764] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-10-03T17:01:22.250161] [INFO ] [MAIN ] ACHR: Loaded 54208 existing records. [2025-10-03T17:01:22.393274] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:01:22.392404] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-03T17:01:22.449787] [INFO ] [REMOTE ] ABT: Full fetch complete (77596 records). [2025-10-03T17:01:22.477501] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-03T17:01:22.477098] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:22.478196] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-03T17:01:22.478396] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-03T17:01:22.484450] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-03T17:01:22.531631] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-03T17:01:23.378146] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:23.403441] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-03T17:01:23.400989] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-03T17:01:23.404506] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-03T17:01:23.406001] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-03T17:01:23.406806] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-03T17:01:23.408543] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T17:01:23.419880] [DEBUG] [LOCAL ] ABT: Trimmed 77596 records to 54400 (keeping 200 days of data) [2025-10-03T17:01:23.816031] [DEBUG] [LOCAL ] ABT: Primary data saved (54400 records). [2025-10-03T17:01:23.816179] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-03T17:01:23.816271] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 28.8s. Estimated remaining: 3h 14m 22s. Rate: 12.1 symbols/min [2025-10-03T17:01:24.017804] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-03T17:01:24.023336] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:24.048397] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:01:24.119184] [DEBUG] [LOCAL ] ACI: Loaded 53643 existing records from primary storage. [2025-10-03T17:01:24.119538] [INFO ] [MAIN ] ACI: Loaded 53643 existing records. [2025-10-03T17:01:24.379477] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:24.379983] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-03T17:01:24.380035] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-03T17:01:24.380468] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-03T17:01:24.380532] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-03T17:01:24.803773] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-03T17:01:24.811729] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:25.089133] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T17:01:25.590724] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-03T17:01:25.999309] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:01:26.146752] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-10-03T17:01:26.390836] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-03T17:01:27.166745] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T17:01:27.190701] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-03T17:01:27.560805] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T17:01:27.564362] [INFO ] [REMOTE ] ACCO: Full fetch complete (54021 records). [2025-10-03T17:01:27.564528] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-03T17:01:27.995683] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-03T17:01:28.024784] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-03T17:01:28.024880] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-03T17:01:28.025472] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-03T17:01:28.025525] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-03T17:01:28.027019] [DEBUG] [LOCAL ] ACCO: Trimmed 54021 records to 37807 (keeping 200 days of data) [2025-10-03T17:01:28.271569] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T17:01:28.283231] [DEBUG] [LOCAL ] ACCO: Primary data saved (37807 records). [2025-10-03T17:01:28.283387] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-03T17:01:28.285075] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 24.0s. Estimated remaining: 3h 13m 10s. Rate: 12.2 symbols/min [2025-10-03T17:01:28.476554] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:28.559222] [DEBUG] [LOCAL ] ACM: Loaded 43361 existing records from primary storage. [2025-10-03T17:01:28.559571] [INFO ] [MAIN ] ACM: Loaded 43361 existing records. [2025-10-03T17:01:28.768041] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:28.768353] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-03T17:01:28.768418] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-03T17:01:28.769540] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-03T17:01:28.769608] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-03T17:01:28.795859] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-03T17:01:29.184254] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:29.590734] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-03T17:01:30.098757] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T17:01:30.180114] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:01:30.390726] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-03T17:01:30.725050] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:01:31.190708] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-03T17:01:31.847544] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:01:31.990722] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-03T17:01:32.485131] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T17:01:32.790735] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-03T17:01:33.590721] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-03T17:01:34.174025] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:01:34.390729] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-03T17:01:34.697227] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-10-03T17:01:34.794550] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T17:01:35.190716] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-03T17:01:35.478877] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:01:35.990730] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-03T17:01:36.790735] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-03T17:01:37.590683] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-03T17:01:37.633055] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:01:37.955709] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.76 seconds). [2025-10-03T17:01:38.178743] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:01:38.245689] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:01:38.247284] [INFO ] [REMOTE ] ACEL: Full fetch complete (38565 records). [2025-10-03T17:01:38.247369] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-03T17:01:38.248200] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:01:38.248295] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:01:38.248342] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:01:38.248384] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-03T17:01:38.248447] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-03T17:01:38.248489] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-03T17:01:38.248530] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-10-03T17:01:38.248603] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 27.6s. Estimated remaining: 3h 24m 3s. Rate: 11.5 symbols/min [2025-10-03T17:01:38.404172] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-03T17:01:38.443754] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:38.509699] [DEBUG] [LOCAL ] ACN: Loaded 53816 existing records from primary storage. [2025-10-03T17:01:38.510187] [INFO ] [MAIN ] ACN: Loaded 53816 existing records. [2025-10-03T17:01:38.713904] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:38.714147] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-03T17:01:38.714198] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-03T17:01:38.715212] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-03T17:01:38.715279] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-03T17:01:39.130632] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:39.190707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-03T17:01:39.785477] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T17:01:39.990742] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-03T17:01:40.546321] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:01:40.790722] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-03T17:01:41.524257] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:01:41.590725] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-03T17:01:42.390703] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-03T17:01:42.600940] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:01:43.190702] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-03T17:01:43.990670] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-03T17:01:44.066160] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:01:44.206401] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-03T17:01:44.790742] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-03T17:01:45.015830] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:01:45.532808] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:01:45.590707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-03T17:01:46.362498] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:01:46.390691] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-03T17:01:47.169427] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:01:47.190639] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-03T17:01:47.990682] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-03T17:01:48.074500] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:01:48.790713] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-03T17:01:49.100775] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:01:49.590752] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-03T17:01:50.390751] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-03T17:01:50.708180] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:01:50.771964] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-10-03T17:01:50.967464] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:01:51.190771] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-03T17:01:51.747637] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T17:01:51.990728] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-03T17:01:52.790726] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-03T17:01:53.061290] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:01:53.590716] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-03T17:01:54.228711] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:01:54.390744] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-03T17:01:54.464743] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-03T17:01:55.190740] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-03T17:01:55.206673] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:01:55.211782] [INFO ] [REMOTE ] ACI: Full fetch complete (77045 records). [2025-10-03T17:01:55.211934] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-03T17:01:55.676567] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-03T17:01:55.676704] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-03T17:01:55.677719] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-03T17:01:55.677934] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-03T17:01:55.679952] [DEBUG] [LOCAL ] ACI: Trimmed 77045 records to 54030 (keeping 200 days of data) [2025-10-03T17:01:55.924054] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:01:55.928302] [INFO ] [REMOTE ] ACM: Full fetch complete (62801 records). [2025-10-03T17:01:55.928917] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-03T17:01:55.996168] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-03T17:01:56.432530] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-03T17:01:56.433131] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-03T17:01:56.435105] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-03T17:01:56.436356] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-03T17:01:56.445193] [DEBUG] [LOCAL ] ACM: Trimmed 62801 records to 43665 (keeping 200 days of data) [2025-10-03T17:01:56.840973] [DEBUG] [LOCAL ] ACM: Primary data saved (43665 records). [2025-10-03T17:01:56.841950] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-03T17:01:56.843935] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACM took 28.6s. Estimated remaining: 3h 51m 35s. Rate: 10.2 symbols/min [2025-10-03T17:01:56.971218] [DEBUG] [LOCAL ] ACI: Primary data saved (54030 records). [2025-10-03T17:01:56.977150] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-03T17:01:56.984698] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACI took 33.2s. Estimated remaining: 3h 40m 11s. Rate: 10.7 symbols/min [2025-10-03T17:01:57.134322] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:57.251013] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:01:57.274480] [DEBUG] [LOCAL ] ACR: Loaded 5990 existing records from primary storage. [2025-10-03T17:01:57.274776] [INFO ] [MAIN ] ACR: Loaded 5990 existing records. [2025-10-03T17:01:57.412281] [DEBUG] [LOCAL ] ACP: Loaded 31272 existing records from primary storage. [2025-10-03T17:01:57.412922] [INFO ] [MAIN ] ACP: Loaded 31272 existing records. [2025-10-03T17:01:57.593968] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:57.621943] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-03T17:01:57.627004] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-03T17:01:57.627368] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-03T17:01:57.638120] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-03T17:01:57.804928] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:01:57.810735] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-03T17:01:57.842371] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-03T17:01:57.871475] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-03T17:01:57.916115] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-03T17:01:58.498912] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:58.516246] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-03T17:01:58.624117] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (3.43 seconds). [2025-10-03T17:01:58.686876] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:01:58.687570] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-03T17:01:58.689425] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-03T17:01:58.731239] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-03T17:01:59.190699] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-03T17:01:59.343010] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T17:01:59.990776] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-03T17:02:00.069234] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:02:00.625691] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T17:02:00.790928] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-03T17:02:00.888881] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:02:01.451029] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T17:02:01.549864] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-10-03T17:02:01.590637] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-03T17:02:02.390694] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-03T17:02:03.076798] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T17:02:03.156333] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:02:03.190734] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-03T17:02:03.990711] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-03T17:02:04.539413] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:02:04.790743] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-03T17:02:05.590740] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-03T17:02:05.917065] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-03T17:02:06.292868] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T17:02:06.338230] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T17:02:06.390694] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-03T17:02:07.190711] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-03T17:02:07.327319] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:02:07.990689] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-03T17:02:08.458409] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T17:02:08.790727] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-03T17:02:09.161993] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T17:02:09.404158] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-03T17:02:09.406522] [INFO ] [REMOTE ] ACHR: Full fetch complete (77608 records). [2025-10-03T17:02:09.406716] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-03T17:02:09.407805] [FATAL] [VALIDATOR ] ACHR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:02:09.407928] [FATAL] [MAIN ] ACHR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:02:09.412863] [WARN ] [MAIN ] ACHR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:02:09.413354] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-03T17:02:09.413717] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-10-03T17:02:09.413818] [INFO ] [LOCAL ] ACHR: Starting deletion of derivative data. [2025-10-03T17:02:09.414107] [DEBUG] [LOCAL ] ACHR: Deleted derivative data file. [2025-10-03T17:02:09.414456] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACHR took 47.4s. Estimated remaining: 3h 52m 47s. Rate: 10.1 symbols/min [2025-10-03T17:02:09.592824] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-03T17:02:09.623856] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:09.665232] [DEBUG] [LOCAL ] ACRE: Loaded 33897 existing records from primary storage. [2025-10-03T17:02:09.665588] [INFO ] [MAIN ] ACRE: Loaded 33897 existing records. [2025-10-03T17:02:09.873343] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:09.873597] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-03T17:02:09.873673] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-03T17:02:09.874808] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-03T17:02:09.874884] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-03T17:02:10.296680] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:10.390706] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-03T17:02:11.003335] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:02:11.190712] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-03T17:02:11.725831] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:02:11.945022] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:02:11.990736] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-03T17:02:12.790743] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-03T17:02:13.362236] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:02:13.363399] [INFO ] [REMOTE ] ACR: Full fetch complete (8592 records). [2025-10-03T17:02:13.363533] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-03T17:02:13.601928] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-03T17:02:13.845472] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-03T17:02:13.845604] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-03T17:02:13.845961] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-03T17:02:13.846088] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-03T17:02:13.847298] [DEBUG] [LOCAL ] ACR: Trimmed 8592 records to 6006 (keeping 200 days of data) [2025-10-03T17:02:13.926929] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T17:02:13.945120] [DEBUG] [LOCAL ] ACR: Primary data saved (6006 records). [2025-10-03T17:02:13.945560] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-03T17:02:13.945742] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACR took 16.9s. Estimated remaining: 3h 50m 10s. Rate: 10.2 symbols/min [2025-10-03T17:02:14.151210] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:14.161166] [DEBUG] [LOCAL ] ACV: Loaded 7383 existing records from primary storage. [2025-10-03T17:02:14.161478] [INFO ] [MAIN ] ACV: Loaded 7383 existing records. [2025-10-03T17:02:14.363025] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:14.363312] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-03T17:02:14.363391] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-03T17:02:14.363744] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-03T17:02:14.363812] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-03T17:02:14.399410] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-03T17:02:14.773874] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:15.061673] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:02:15.190713] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-03T17:02:15.990706] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-03T17:02:16.391904] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T17:02:16.636938] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T17:02:16.706485] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T17:02:16.790724] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-03T17:02:17.590724] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-03T17:02:18.191845] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T17:02:18.256056] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T17:02:18.390736] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-03T17:02:19.190729] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-03T17:02:19.576271] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T17:02:19.990695] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-03T17:02:20.300285] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:02:20.676182] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:02:20.790747] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-03T17:02:21.590741] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-03T17:02:22.385382] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:02:22.394584] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-03T17:02:23.190712] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-03T17:02:23.804248] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T17:02:23.842704] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T17:02:23.990747] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-03T17:02:24.264909] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:02:24.782860] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:02:24.790607] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-03T17:02:25.385604] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T17:02:25.590735] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-03T17:02:26.390701] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-03T17:02:26.690340] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:02:27.190718] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-03T17:02:27.990961] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-03T17:02:27.992634] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T17:02:28.455871] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:02:28.790725] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-03T17:02:29.295853] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T17:02:29.590696] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-03T17:02:30.167227] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:02:30.390684] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-03T17:02:30.861286] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:02:31.190716] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-03T17:02:31.647168] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:02:31.990738] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-03T17:02:32.160258] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:02:32.790725] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-03T17:02:32.936920] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:02:33.590712] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-03T17:02:34.051553] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T17:02:34.390741] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-03T17:02:34.694738] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T17:02:34.699002] [INFO ] [REMOTE ] ACN: Full fetch complete (77140 records). [2025-10-03T17:02:34.699150] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-03T17:02:35.179139] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-03T17:02:35.179323] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-03T17:02:35.180263] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-03T17:02:35.180347] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-03T17:02:35.182924] [DEBUG] [LOCAL ] ACN: Trimmed 77140 records to 54205 (keeping 200 days of data) [2025-10-03T17:02:35.248536] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-03T17:02:35.545975] [DEBUG] [LOCAL ] ACN: Primary data saved (54205 records). [2025-10-03T17:02:35.546120] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-03T17:02:35.548024] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACN took 57.3s. Estimated remaining: 4h 16m 48s. Rate: 9.1 symbols/min [2025-10-03T17:02:35.760670] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:35.776892] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:02:35.836548] [DEBUG] [LOCAL ] ACVA: Loaded 49607 existing records from primary storage. [2025-10-03T17:02:35.837023] [INFO ] [MAIN ] ACVA: Loaded 49607 existing records. [2025-10-03T17:02:35.997775] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-03T17:02:36.036077] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:36.036538] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-03T17:02:36.036605] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-03T17:02:36.037889] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-03T17:02:36.038368] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-03T17:02:36.317879] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:02:36.353609] [INFO ] [REMOTE ] ACP: Full fetch complete (47230 records). [2025-10-03T17:02:36.357117] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-03T17:02:36.576356] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:36.795776] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-03T17:02:36.873559] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-03T17:02:36.873694] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-03T17:02:36.875003] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-03T17:02:36.875072] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-03T17:02:36.876407] [DEBUG] [LOCAL ] ACP: Trimmed 47230 records to 31458 (keeping 200 days of data) [2025-10-03T17:02:37.079592] [DEBUG] [LOCAL ] ACP: Primary data saved (31458 records). [2025-10-03T17:02:37.079902] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-03T17:02:37.080059] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 40.2s. Estimated remaining: 4h 8m 30s. Rate: 9.4 symbols/min [2025-10-03T17:02:37.200956] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:02:37.244848] [INFO ] [REMOTE ] ACRE: Full fetch complete (50670 records). [2025-10-03T17:02:37.257878] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-03T17:02:37.277930] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:37.327015] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-03T17:02:37.349625] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-03T17:02:37.368038] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-03T17:02:37.394262] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-03T17:02:37.397843] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-03T17:02:37.398274] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-03T17:02:37.598214] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-03T17:02:38.212256] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-03T17:02:38.211821] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:38.212505] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-03T17:02:38.213490] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-03T17:02:38.213716] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-03T17:02:38.215469] [DEBUG] [LOCAL ] ACRE: Trimmed 50670 records to 34079 (keeping 200 days of data) [2025-10-03T17:02:38.345127] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:02:38.391746] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-03T17:02:38.469058] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T17:02:38.491707] [DEBUG] [LOCAL ] ACRE: Primary data saved (34079 records). [2025-10-03T17:02:38.491860] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-03T17:02:38.491971] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. ACRE took 29.1s. Estimated remaining: 4h 0m 40s. Rate: 9.7 symbols/min [2025-10-03T17:02:38.686324] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:02:38.686150] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:38.686679] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-10-03T17:02:38.686768] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-03T17:02:38.686965] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:02:38.686857] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-10-03T17:02:38.687222] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-03T17:02:38.687446] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:02:38.687716] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-03T17:02:38.687554] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-03T17:02:38.688023] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-03T17:02:38.688116] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-03T17:02:38.687926] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-03T17:02:38.688310] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-03T17:02:38.688629] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-03T17:02:38.688761] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. AD took 1.6s. Estimated remaining: 3h 51m 36s. Rate: 10.1 symbols/min [2025-10-03T17:02:38.689060] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-03T17:02:39.074148] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:39.192679] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-03T17:02:39.296048] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:39.306788] [DEBUG] [LOCAL ] ADCT: Loaded 34861 existing records from primary storage. [2025-10-03T17:02:39.307040] [INFO ] [MAIN ] ADCT: Loaded 34861 existing records. [2025-10-03T17:02:39.494958] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:39.495270] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-03T17:02:39.495330] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-03T17:02:39.497101] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-03T17:02:39.497167] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-03T17:02:39.876400] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:39.990759] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-03T17:02:40.668622] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:02:40.685033] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T17:02:40.790706] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-03T17:02:41.590777] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-03T17:02:42.390743] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-03T17:02:42.419977] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:02:42.511354] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T17:02:43.190750] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-03T17:02:43.996815] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-03T17:02:44.003527] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:02:44.677959] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:02:44.774284] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:02:44.775846] [INFO ] [REMOTE ] ACV: Full fetch complete (10152 records). [2025-10-03T17:02:44.775936] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-03T17:02:44.799399] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-03T17:02:45.178879] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-03T17:02:45.178963] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-03T17:02:45.179170] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-03T17:02:45.179213] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-03T17:02:45.179864] [DEBUG] [LOCAL ] ACV: Trimmed 10152 records to 7512 (keeping 200 days of data) [2025-10-03T17:02:45.228103] [DEBUG] [LOCAL ] ACV: Primary data saved (7512 records). [2025-10-03T17:02:45.228261] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-03T17:02:45.228360] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACV took 31.3s. Estimated remaining: 3h 52m 23s. Rate: 10.1 symbols/min [2025-10-03T17:02:45.419317] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:02:45.477460] [DEBUG] [LOCAL ] ADM: Loaded 53777 existing records from primary storage. [2025-10-03T17:02:45.477916] [INFO ] [MAIN ] ADM: Loaded 53777 existing records. [2025-10-03T17:02:45.593215] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-03T17:02:45.683920] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:02:45.684283] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-03T17:02:45.684381] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-03T17:02:45.686175] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-03T17:02:45.686240] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-03T17:02:46.095125] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:02:46.121242] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:02:46.390716] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-03T17:02:47.077677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T17:02:47.190677] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-03T17:02:47.329086] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T17:02:47.990696] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-03T17:02:48.790683] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-03T17:02:48.874608] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T17:02:49.351253] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:02:49.590745] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-03T17:02:50.351243] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:02:50.390723] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-03T17:02:50.987333] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:02:51.190632] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-03T17:02:51.389685] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T17:02:51.990696] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-03T17:02:52.790737] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-03T17:02:52.947895] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:02:52.987436] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T17:02:53.590698] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-03T17:02:54.390772] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-03T17:02:54.619980] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:02:55.190743] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-03T17:02:55.258943] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T17:02:55.990718] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-03T17:02:56.326677] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T17:02:56.373805] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:02:56.790747] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-03T17:02:57.337189] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:02:57.590772] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-03T17:02:58.390670] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-03T17:02:58.427910] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:02:59.120023] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:02:59.190682] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-03T17:02:59.724869] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:02:59.990714] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-03T17:03:00.790711] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-03T17:03:01.524090] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-10-03T17:03:01.595811] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-03T17:03:01.610318] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:03:01.821238] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T17:03:02.390716] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-03T17:03:03.078783] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:03:03.190696] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-03T17:03:03.957145] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:03:03.990704] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-03T17:03:04.739572] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:03:04.790706] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-03T17:03:05.590699] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-03T17:03:05.784883] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:03:06.390727] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-03T17:03:06.570133] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:03:07.094699] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:03:07.098149] [INFO ] [REMOTE ] ADC: Full fetch complete (66312 records). [2025-10-03T17:03:07.098381] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-03T17:03:07.195942] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-03T17:03:07.548814] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-03T17:03:07.548916] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-03T17:03:07.549582] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-03T17:03:07.549630] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-03T17:03:07.551442] [DEBUG] [LOCAL ] ADC: Trimmed 66312 records to 46854 (keeping 200 days of data) [2025-10-03T17:03:07.869217] [DEBUG] [LOCAL ] ADC: Primary data saved (46854 records). [2025-10-03T17:03:07.869374] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-03T17:03:07.869477] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ADC took 29.4s. Estimated remaining: 4h 15m 33s. Rate: 9.2 symbols/min [2025-10-03T17:03:07.993766] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-03T17:03:08.078693] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:08.127101] [DEBUG] [LOCAL ] ADNT: Loaded 47495 existing records from primary storage. [2025-10-03T17:03:08.127491] [INFO ] [MAIN ] ADNT: Loaded 47495 existing records. [2025-10-03T17:03:08.334675] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:08.335292] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-03T17:03:08.335396] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-03T17:03:08.337030] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-03T17:03:08.337109] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-03T17:03:08.660883] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T17:03:08.806436] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-03T17:03:08.813306] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:08.909057] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:03:09.214224] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:03:09.590712] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-03T17:03:10.390672] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-03T17:03:10.689363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T17:03:10.964021] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:03:11.190726] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-03T17:03:11.992296] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-03T17:03:11.998852] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:03:12.790737] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-03T17:03:12.819868] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:03:12.822712] [INFO ] [REMOTE ] ACVA: Full fetch complete (70422 records). [2025-10-03T17:03:12.822883] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-03T17:03:13.286185] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-03T17:03:13.286298] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-03T17:03:13.287097] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-03T17:03:13.287166] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-03T17:03:13.288826] [DEBUG] [LOCAL ] ACVA: Trimmed 70422 records to 49976 (keeping 200 days of data) [2025-10-03T17:03:13.589953] [DEBUG] [LOCAL ] ACVA: Primary data saved (49976 records). [2025-10-03T17:03:13.590107] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-03T17:03:13.590244] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ACVA took 38.0s. Estimated remaining: 4h 14m 20s. Rate: 9.2 symbols/min [2025-10-03T17:03:13.624606] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-03T17:03:13.785489] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:13.839235] [DEBUG] [LOCAL ] ADT: Loaded 53842 existing records from primary storage. [2025-10-03T17:03:13.839587] [INFO ] [MAIN ] ADT: Loaded 53842 existing records. [2025-10-03T17:03:14.040720] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:14.041237] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-03T17:03:14.041303] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-03T17:03:14.042604] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-03T17:03:14.042695] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-03T17:03:14.504018] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:14.521605] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-03T17:03:14.538231] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:03:14.549955] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T17:03:15.190704] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-03T17:03:15.219923] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:03:15.990692] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-03T17:03:16.118119] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:03:16.753138] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:03:16.790627] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-03T17:03:16.957469] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:03:16.960830] [INFO ] [REMOTE ] ADCT: Full fetch complete (51442 records). [2025-10-03T17:03:16.961014] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-03T17:03:17.410676] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-03T17:03:17.411055] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-03T17:03:17.411773] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-03T17:03:17.411849] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-03T17:03:17.413222] [DEBUG] [LOCAL ] ADCT: Trimmed 51442 records to 35209 (keeping 200 days of data) [2025-10-03T17:03:17.611908] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-03T17:03:17.644175] [DEBUG] [LOCAL ] ADCT: Primary data saved (35209 records). [2025-10-03T17:03:17.644370] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-03T17:03:17.646571] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 39.0s. Estimated remaining: 4h 11m 2s. Rate: 9.3 symbols/min [2025-10-03T17:03:17.892222] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:17.932016] [DEBUG] [LOCAL ] ADX: Loaded 27720 existing records from primary storage. [2025-10-03T17:03:17.932361] [INFO ] [MAIN ] ADX: Loaded 27720 existing records. [2025-10-03T17:03:18.157689] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:18.158116] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-03T17:03:18.158219] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-03T17:03:18.158905] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-03T17:03:18.159048] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-03T17:03:18.397419] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-03T17:03:18.535864] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:03:18.624428] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:19.190743] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-03T17:03:19.437591] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T17:03:19.841024] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:03:19.990740] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-03T17:03:20.689172] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:03:20.693339] [INFO ] [REMOTE ] ADM: Full fetch complete (77242 records). [2025-10-03T17:03:20.693526] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-03T17:03:20.796120] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-03T17:03:21.203231] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-03T17:03:21.203446] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-03T17:03:21.204341] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-03T17:03:21.204454] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-03T17:03:21.206330] [DEBUG] [LOCAL ] ADM: Trimmed 77242 records to 54167 (keeping 200 days of data) [2025-10-03T17:03:21.338547] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T17:03:21.592804] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-03T17:03:21.596216] [DEBUG] [LOCAL ] ADM: Primary data saved (54167 records). [2025-10-03T17:03:21.596311] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-03T17:03:21.597617] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADM took 36.4s. Estimated remaining: 4h 7m 48s. Rate: 9.4 symbols/min [2025-10-03T17:03:21.787894] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:21.842184] [DEBUG] [LOCAL ] AEE: Loaded 50446 existing records from primary storage. [2025-10-03T17:03:21.842516] [INFO ] [MAIN ] AEE: Loaded 50446 existing records. [2025-10-03T17:03:22.063789] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:22.064039] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-03T17:03:22.064102] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-03T17:03:22.064400] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-03T17:03:22.064464] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-03T17:03:22.393279] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-03T17:03:22.484947] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:22.518167] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:03:23.191924] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-03T17:03:23.195082] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:03:23.712004] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:03:23.990704] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-03T17:03:24.790755] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-03T17:03:25.033225] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:03:25.563497] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:03:25.590627] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-03T17:03:25.809135] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:03:26.390776] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-03T17:03:26.948890] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:03:27.190727] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-03T17:03:27.812565] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:03:27.990754] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-03T17:03:28.705958] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:03:28.790746] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-03T17:03:29.580468] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:03:29.591211] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-03T17:03:30.138047] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:03:30.390722] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-03T17:03:31.018114] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:03:31.190734] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-03T17:03:31.990669] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-03T17:03:32.380248] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:03:32.790731] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-03T17:03:33.031771] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:03:33.590667] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-03T17:03:33.708812] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:03:34.111321] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:03:34.390743] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-03T17:03:35.180750] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:03:35.192369] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-03T17:03:35.990750] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-03T17:03:36.256369] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T17:03:36.479544] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:03:36.790740] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-03T17:03:37.590683] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-03T17:03:37.677696] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:03:38.357970] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:03:38.390626] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-03T17:03:39.198250] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-03T17:03:39.206469] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T17:03:39.996629] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-03T17:03:40.003427] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:03:40.159099] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T17:03:40.790768] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-03T17:03:41.590698] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-03T17:03:41.800394] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T17:03:41.966280] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:03:42.390769] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-03T17:03:43.191982] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:03:43.192077] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-03T17:03:43.703368] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T17:03:43.990754] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-03T17:03:44.371886] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T17:03:44.374695] [INFO ] [REMOTE ] ADNT: Full fetch complete (67945 records). [2025-10-03T17:03:44.374885] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-03T17:03:44.776595] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-03T17:03:44.776752] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-03T17:03:44.777800] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-03T17:03:44.777875] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-03T17:03:44.780087] [DEBUG] [LOCAL ] ADNT: Trimmed 67945 records to 47831 (keeping 200 days of data) [2025-10-03T17:03:44.836151] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-03T17:03:45.088171] [DEBUG] [LOCAL ] ADNT: Primary data saved (47831 records). [2025-10-03T17:03:45.088391] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-03T17:03:45.088526] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADNT took 37.2s. Estimated remaining: 4h 28m 33s. Rate: 8.7 symbols/min [2025-10-03T17:03:45.316880] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:45.334715] [DEBUG] [LOCAL ] AEFC: Loaded 8541 existing records from primary storage. [2025-10-03T17:03:45.335031] [INFO ] [MAIN ] AEFC: Loaded 8541 existing records. [2025-10-03T17:03:45.546455] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:45.546888] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-03T17:03:45.546965] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-03T17:03:45.547771] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-03T17:03:45.547836] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-03T17:03:45.603143] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-03T17:03:45.927253] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:45.986233] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:03:46.390677] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-03T17:03:46.748517] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:03:46.808337] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:03:47.190683] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-03T17:03:47.201165] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:03:47.990673] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-03T17:03:48.390836] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T17:03:48.790729] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-03T17:03:49.142290] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:03:49.590698] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-03T17:03:50.164835] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:03:50.167746] [INFO ] [REMOTE ] AEE: Full fetch complete (72655 records). [2025-10-03T17:03:50.167914] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-03T17:03:50.399036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-03T17:03:50.562881] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:03:50.595966] [INFO ] [REMOTE ] ADX: Full fetch complete (41964 records). [2025-10-03T17:03:50.604018] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-03T17:03:50.717034] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-03T17:03:50.738101] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-03T17:03:50.757896] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-03T17:03:50.769539] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-03T17:03:50.833530] [DEBUG] [LOCAL ] AEE: Trimmed 72655 records to 50827 (keeping 200 days of data) [2025-10-03T17:03:51.108863] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-03T17:03:51.196379] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-03T17:03:51.193254] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-03T17:03:51.198232] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-03T17:03:51.201574] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-03T17:03:51.201975] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-03T17:03:51.207942] [DEBUG] [LOCAL ] ADX: Trimmed 41964 records to 27928 (keeping 200 days of data) [2025-10-03T17:03:51.596969] [DEBUG] [LOCAL ] AEE: Primary data saved (50827 records). [2025-10-03T17:03:51.598076] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-03T17:03:51.599701] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. AEE took 30.0s. Estimated remaining: 4h 27m 59s. Rate: 8.7 symbols/min [2025-10-03T17:03:51.759742] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:03:51.818579] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:51.821488] [DEBUG] [LOCAL ] ADX: Primary data saved (27928 records). [2025-10-03T17:03:51.821676] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-03T17:03:51.821822] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 34.2s. Estimated remaining: 4h 20m 15s. Rate: 9.0 symbols/min [2025-10-03T17:03:51.993599] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-03T17:03:52.028895] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:03:52.070705] [DEBUG] [LOCAL ] AEG: Loaded 49924 existing records from primary storage. [2025-10-03T17:03:52.071171] [INFO ] [MAIN ] AEG: Loaded 49924 existing records. [2025-10-03T17:03:52.291973] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:52.292449] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-03T17:03:52.307373] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-03T17:03:52.309257] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-03T17:03:52.309360] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-03T17:03:52.359591] [DEBUG] [LOCAL ] AEM: Loaded 53853 existing records from primary storage. [2025-10-03T17:03:52.395311] [INFO ] [MAIN ] AEM: Loaded 53853 existing records. [2025-10-03T17:03:52.801016] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-03T17:03:52.993461] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:03:52.995236] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-03T17:03:53.013955] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-03T17:03:53.022343] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:53.023215] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-03T17:03:53.023374] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-03T17:03:53.441820] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:03:53.590706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-03T17:03:53.648544] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T17:03:53.847467] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:03:54.390701] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-03T17:03:54.967376] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:03:55.190706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-03T17:03:55.990678] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-03T17:03:56.238385] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T17:03:56.544722] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T17:03:56.647077] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:03:56.790740] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-03T17:03:57.590740] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-03T17:03:57.992797] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T17:03:58.161477] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:03:58.390699] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-03T17:03:59.190747] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-03T17:03:59.774228] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:03:59.812581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T17:03:59.815698] [INFO ] [REMOTE ] ADT: Full fetch complete (77190 records). [2025-10-03T17:03:59.816023] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-03T17:03:59.991739] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-03T17:04:00.258286] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-03T17:04:00.258382] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-03T17:04:00.259333] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-03T17:04:00.259433] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-03T17:04:00.261452] [DEBUG] [LOCAL ] ADT: Trimmed 77190 records to 54224 (keeping 200 days of data) [2025-10-03T17:04:00.611016] [DEBUG] [LOCAL ] ADT: Primary data saved (54224 records). [2025-10-03T17:04:00.611185] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-03T17:04:00.611328] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. ADT took 47.0s. Estimated remaining: 4h 22m 29s. Rate: 8.9 symbols/min [2025-10-03T17:04:00.792145] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-03T17:04:00.794018] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:00.851518] [DEBUG] [LOCAL ] AEO: Loaded 53947 existing records from primary storage. [2025-10-03T17:04:00.851946] [INFO ] [MAIN ] AEO: Loaded 53947 existing records. [2025-10-03T17:04:01.043153] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:01.043380] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-03T17:04:01.043432] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-03T17:04:01.043884] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-03T17:04:01.043947] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-03T17:04:01.447826] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:01.515571] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:04:01.590692] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-03T17:04:02.055943] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T17:04:02.152442] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:04:02.390714] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-03T17:04:03.190757] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-03T17:04:03.792707] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:04:03.990712] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-03T17:04:04.601698] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:04:04.602774] [INFO ] [REMOTE ] AEFC: Full fetch complete (12071 records). [2025-10-03T17:04:04.602850] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-03T17:04:04.797816] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-03T17:04:05.033075] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:04:05.084031] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-03T17:04:05.084686] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-03T17:04:05.085218] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-03T17:04:05.085299] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-03T17:04:05.086702] [DEBUG] [LOCAL ] AEFC: Trimmed 12071 records to 8584 (keeping 200 days of data) [2025-10-03T17:04:05.143964] [DEBUG] [LOCAL ] AEFC: Primary data saved (8584 records). [2025-10-03T17:04:05.144182] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-03T17:04:05.144323] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEFC took 20.1s. Estimated remaining: 4h 19m 59s. Rate: 9.0 symbols/min [2025-10-03T17:04:05.328729] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:05.390915] [DEBUG] [LOCAL ] AER: Loaded 48702 existing records from primary storage. [2025-10-03T17:04:05.391397] [INFO ] [MAIN ] AER: Loaded 48702 existing records. [2025-10-03T17:04:05.577930] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:05.578261] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-03T17:04:05.578318] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-03T17:04:05.578808] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-03T17:04:05.578884] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-03T17:04:05.595869] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-03T17:04:05.994104] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:06.390786] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-03T17:04:06.711617] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:04:07.190742] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-03T17:04:07.488519] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:04:07.714120] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:04:07.990763] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-03T17:04:08.802297] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-03T17:04:08.861027] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:04:09.590690] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-03T17:04:09.756175] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T17:04:10.390794] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-03T17:04:10.644135] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:04:11.122429] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:04:11.190751] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-03T17:04:11.859731] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T17:04:11.990745] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-03T17:04:12.790780] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-03T17:04:12.902185] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:04:13.590737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-03T17:04:13.746321] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:04:14.390685] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-03T17:04:14.580911] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:04:15.190681] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-03T17:04:15.677410] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T17:04:15.990726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-03T17:04:16.212272] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T17:04:16.790676] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-03T17:04:16.999056] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:04:17.590719] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-03T17:04:17.973508] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T17:04:18.390757] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-03T17:04:18.828540] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:04:19.190707] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-03T17:04:19.490934] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:04:19.790927] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:04:19.990738] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-03T17:04:20.790712] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-03T17:04:21.315693] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:04:21.590906] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-03T17:04:21.971061] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T17:04:22.122816] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:04:22.125689] [INFO ] [REMOTE ] AEG: Full fetch complete (70337 records). [2025-10-03T17:04:22.125813] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-03T17:04:22.402892] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-03T17:04:22.552158] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-03T17:04:22.552310] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-03T17:04:22.553322] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-03T17:04:22.553403] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-03T17:04:22.555917] [DEBUG] [LOCAL ] AEG: Trimmed 70337 records to 50249 (keeping 200 days of data) [2025-10-03T17:04:22.875615] [DEBUG] [LOCAL ] AEG: Primary data saved (50249 records). [2025-10-03T17:04:22.875862] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-03T17:04:22.877377] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEG took 31.3s. Estimated remaining: 4h 31m 29s. Rate: 8.6 symbols/min [2025-10-03T17:04:23.190753] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-03T17:04:23.243749] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:04:23.990731] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-03T17:04:24.535014] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-03T17:04:24.790788] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-03T17:04:25.057829] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:04:25.346212] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:04:25.590716] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-03T17:04:26.390750] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-03T17:04:26.436937] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:04:27.190798] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-03T17:04:27.282659] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:04:27.990752] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-03T17:04:28.386571] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:04:28.790677] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-03T17:04:29.195133] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:04:29.590728] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-03T17:04:29.669746] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:04:30.390919] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-03T17:04:30.771366] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T17:04:31.196110] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-03T17:04:31.211154] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:04:31.493054] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T17:04:31.990749] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-03T17:04:32.790740] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-03T17:04:33.176269] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T17:04:33.590771] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-03T17:04:34.032669] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:04:34.278576] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T17:04:34.283161] [INFO ] [REMOTE ] AER: Full fetch complete (69622 records). [2025-10-03T17:04:34.283550] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-03T17:04:34.395870] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-03T17:04:34.762750] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-03T17:04:34.762882] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-03T17:04:34.763766] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-03T17:04:34.763861] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-03T17:04:34.765559] [DEBUG] [LOCAL ] AER: Trimmed 69622 records to 49029 (keeping 200 days of data) [2025-10-03T17:04:35.105515] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T17:04:35.116260] [DEBUG] [LOCAL ] AER: Primary data saved (49029 records). [2025-10-03T17:04:35.116723] [INFO ] [MAIN ] AER: Full history saved. [2025-10-03T17:04:35.118493] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AER took 30.0s. Estimated remaining: 4h 36m 44s. Rate: 8.4 symbols/min [2025-10-03T17:04:35.118724] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-10-03T17:04:35.119368] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-03T17:04:35.576199] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-03T17:04:35.576343] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-03T17:04:35.577364] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-03T17:04:35.577441] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-03T17:04:35.580168] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 54337 (keeping 200 days of data) [2025-10-03T17:04:35.947631] [DEBUG] [LOCAL ] AEO: Primary data saved (54337 records). [2025-10-03T17:04:35.947955] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-03T17:04:35.948152] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEO took 35.3s. Estimated remaining: 4h 30m 21s. Rate: 8.6 symbols/min [2025-10-03T17:04:36.003876] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T17:04:36.007149] [INFO ] [REMOTE ] AEM: Full fetch complete (77164 records). [2025-10-03T17:04:36.007324] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-03T17:04:36.442915] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-03T17:04:36.443067] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-03T17:04:36.444256] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-03T17:04:36.444365] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-03T17:04:36.447408] [DEBUG] [LOCAL ] AEM: Trimmed 77164 records to 54239 (keeping 200 days of data) [2025-10-03T17:04:36.874190] [DEBUG] [LOCAL ] AEM: Primary data saved (54239 records). [2025-10-03T17:04:36.874428] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-03T17:04:36.874576] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AEM took 45.1s. Estimated remaining: 4h 24m 23s. Rate: 8.8 symbols/min [2025-10-03T17:04:37.487428] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.564159] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-03T17:04:37.658058] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.664025] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-03T17:04:37.717333] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-03T17:04:37.715665] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.717737] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-03T17:04:37.722050] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-03T17:04:37.721253] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:37.722203] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-03T17:04:37.882007] [DEBUG] [LOCAL ] AFB: Loaded 11470 existing records from primary storage. [2025-10-03T17:04:37.912524] [INFO ] [MAIN ] AFB: Loaded 11470 existing records. [2025-10-03T17:04:38.155223] [DEBUG] [LOCAL ] AESI: Loaded 49859 existing records from primary storage. [2025-10-03T17:04:38.283769] [INFO ] [MAIN ] AESI: Loaded 49859 existing records. [2025-10-03T17:04:38.380921] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.241301] [DEBUG] [LOCAL ] AES: Loaded 54060 existing records from primary storage. [2025-10-03T17:04:38.402499] [INFO ] [MAIN ] AES: Loaded 54060 existing records. [2025-10-03T17:04:38.436217] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.455948] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-03T17:04:38.589795] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-03T17:04:38.589712] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:38.667384] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-03T17:04:38.654001] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-03T17:04:38.952811] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:04:38.957270] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.933066] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:38.968130] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.968732] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-03T17:04:38.974107] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-03T17:04:38.968628] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-03T17:04:38.979514] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:04:39.000015] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-03T17:04:39.000131] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-03T17:04:38.984761] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-03T17:04:39.000177] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-03T17:04:39.071570] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-03T17:04:39.071721] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:04:39.155772] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-03T17:04:39.111779] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-03T17:04:39.210011] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-03T17:04:39.225737] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-03T17:04:39.266792] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-03T17:04:39.323407] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AEXA took 2.4s. Estimated remaining: 4h 20m 9s. Rate: 9.0 symbols/min [2025-10-03T17:04:39.877364] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:04:40.045376] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.094795] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-03T17:04:40.111155] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.137919] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-03T17:04:40.321626] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.337238] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-03T17:04:40.338972] [DEBUG] [LOCAL ] AFG: Loaded 32624 existing records from primary storage. [2025-10-03T17:04:40.339233] [INFO ] [MAIN ] AFG: Loaded 32624 existing records. [2025-10-03T17:04:40.520685] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:04:40.521029] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-03T17:04:40.521109] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-03T17:04:40.522275] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-03T17:04:40.522341] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-03T17:04:40.883477] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:04:40.883904] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-03T17:04:41.262002] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:04:41.265191] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-03T17:04:41.966108] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:04:41.973752] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-03T17:04:42.018597] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T17:04:42.032052] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-03T17:04:42.076916] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:04:42.080158] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-03T17:04:42.179250] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T17:04:42.390735] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-03T17:04:42.736556] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T17:04:43.190732] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-03T17:04:43.270511] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:04:43.304717] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:04:43.663891] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T17:04:43.990745] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-03T17:04:44.117570] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:04:44.790748] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-03T17:04:45.292846] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:04:45.590736] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-03T17:04:46.390714] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-03T17:04:46.499624] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T17:04:46.722974] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T17:04:47.190734] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-03T17:04:47.525187] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T17:04:47.990729] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-03T17:04:48.018694] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T17:04:48.790747] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-03T17:04:49.410443] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:04:49.562525] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T17:04:49.590621] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-03T17:04:50.390633] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-03T17:04:50.872215] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T17:04:51.190733] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-03T17:04:51.990693] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-03T17:04:52.175772] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:04:52.188266] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T17:04:52.790765] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-03T17:04:53.405480] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:04:53.590719] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-03T17:04:54.390689] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-03T17:04:54.452451] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:04:55.190684] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-03T17:04:55.494724] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:04:55.531692] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T17:04:55.990712] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-03T17:04:56.790738] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-03T17:04:56.929695] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:04:57.181065] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T17:04:57.590732] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-03T17:04:57.623540] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T17:04:58.390742] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-03T17:04:58.895683] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:04:59.190765] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-03T17:04:59.990764] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-03T17:05:00.245195] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:05:00.300996] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:05:00.790769] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-03T17:05:01.590638] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-03T17:05:01.604793] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:05:01.773439] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T17:05:02.390724] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-03T17:05:03.190739] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-03T17:05:03.716993] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:05:03.718975] [INFO ] [REMOTE ] AFG: Full fetch complete (46042 records). [2025-10-03T17:05:03.719090] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-03T17:05:03.997027] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-03T17:05:04.056952] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-03T17:05:04.194952] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-03T17:05:04.195072] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-03T17:05:04.195729] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-03T17:05:04.195801] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-03T17:05:04.197186] [DEBUG] [LOCAL ] AFG: Trimmed 46042 records to 32819 (keeping 200 days of data) [2025-10-03T17:05:04.421820] [DEBUG] [LOCAL ] AFG: Primary data saved (32819 records). [2025-10-03T17:05:04.421987] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-03T17:05:04.422099] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFG took 25.0s. Estimated remaining: 4h 37m 2s. Rate: 8.4 symbols/min [2025-10-03T17:05:04.611331] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:04.617359] [DEBUG] [LOCAL ] AFGB: Loaded 2357 existing records from primary storage. [2025-10-03T17:05:04.617669] [INFO ] [MAIN ] AFGB: Loaded 2357 existing records. [2025-10-03T17:05:04.795201] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-03T17:05:04.830618] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:04.832088] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-03T17:05:04.832315] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-03T17:05:04.832628] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-10-03T17:05:04.832740] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-03T17:05:04.885224] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T17:05:04.925285] [INFO ] [REMOTE ] AFB: Full fetch complete (16785 records). [2025-10-03T17:05:04.954411] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-03T17:05:05.327927] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-03T17:05:05.619180] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-03T17:05:05.635295] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:05.718228] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-03T17:05:05.718312] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-03T17:05:05.718565] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-03T17:05:05.718606] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-03T17:05:05.719193] [DEBUG] [LOCAL ] AFB: Trimmed 16785 records to 11614 (keeping 200 days of data) [2025-10-03T17:05:05.790637] [DEBUG] [LOCAL ] AFB: Primary data saved (11614 records). [2025-10-03T17:05:05.790835] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-03T17:05:05.790932] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AFB took 28.9s. Estimated remaining: 4h 31m 42s. Rate: 8.6 symbols/min [2025-10-03T17:05:05.987698] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:05.992265] [DEBUG] [LOCAL ] AFGC: Loaded 2561 existing records from primary storage. [2025-10-03T17:05:05.992464] [INFO ] [MAIN ] AFGC: Loaded 2561 existing records. [2025-10-03T17:05:06.199919] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:06.200198] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-03T17:05:06.200249] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-03T17:05:06.200463] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-03T17:05:06.200523] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-03T17:05:06.406692] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-03T17:05:06.628917] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:06.678823] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T17:05:07.111015] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T17:05:07.190687] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-03T17:05:07.632987] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:05:07.990689] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-03T17:05:08.466437] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:05:08.790708] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-03T17:05:09.063431] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:05:09.543344] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:05:09.590717] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-03T17:05:10.390723] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-03T17:05:11.190673] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-03T17:05:11.392077] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:05:11.711403] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T17:05:11.935270] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T17:05:11.990709] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-03T17:05:12.790704] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-03T17:05:13.253872] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T17:05:13.590730] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-03T17:05:13.745034] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T17:05:13.748368] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-03T17:05:13.748535] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-03T17:05:14.094069] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-03T17:05:14.208688] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-03T17:05:14.208794] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-03T17:05:14.210690] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-03T17:05:14.210795] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-03T17:05:14.216496] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54450 (keeping 200 days of data) [2025-10-03T17:05:14.401184] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-03T17:05:14.566315] [DEBUG] [LOCAL ] AES: Primary data saved (54450 records). [2025-10-03T17:05:14.566477] [INFO ] [MAIN ] AES: Full history saved. [2025-10-03T17:05:14.566614] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AES took 37.7s. Estimated remaining: 4h 33m 9s. Rate: 8.5 symbols/min [2025-10-03T17:05:14.759077] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:14.762867] [DEBUG] [LOCAL ] AFGD: Loaded 1827 existing records from primary storage. [2025-10-03T17:05:14.763023] [INFO ] [MAIN ] AFGD: Loaded 1827 existing records. [2025-10-03T17:05:14.888525] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T17:05:14.967033] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:14.967277] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-03T17:05:14.967326] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-03T17:05:14.967538] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-10-03T17:05:14.967597] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-03T17:05:15.195853] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-03T17:05:15.364553] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:15.876343] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T17:05:15.990727] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-03T17:05:16.531077] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:05:16.790696] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-03T17:05:17.305749] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T17:05:17.590689] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-03T17:05:18.331705] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T17:05:18.390723] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-03T17:05:18.827378] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T17:05:19.190737] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-03T17:05:19.635512] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T17:05:19.990740] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-03T17:05:20.491774] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T17:05:20.790743] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-03T17:05:21.209726] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T17:05:21.590738] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-03T17:05:22.109231] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:22.390719] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-03T17:05:22.960244] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T17:05:23.190725] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-03T17:05:23.623807] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:05:23.990714] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-03T17:05:24.363449] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T17:05:24.790734] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-03T17:05:25.266380] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T17:05:25.590718] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-03T17:05:25.894083] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-03T17:05:26.390739] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-03T17:05:26.805697] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T17:05:26.806505] [INFO ] [REMOTE ] AFGC: Full fetch complete (3734 records). [2025-10-03T17:05:26.806575] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-03T17:05:27.203357] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-03T17:05:27.212423] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-03T17:05:27.212517] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-03T17:05:27.212725] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-03T17:05:27.212790] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-03T17:05:27.213174] [DEBUG] [LOCAL ] AFGC: Trimmed 3734 records to 2568 (keeping 200 days of data) [2025-10-03T17:05:27.230798] [DEBUG] [LOCAL ] AFGC: Primary data saved (2568 records). [2025-10-03T17:05:27.230933] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-03T17:05:27.231022] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AFGC took 21.4s. Estimated remaining: 4h 37m 52s. Rate: 8.4 symbols/min [2025-10-03T17:05:27.430712] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:27.437457] [DEBUG] [LOCAL ] AFGE: Loaded 2467 existing records from primary storage. [2025-10-03T17:05:27.437732] [INFO ] [MAIN ] AFGE: Loaded 2467 existing records. [2025-10-03T17:05:27.676601] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:27.676889] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-03T17:05:27.676945] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-03T17:05:27.677111] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-03T17:05:27.677171] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-03T17:05:27.813087] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:05:27.995952] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-03T17:05:28.103453] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:28.790714] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-03T17:05:29.385857] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T17:05:29.590695] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-03T17:05:30.030598] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T17:05:30.031423] [INFO ] [REMOTE ] AFGB: Full fetch complete (3667 records). [2025-10-03T17:05:30.031495] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-03T17:05:30.031900] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:05:30.031992] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:05:30.032077] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:05:30.032154] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-03T17:05:30.032251] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-03T17:05:30.032298] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-10-03T17:05:30.032602] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-10-03T17:05:30.032723] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 25.6s. Estimated remaining: 4h 34m 4s. Rate: 8.5 symbols/min [2025-10-03T17:05:30.224668] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:30.261304] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-10-03T17:05:30.334682] [DEBUG] [LOCAL ] AFL: Loaded 53536 existing records from primary storage. [2025-10-03T17:05:30.335127] [INFO ] [MAIN ] AFL: Loaded 53536 existing records. [2025-10-03T17:05:30.395863] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-03T17:05:30.541173] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:30.541409] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-03T17:05:30.541460] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-03T17:05:30.541843] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-03T17:05:30.541907] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-03T17:05:30.954832] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:31.190735] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-03T17:05:31.956415] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:05:31.963060] [INFO ] [REMOTE ] AESI: Full fetch complete (70535 records). [2025-10-03T17:05:31.963212] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-03T17:05:31.998023] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-03T17:05:32.397265] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-03T17:05:32.397365] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-03T17:05:32.398133] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-03T17:05:32.398207] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-03T17:05:32.399899] [DEBUG] [LOCAL ] AESI: Trimmed 70535 records to 50229 (keeping 200 days of data) [2025-10-03T17:05:32.738877] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T17:05:32.758672] [DEBUG] [LOCAL ] AESI: Primary data saved (50229 records). [2025-10-03T17:05:32.758918] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-03T17:05:32.759112] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AESI took 55.9s. Estimated remaining: 4h 30m 22s. Rate: 8.6 symbols/min [2025-10-03T17:05:32.801940] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-03T17:05:32.982168] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:33.018705] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:05:33.078214] [DEBUG] [LOCAL ] AG: Loaded 54032 existing records from primary storage. [2025-10-03T17:05:33.078559] [INFO ] [MAIN ] AG: Loaded 54032 existing records. [2025-10-03T17:05:33.263464] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:05:33.287713] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:33.289684] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-03T17:05:33.289776] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-03T17:05:33.291439] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-03T17:05:33.291528] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-03T17:05:33.595753] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-03T17:05:33.694073] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:34.048242] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T17:05:34.390731] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-03T17:05:34.891971] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T17:05:35.190710] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-03T17:05:35.634050] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:05:35.990690] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-03T17:05:36.790699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-03T17:05:37.277045] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T17:05:37.590695] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-03T17:05:37.696871] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:05:38.390712] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-03T17:05:39.190631] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-03T17:05:39.546083] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T17:05:39.561773] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T17:05:39.890552] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:05:39.990710] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-03T17:05:40.790723] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-03T17:05:41.313929] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:41.590638] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-03T17:05:41.687055] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T17:05:42.390690] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-03T17:05:43.190747] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-03T17:05:43.200553] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T17:05:43.909878] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-03T17:05:43.990689] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-03T17:05:44.790635] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-03T17:05:44.881371] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:05:45.296977] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-03T17:05:45.590704] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-03T17:05:45.705788] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:05:46.005341] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T17:05:46.390710] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-03T17:05:47.190682] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-03T17:05:47.664625] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:05:47.990677] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-03T17:05:48.207806] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:05:48.464575] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T17:05:48.790627] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-03T17:05:49.590719] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-03T17:05:50.390699] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-03T17:05:50.470801] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:05:50.819918] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-03T17:05:50.820623] [INFO ] [REMOTE ] AFGD: Full fetch complete (3112 records). [2025-10-03T17:05:50.820722] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-03T17:05:51.197334] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-03T17:05:51.295447] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-03T17:05:51.295804] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-03T17:05:51.296089] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-03T17:05:51.296180] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-03T17:05:51.296895] [DEBUG] [LOCAL ] AFGD: Trimmed 3112 records to 1836 (keeping 200 days of data) [2025-10-03T17:05:51.309966] [DEBUG] [LOCAL ] AFGD: Primary data saved (1836 records). [2025-10-03T17:05:51.310052] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-03T17:05:51.310201] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 36.7s. Estimated remaining: 4h 39m 35s. Rate: 8.3 symbols/min [2025-10-03T17:05:51.511730] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:05:51.550956] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:05:51.602247] [DEBUG] [LOCAL ] AGCO: Loaded 42677 existing records from primary storage. [2025-10-03T17:05:51.602559] [INFO ] [MAIN ] AGCO: Loaded 42677 existing records. [2025-10-03T17:05:51.713074] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T17:05:51.798670] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:05:51.798951] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-03T17:05:51.799012] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-03T17:05:51.799512] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-03T17:05:51.799574] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-03T17:05:52.020366] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-03T17:05:52.251841] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:05:52.790695] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-03T17:05:53.590731] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-03T17:05:54.243324] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T17:05:54.390735] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-03T17:05:54.521788] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:05:55.190691] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-03T17:05:55.441668] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T17:05:55.990743] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-03T17:05:56.295209] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:05:56.495110] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T17:05:56.604504] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:05:56.790720] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-03T17:05:57.374353] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T17:05:57.590683] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-03T17:05:58.020571] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:05:58.390720] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-03T17:05:59.190740] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-03T17:05:59.556959] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T17:05:59.557754] [INFO ] [REMOTE ] AFGE: Full fetch complete (3479 records). [2025-10-03T17:05:59.557831] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-03T17:05:59.974100] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-03T17:05:59.974215] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-03T17:05:59.974667] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-03T17:05:59.983017] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-03T17:05:59.999935] [DEBUG] [LOCAL ] AFGE: Trimmed 3479 records to 2471 (keeping 200 days of data) [2025-10-03T17:05:59.996396] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-03T17:06:00.004924] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:06:00.037171] [DEBUG] [LOCAL ] AFGE: Primary data saved (2471 records). [2025-10-03T17:06:00.038152] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-03T17:06:00.038262] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 32.8s. Estimated remaining: 4h 40m 39s. Rate: 8.3 symbols/min [2025-10-03T17:06:00.247013] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:00.272523] [DEBUG] [LOCAL ] AGD: Loaded 18158 existing records from primary storage. [2025-10-03T17:06:00.272870] [INFO ] [MAIN ] AGD: Loaded 18158 existing records. [2025-10-03T17:06:00.484232] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:00.484500] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-03T17:06:00.484550] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-03T17:06:00.485019] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-03T17:06:00.485081] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-03T17:06:00.796710] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-03T17:06:00.889951] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:01.590719] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-03T17:06:02.369395] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-03T17:06:02.390614] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-03T17:06:02.797466] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T17:06:02.838724] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:06:03.190695] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-03T17:06:03.990706] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-03T17:06:04.257054] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T17:06:04.551455] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T17:06:04.790729] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-03T17:06:05.590730] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-03T17:06:05.803322] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:06:06.390731] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-03T17:06:07.101626] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-10-03T17:06:07.114535] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:06:07.190729] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-03T17:06:07.633388] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T17:06:07.964885] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T17:06:07.990720] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-03T17:06:08.790703] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-03T17:06:09.248792] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T17:06:09.590725] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-03T17:06:10.262421] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:06:10.265427] [INFO ] [REMOTE ] AFL: Full fetch complete (76913 records). [2025-10-03T17:06:10.265557] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-03T17:06:10.395824] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-03T17:06:10.653456] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:06:10.765494] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-03T17:06:10.765593] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-03T17:06:10.766489] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-03T17:06:10.766560] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-03T17:06:10.771489] [DEBUG] [LOCAL ] AFL: Trimmed 76913 records to 53923 (keeping 200 days of data) [2025-10-03T17:06:11.129803] [DEBUG] [LOCAL ] AFL: Primary data saved (53923 records). [2025-10-03T17:06:11.129975] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-03T17:06:11.131560] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AFL took 41.1s. Estimated remaining: 4h 43m 29s. Rate: 8.2 symbols/min [2025-10-03T17:06:11.199491] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-03T17:06:11.317119] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:11.317329] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-03T17:06:11.317371] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-03T17:06:11.317512] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-03T17:06:11.317583] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-03T17:06:11.317662] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-03T17:06:11.317741] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-03T17:06:11.701961] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:11.990635] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-03T17:06:12.224212] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T17:06:12.248501] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:06:12.790707] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-03T17:06:13.590638] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-03T17:06:13.914298] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T17:06:13.945182] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:06:14.390724] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-03T17:06:15.067133] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:06:15.190706] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-03T17:06:15.417427] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T17:06:15.990708] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-03T17:06:16.790717] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-03T17:06:17.558144] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:06:17.598480] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-03T17:06:17.602128] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:06:17.654810] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-10-03T17:06:18.390714] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-03T17:06:19.081701] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:06:19.190635] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-03T17:06:19.405034] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T17:06:19.990718] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-03T17:06:20.790744] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-03T17:06:21.006485] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T17:06:21.172993] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T17:06:21.590677] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-03T17:06:21.616853] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T17:06:21.618157] [INFO ] [REMOTE ] AGD: Full fetch complete (25510 records). [2025-10-03T17:06:21.618240] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-03T17:06:21.618860] [FATAL] [VALIDATOR ] AGD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:06:21.618949] [FATAL] [MAIN ] AGD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:06:21.618997] [WARN ] [MAIN ] AGD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:06:21.619049] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-03T17:06:21.619111] [DEBUG] [LOCAL ] AGD: No primary data file found to delete. [2025-10-03T17:06:21.619156] [INFO ] [LOCAL ] AGD: Starting deletion of derivative data. [2025-10-03T17:06:21.619459] [DEBUG] [LOCAL ] AGD: Deleted derivative data file. [2025-10-03T17:06:21.619569] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AGD took 21.6s. Estimated remaining: 4h 45m 46s. Rate: 8.1 symbols/min [2025-10-03T17:06:21.809106] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:21.877182] [DEBUG] [LOCAL ] AGL: Loaded 52833 existing records from primary storage. [2025-10-03T17:06:21.877664] [INFO ] [MAIN ] AGL: Loaded 52833 existing records. [2025-10-03T17:06:22.077085] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:22.077316] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-03T17:06:22.077365] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-03T17:06:22.078014] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-03T17:06:22.078092] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-03T17:06:22.396106] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-03T17:06:22.546024] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:23.190698] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-03T17:06:23.445873] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:06:23.449013] [INFO ] [REMOTE ] AG: Full fetch complete (77607 records). [2025-10-03T17:06:23.449168] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-03T17:06:23.901526] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-03T17:06:23.901759] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-03T17:06:23.902600] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-03T17:06:23.902715] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-03T17:06:23.904806] [DEBUG] [LOCAL ] AG: Trimmed 77607 records to 54422 (keeping 200 days of data) [2025-10-03T17:06:23.998024] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-03T17:06:24.039631] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:06:24.287566] [DEBUG] [LOCAL ] AG: Primary data saved (54422 records). [2025-10-03T17:06:24.287748] [INFO ] [MAIN ] AG: Full history saved. [2025-10-03T17:06:24.287846] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AG took 51.5s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-10-03T17:06:24.478707] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:24.491821] [DEBUG] [LOCAL ] AGM: Loaded 10296 existing records from primary storage. [2025-10-03T17:06:24.492097] [INFO ] [MAIN ] AGM: Loaded 10296 existing records. [2025-10-03T17:06:24.687361] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:24.687595] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-03T17:06:24.687668] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-03T17:06:24.687961] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-03T17:06:24.688182] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-03T17:06:24.793682] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-03T17:06:25.098362] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:25.133830] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:06:25.590716] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-03T17:06:25.730991] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:06:26.183368] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:06:26.187468] [INFO ] [REMOTE ] AGCO: Full fetch complete (61874 records). [2025-10-03T17:06:26.187628] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-03T17:06:26.396861] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-03T17:06:26.603007] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-03T17:06:26.603108] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-03T17:06:26.603778] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-03T17:06:26.603846] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-03T17:06:26.605346] [DEBUG] [LOCAL ] AGCO: Trimmed 61874 records to 42995 (keeping 200 days of data) [2025-10-03T17:06:26.891337] [DEBUG] [LOCAL ] AGCO: Primary data saved (42995 records). [2025-10-03T17:06:26.891499] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-03T17:06:26.892940] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGCO took 35.6s. Estimated remaining: 4h 38m 35s. Rate: 8.3 symbols/min [2025-10-03T17:06:27.087998] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:27.152039] [DEBUG] [LOCAL ] AGO: Loaded 28176 existing records from primary storage. [2025-10-03T17:06:27.154431] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T17:06:27.154987] [INFO ] [MAIN ] AGO: Loaded 28176 existing records. [2025-10-03T17:06:27.202494] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-03T17:06:27.372941] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:27.373177] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-03T17:06:27.373227] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-03T17:06:27.373872] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-03T17:06:27.373936] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-03T17:06:27.762476] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:27.990700] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-03T17:06:28.098109] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T17:06:28.102546] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:06:28.790664] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-03T17:06:28.880107] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:06:29.337245] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-03T17:06:29.590685] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-03T17:06:30.305871] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:06:30.390708] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-03T17:06:31.083722] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T17:06:31.190693] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-03T17:06:31.990697] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-03T17:06:32.785132] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T17:06:32.795603] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-03T17:06:32.837206] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T17:06:33.458598] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T17:06:33.590686] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-03T17:06:34.369269] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:06:34.390639] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-03T17:06:35.146795] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:06:35.190695] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-03T17:06:35.996605] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-03T17:06:35.997530] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:06:36.790715] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-03T17:06:37.573034] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:06:37.590682] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-03T17:06:37.985637] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:06:38.390699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-03T17:06:38.657156] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:06:39.190707] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-03T17:06:39.990638] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-03T17:06:40.477718] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:06:40.749712] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:06:40.790639] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-03T17:06:40.974559] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:06:41.590708] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-03T17:06:42.037219] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:06:42.390689] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-03T17:06:43.197721] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-03T17:06:43.223004] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T17:06:43.990694] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-03T17:06:44.121074] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:06:44.276444] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:06:44.277831] [INFO ] [REMOTE ] AGM: Full fetch complete (12887 records). [2025-10-03T17:06:44.277924] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-03T17:06:44.702823] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-03T17:06:44.702933] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-03T17:06:44.703203] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-03T17:06:44.703254] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-03T17:06:44.703988] [DEBUG] [LOCAL ] AGM: Trimmed 12887 records to 10383 (keeping 200 days of data) [2025-10-03T17:06:44.778582] [DEBUG] [LOCAL ] AGM: Primary data saved (10383 records). [2025-10-03T17:06:44.778758] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-03T17:06:44.778877] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 20.5s. Estimated remaining: 4h 46m 5s. Rate: 8.1 symbols/min [2025-10-03T17:06:44.795820] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-03T17:06:44.991282] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:45.027611] [DEBUG] [LOCAL ] AGRO: Loaded 33687 existing records from primary storage. [2025-10-03T17:06:45.027958] [INFO ] [MAIN ] AGRO: Loaded 33687 existing records. [2025-10-03T17:06:45.238540] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:45.239093] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-03T17:06:45.239224] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-03T17:06:45.239771] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-03T17:06:45.239860] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-03T17:06:45.495022] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:06:45.597037] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-03T17:06:45.823577] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:46.390692] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-03T17:06:46.522759] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:06:46.922577] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T17:06:47.190707] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-03T17:06:47.838783] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:06:47.990717] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-03T17:06:48.790703] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-03T17:06:49.130929] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:06:49.590699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-03T17:06:49.874368] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T17:06:49.935883] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:06:50.390690] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-03T17:06:51.190682] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-03T17:06:51.459057] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:06:51.541751] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T17:06:51.990718] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-03T17:06:52.795960] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-03T17:06:52.817476] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:06:53.581433] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:06:53.590610] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-03T17:06:54.164129] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:06:54.325027] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:06:54.390738] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-03T17:06:55.190726] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-03T17:06:55.227500] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:06:55.229711] [INFO ] [REMOTE ] AGO: Full fetch complete (39418 records). [2025-10-03T17:06:55.229851] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-03T17:06:55.650981] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-03T17:06:55.651091] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-03T17:06:55.651613] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-03T17:06:55.651705] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-03T17:06:55.653120] [DEBUG] [LOCAL ] AGO: Trimmed 39418 records to 28380 (keeping 200 days of data) [2025-10-03T17:06:55.839034] [DEBUG] [LOCAL ] AGO: Primary data saved (28380 records). [2025-10-03T17:06:55.839183] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-03T17:06:55.839283] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGO took 28.9s. Estimated remaining: 4h 48m 32s. Rate: 8.0 symbols/min [2025-10-03T17:06:55.996187] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-03T17:06:56.024952] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:06:56.065409] [DEBUG] [LOCAL ] AGX: Loaded 33402 existing records from primary storage. [2025-10-03T17:06:56.065744] [INFO ] [MAIN ] AGX: Loaded 33402 existing records. [2025-10-03T17:06:56.265286] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:06:56.265527] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-03T17:06:56.265591] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-03T17:06:56.266094] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-03T17:06:56.266157] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-03T17:06:56.658919] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:06:56.781010] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:06:56.791967] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-03T17:06:57.590693] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-03T17:06:57.800749] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:06:58.267472] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:06:58.390714] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-03T17:06:59.047583] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T17:06:59.050534] [INFO ] [REMOTE ] AGL: Full fetch complete (75547 records). [2025-10-03T17:06:59.050709] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-03T17:06:59.195873] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-03T17:06:59.526706] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-03T17:06:59.526919] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-03T17:06:59.527789] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-03T17:06:59.527880] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-03T17:06:59.529721] [DEBUG] [LOCAL ] AGL: Trimmed 75547 records to 53221 (keeping 200 days of data) [2025-10-03T17:06:59.844685] [DEBUG] [LOCAL ] AGL: Primary data saved (53221 records). [2025-10-03T17:06:59.844857] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-03T17:06:59.845001] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGL took 38.2s. Estimated remaining: 4h 46m 1s. Rate: 8.1 symbols/min [2025-10-03T17:07:00.004719] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-03T17:07:00.085197] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:00.131023] [DEBUG] [LOCAL ] AHH: Loaded 41379 existing records from primary storage. [2025-10-03T17:07:00.131365] [INFO ] [MAIN ] AHH: Loaded 41379 existing records. [2025-10-03T17:07:00.262490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T17:07:00.306029] [INFO ] [REMOTE ] AGI: Full fetch complete (76837 records). [2025-10-03T17:07:00.323137] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-03T17:07:00.348718] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:00.426246] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-03T17:07:00.438549] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-03T17:07:00.470832] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-03T17:07:00.481387] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-03T17:07:01.213693] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-03T17:07:01.253702] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-03T17:07:01.259276] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-03T17:07:01.283305] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:01.283587] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-03T17:07:01.284240] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-03T17:07:01.295514] [DEBUG] [LOCAL ] AGI: Trimmed 76837 records to 54194 (keeping 200 days of data) [2025-10-03T17:07:01.313440] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T17:07:01.592956] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-03T17:07:01.693615] [DEBUG] [LOCAL ] AGI: Primary data saved (54194 records). [2025-10-03T17:07:01.693868] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-03T17:07:01.694006] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGI took 50.6s. Estimated remaining: 4h 42m 7s. Rate: 8.2 symbols/min [2025-10-03T17:07:01.909018] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:01.909254] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-03T17:07:01.909400] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-03T17:07:01.909599] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-03T17:07:01.909702] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-03T17:07:01.909777] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-03T17:07:01.909841] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-03T17:07:02.287506] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-03T17:07:02.357872] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:02.390636] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-03T17:07:02.563916] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:07:02.564327] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-03T17:07:02.564428] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:02.564489] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-03T17:07:02.564576] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:02.564678] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-03T17:07:02.564795] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-03T17:07:02.564866] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-03T17:07:02.564935] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-03T17:07:02.565018] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AHL took 0.9s. Estimated remaining: 4h 37m 43s. Rate: 8.3 symbols/min [2025-10-03T17:07:02.752866] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:02.813209] [DEBUG] [LOCAL ] AHR: Loaded 49515 existing records from primary storage. [2025-10-03T17:07:02.813604] [INFO ] [MAIN ] AHR: Loaded 49515 existing records. [2025-10-03T17:07:03.013438] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:03.013676] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-03T17:07:03.013755] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-03T17:07:03.014341] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-03T17:07:03.014402] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-03T17:07:03.190801] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-03T17:07:03.416719] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:03.471705] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:07:03.624533] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T17:07:03.990717] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-03T17:07:04.412388] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:07:04.790765] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-03T17:07:05.386102] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:07:05.590701] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-03T17:07:06.317494] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:07:06.390726] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-03T17:07:06.701999] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:07:07.190746] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-03T17:07:07.413950] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:07:07.990700] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-03T17:07:08.501488] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T17:07:08.790700] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-03T17:07:08.946577] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T17:07:09.590692] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-03T17:07:10.390673] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-03T17:07:10.414852] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:07:10.709297] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:07:11.190765] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-03T17:07:11.910053] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:07:11.990714] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-03T17:07:12.368805] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:07:12.790708] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-03T17:07:13.550717] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T17:07:13.590714] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-03T17:07:14.316840] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:07:14.390681] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-03T17:07:14.743702] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T17:07:15.190720] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-03T17:07:15.990667] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-03T17:07:16.066596] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:07:16.671037] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:07:16.790688] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-03T17:07:17.590745] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-03T17:07:17.898495] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:07:18.368910] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T17:07:18.390632] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-03T17:07:18.536750] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:07:19.190737] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-03T17:07:19.903164] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:07:19.990744] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-03T17:07:20.790668] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-03T17:07:20.825532] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:07:21.322948] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:07:21.590672] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-03T17:07:21.923626] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:07:21.925592] [INFO ] [REMOTE ] AGRO: Full fetch complete (49605 records). [2025-10-03T17:07:21.925747] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-03T17:07:22.335738] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-03T17:07:22.335833] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-03T17:07:22.336379] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-03T17:07:22.336424] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-03T17:07:22.337622] [DEBUG] [LOCAL ] AGRO: Trimmed 49605 records to 33939 (keeping 200 days of data) [2025-10-03T17:07:22.394709] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-03T17:07:22.550395] [DEBUG] [LOCAL ] AGRO: Primary data saved (33939 records). [2025-10-03T17:07:22.550535] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-03T17:07:22.551289] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AGRO took 37.8s. Estimated remaining: 4h 45m 56s. Rate: 8.1 symbols/min [2025-10-03T17:07:22.750479] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:22.775406] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:07:22.786882] [DEBUG] [LOCAL ] AHT: Loaded 6188 existing records from primary storage. [2025-10-03T17:07:22.787161] [INFO ] [MAIN ] AHT: Loaded 6188 existing records. [2025-10-03T17:07:22.977881] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:22.978148] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-03T17:07:22.978197] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-03T17:07:22.978418] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-03T17:07:22.978477] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-03T17:07:23.195911] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-03T17:07:23.368426] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:23.916370] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T17:07:23.990719] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-03T17:07:24.534473] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:07:24.536343] [INFO ] [REMOTE ] AGX: Full fetch complete (48806 records). [2025-10-03T17:07:24.536440] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-03T17:07:24.798606] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-03T17:07:24.809784] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:07:24.970118] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-03T17:07:24.970247] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-03T17:07:24.970906] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-03T17:07:24.970984] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-03T17:07:24.972290] [DEBUG] [LOCAL ] AGX: Trimmed 48806 records to 33569 (keeping 200 days of data) [2025-10-03T17:07:25.197342] [DEBUG] [LOCAL ] AGX: Primary data saved (33569 records). [2025-10-03T17:07:25.197501] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-03T17:07:25.198936] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AGX took 29.4s. Estimated remaining: 4h 42m 45s. Rate: 8.2 symbols/min [2025-10-03T17:07:25.380218] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:25.438419] [DEBUG] [LOCAL ] AI: Loaded 54140 existing records from primary storage. [2025-10-03T17:07:25.438878] [INFO ] [MAIN ] AI: Loaded 54140 existing records. [2025-10-03T17:07:25.598385] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-03T17:07:25.631341] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:25.631765] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-03T17:07:25.631820] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-03T17:07:25.632181] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-03T17:07:25.632241] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-03T17:07:26.022543] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:26.277926] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T17:07:26.330369] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T17:07:26.390701] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-03T17:07:27.076106] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:07:27.190714] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-03T17:07:27.990693] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-03T17:07:28.748257] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T17:07:28.790740] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-03T17:07:29.566807] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:07:29.599231] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-03T17:07:29.606018] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T17:07:30.390718] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-03T17:07:31.190729] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-03T17:07:31.868820] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:07:31.882110] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:07:31.990713] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-03T17:07:32.221214] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-10-03T17:07:32.790698] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-03T17:07:33.590689] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-03T17:07:33.687776] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:07:33.842566] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:07:34.302067] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T17:07:34.390703] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-03T17:07:35.190705] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-03T17:07:35.522805] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:07:35.525018] [INFO ] [REMOTE ] AHH: Full fetch complete (60168 records). [2025-10-03T17:07:35.525140] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-03T17:07:35.940374] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-03T17:07:35.940462] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-03T17:07:35.941108] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-03T17:07:35.941175] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-03T17:07:35.942426] [DEBUG] [LOCAL ] AHH: Trimmed 60168 records to 41619 (keeping 200 days of data) [2025-10-03T17:07:35.995632] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-03T17:07:36.193022] [DEBUG] [LOCAL ] AHH: Primary data saved (41619 records). [2025-10-03T17:07:36.193153] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-03T17:07:36.193239] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AHH took 36.3s. Estimated remaining: 4h 44m 56s. Rate: 8.1 symbols/min [2025-10-03T17:07:36.375286] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:36.429906] [DEBUG] [LOCAL ] AIG: Loaded 53862 existing records from primary storage. [2025-10-03T17:07:36.430294] [INFO ] [MAIN ] AIG: Loaded 53862 existing records. [2025-10-03T17:07:36.638287] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:36.638554] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-03T17:07:36.638624] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-03T17:07:36.639217] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-03T17:07:36.639277] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-03T17:07:36.766037] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T17:07:36.802325] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-03T17:07:37.040603] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:37.571591] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T17:07:37.595789] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-03T17:07:37.613516] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T17:07:38.390709] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-03T17:07:39.200052] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-03T17:07:39.205986] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:07:39.990692] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-03T17:07:40.467808] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T17:07:40.790711] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-03T17:07:40.857800] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:07:41.374306] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:07:41.590698] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-03T17:07:42.326855] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T17:07:42.390675] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-03T17:07:42.966612] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T17:07:43.190689] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-03T17:07:43.632325] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T17:07:43.990706] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-03T17:07:44.544301] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T17:07:44.648171] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:07:44.790713] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-03T17:07:45.590684] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-03T17:07:46.143487] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:07:46.146193] [INFO ] [REMOTE ] AHR: Full fetch complete (70795 records). [2025-10-03T17:07:46.146323] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-03T17:07:46.395876] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-03T17:07:46.578028] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-03T17:07:46.578141] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-03T17:07:46.578930] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-03T17:07:46.579018] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-03T17:07:46.580781] [DEBUG] [LOCAL ] AHR: Trimmed 70795 records to 49849 (keeping 200 days of data) [2025-10-03T17:07:46.905268] [DEBUG] [LOCAL ] AHR: Primary data saved (49849 records). [2025-10-03T17:07:46.905417] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-03T17:07:46.905526] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHR took 44.3s. Estimated remaining: 4h 46m 52s. Rate: 8.0 symbols/min [2025-10-03T17:07:47.089696] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:47.089944] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-03T17:07:47.089992] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-03T17:07:47.090107] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-03T17:07:47.090151] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-03T17:07:47.090195] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-03T17:07:47.090233] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-03T17:07:47.194311] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-03T17:07:47.182169] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:07:47.209609] [INFO ] [REMOTE ] AHT: Full fetch complete (9310 records). [2025-10-03T17:07:47.230576] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-03T17:07:47.765624] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:47.927291] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-03T17:07:47.927458] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-03T17:07:47.927816] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-03T17:07:47.927895] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-03T17:07:47.928778] [DEBUG] [LOCAL ] AHT: Trimmed 9310 records to 6250 (keeping 200 days of data) [2025-10-03T17:07:47.991192] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-03T17:07:47.998940] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-03T17:07:48.019700] [DEBUG] [LOCAL ] AHT: Primary data saved (6250 records). [2025-10-03T17:07:48.020414] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-03T17:07:48.020628] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AHT took 25.5s. Estimated remaining: 4h 42m 52s. Rate: 8.2 symbols/min [2025-10-03T17:07:48.186023] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:07:48.210005] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-03T17:07:48.212630] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:48.212757] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:48.212985] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-03T17:07:48.213862] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:48.213956] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-03T17:07:48.214040] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-03T17:07:48.214083] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-03T17:07:48.214126] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-03T17:07:48.214186] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AII took 1.3s. Estimated remaining: 4h 38m 26s. Rate: 8.3 symbols/min [2025-10-03T17:07:48.437500] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:48.438771] [DEBUG] [LOCAL ] AIN: Loaded 24750 existing records from primary storage. [2025-10-03T17:07:48.439632] [INFO ] [MAIN ] AIN: Loaded 24750 existing records. [2025-10-03T17:07:48.568909] [DEBUG] [LOCAL ] AIO: Loaded 13422 existing records from primary storage. [2025-10-03T17:07:48.569497] [INFO ] [MAIN ] AIO: Loaded 13422 existing records. [2025-10-03T17:07:48.730624] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:48.744456] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-03T17:07:48.744681] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-03T17:07:48.775636] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-03T17:07:48.775883] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-03T17:07:48.810515] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-03T17:07:48.965709] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:48.994513] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-03T17:07:48.999855] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-03T17:07:49.033570] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-03T17:07:49.067907] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-03T17:07:49.433032] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-10-03T17:07:49.551168] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:49.595765] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-03T17:07:49.724337] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:50.390624] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-03T17:07:50.465516] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:07:51.184932] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-03T17:07:51.196404] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-03T17:07:51.602839] [DEBUG] [REMOTE ] AIO: Error fetching primary data for 2024-12: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-03T17:07:51.603009] [WARN ] [REMOTE ] AIO: No data returned for month 2024-12 [2025-10-03T17:07:51.603086] [FATAL] [REMOTE ] AIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:07:51.603132] [FATAL] [MAIN ] AIO: Failed to fetch primary data. [2025-10-03T17:07:51.603195] [WARN ] [MAIN ] AIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:07:51.603276] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-03T17:07:51.603344] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-03T17:07:51.603385] [INFO ] [LOCAL ] AIO: Starting deletion of derivative data. [2025-10-03T17:07:51.603748] [DEBUG] [LOCAL ] AIO: Deleted derivative data file. [2025-10-03T17:07:51.603824] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AIO took 3.4s. Estimated remaining: 4h 36m 2s. Rate: 8.4 symbols/min [2025-10-03T17:07:51.794599] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:07:51.823426] [DEBUG] [LOCAL ] AIR: Loaded 28562 existing records from primary storage. [2025-10-03T17:07:51.823871] [INFO ] [MAIN ] AIR: Loaded 28562 existing records. [2025-10-03T17:07:51.991293] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-03T17:07:52.026035] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:07:52.027609] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-03T17:07:52.027774] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-03T17:07:52.029359] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-03T17:07:52.029429] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-03T17:07:52.483221] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:07:52.485833] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T17:07:52.790704] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-03T17:07:53.094189] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T17:07:53.590694] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-03T17:07:54.390709] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-03T17:07:54.639228] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:07:55.135232] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-03T17:07:55.190748] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-03T17:07:55.990722] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-03T17:07:56.109281] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:07:56.242616] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:07:56.790728] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-03T17:07:57.590633] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-03T17:07:57.889916] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T17:07:58.251725] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-03T17:07:58.390708] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-03T17:07:59.190706] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-03T17:07:59.519598] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:07:59.990743] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-03T17:08:00.015627] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T17:08:00.790742] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-03T17:08:01.568379] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-10-03T17:08:01.599380] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:08:01.599504] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-03T17:08:02.390736] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-03T17:08:03.190715] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-03T17:08:03.293451] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:08:03.419860] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:08:03.479870] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-10-03T17:08:03.990693] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-03T17:08:04.790675] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-03T17:08:05.174976] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:08:05.590695] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-03T17:08:05.703893] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-10-03T17:08:06.390745] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-03T17:08:06.491568] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:08:06.755343] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T17:08:07.190729] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-03T17:08:07.528375] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:08:07.990730] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-03T17:08:08.776238] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:08:08.790627] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-03T17:08:09.590679] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-03T17:08:09.991426] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T17:08:09.994198] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-03T17:08:09.994385] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-03T17:08:10.404601] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-03T17:08:10.434510] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-03T17:08:10.434619] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-03T17:08:10.435570] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-03T17:08:10.435726] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-03T17:08:10.437826] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54530 (keeping 200 days of data) [2025-10-03T17:08:10.562149] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T17:08:10.826625] [DEBUG] [LOCAL ] AI: Primary data saved (54530 records). [2025-10-03T17:08:10.826851] [INFO ] [MAIN ] AI: Full history saved. [2025-10-03T17:08:10.828276] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AI took 45.6s. Estimated remaining: 4h 42m 56s. Rate: 8.1 symbols/min [2025-10-03T17:08:11.039623] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:11.041682] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:08:11.077056] [DEBUG] [LOCAL ] AIT: Loaded 27668 existing records from primary storage. [2025-10-03T17:08:11.077339] [INFO ] [MAIN ] AIT: Loaded 27668 existing records. [2025-10-03T17:08:11.195849] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-03T17:08:11.274555] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:11.274934] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-03T17:08:11.274999] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-03T17:08:11.275978] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-03T17:08:11.276040] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-03T17:08:11.770546] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:08:11.776866] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:11.990739] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-03T17:08:12.280636] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T17:08:12.790666] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-03T17:08:12.989853] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:08:13.590677] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-03T17:08:13.814540] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:08:14.390712] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-03T17:08:14.682325] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:08:14.684092] [INFO ] [REMOTE ] AIN: Full fetch complete (33530 records). [2025-10-03T17:08:14.684177] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-03T17:08:15.094179] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-03T17:08:15.094310] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-03T17:08:15.094908] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-03T17:08:15.095026] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-03T17:08:15.096167] [DEBUG] [LOCAL ] AIN: Trimmed 33530 records to 24987 (keeping 200 days of data) [2025-10-03T17:08:15.194073] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-03T17:08:15.267633] [DEBUG] [LOCAL ] AIN: Primary data saved (24987 records). [2025-10-03T17:08:15.267899] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-03T17:08:15.273229] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIN took 27.3s. Estimated remaining: 4h 41m 8s. Rate: 8.2 symbols/min [2025-10-03T17:08:15.330189] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:08:15.490370] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:15.490578] [DEBUG] [LOCAL ] AIV: No existing data file found in primary storage. [2025-10-03T17:08:15.490618] [WARN ] [MAIN ] AIV: No existing data found, performing full refresh instead. [2025-10-03T17:08:15.490804] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-03T17:08:15.490858] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-03T17:08:15.490915] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-10-03T17:08:15.490952] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-03T17:08:15.920099] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:15.990680] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-03T17:08:16.416153] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T17:08:16.790730] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-03T17:08:17.428074] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:08:17.590683] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-03T17:08:17.851579] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T17:08:18.390695] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-03T17:08:18.920106] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:08:18.922347] [INFO ] [REMOTE ] AIG: Full fetch complete (76991 records). [2025-10-03T17:08:18.922462] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-03T17:08:18.925883] [FATAL] [VALIDATOR ] AIG: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:08:18.925973] [FATAL] [MAIN ] AIG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:08:18.926018] [WARN ] [MAIN ] AIG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:08:18.926116] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-03T17:08:18.926206] [DEBUG] [LOCAL ] AIG: No primary data file found to delete. [2025-10-03T17:08:18.926290] [INFO ] [LOCAL ] AIG: Starting deletion of derivative data. [2025-10-03T17:08:18.926526] [DEBUG] [LOCAL ] AIG: Deleted derivative data file. [2025-10-03T17:08:18.926621] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIG took 42.7s. Estimated remaining: 4h 38m 56s. Rate: 8.3 symbols/min [2025-10-03T17:08:19.119393] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:19.157426] [DEBUG] [LOCAL ] AIZ: Loaded 30062 existing records from primary storage. [2025-10-03T17:08:19.157799] [INFO ] [MAIN ] AIZ: Loaded 30062 existing records. [2025-10-03T17:08:19.196155] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-03T17:08:19.362011] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:19.362242] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-03T17:08:19.362305] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-03T17:08:19.362763] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-03T17:08:19.362824] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-03T17:08:19.781453] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:19.796161] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:08:19.990692] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-03T17:08:20.275201] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:08:20.790746] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-03T17:08:21.461500] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:08:21.590741] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-03T17:08:22.175448] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:08:22.390719] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-03T17:08:22.789560] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:08:23.190735] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-03T17:08:23.754237] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:08:23.990707] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-03T17:08:24.627588] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:08:24.790736] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-03T17:08:25.057090] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:08:25.590688] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-03T17:08:25.893090] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:08:26.390738] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-03T17:08:26.729515] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:08:26.732137] [INFO ] [REMOTE ] AIR: Full fetch complete (38938 records). [2025-10-03T17:08:26.732260] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-03T17:08:26.732969] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:08:26.733069] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:08:26.733115] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:08:26.733157] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-03T17:08:26.733226] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-10-03T17:08:26.733266] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-10-03T17:08:26.733465] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-10-03T17:08:26.733604] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIR took 35.1s. Estimated remaining: 4h 39m 7s. Rate: 8.2 symbols/min [2025-10-03T17:08:26.935364] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:26.942558] [DEBUG] [LOCAL ] AIZN: Loaded 4082 existing records from primary storage. [2025-10-03T17:08:26.942784] [INFO ] [MAIN ] AIZN: Loaded 4082 existing records. [2025-10-03T17:08:27.132457] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:27.132707] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-03T17:08:27.132766] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-03T17:08:27.133026] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-03T17:08:27.133154] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-03T17:08:27.198500] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-03T17:08:27.537019] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:27.556707] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:08:27.990685] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-03T17:08:28.605428] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:08:28.790706] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-03T17:08:29.271728] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T17:08:29.461627] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:08:29.590699] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-03T17:08:30.390695] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-03T17:08:30.673874] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T17:08:31.009794] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:08:31.190689] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-03T17:08:31.990685] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-03T17:08:32.506190] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:08:32.790707] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-03T17:08:33.522511] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:08:33.590707] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-03T17:08:34.135964] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:08:34.390677] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-03T17:08:34.822457] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T17:08:35.190637] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-03T17:08:35.333907] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T17:08:35.627864] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T17:08:35.990686] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-03T17:08:36.565930] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T17:08:36.790681] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-03T17:08:37.374185] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T17:08:37.590859] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-03T17:08:38.390684] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-03T17:08:39.052493] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:08:39.190636] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-03T17:08:39.358807] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:08:39.820167] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T17:08:39.990702] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-03T17:08:40.585569] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T17:08:40.790716] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-03T17:08:41.590700] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-03T17:08:42.107364] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:08:42.390630] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-03T17:08:42.499714] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:08:42.950422] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T17:08:43.190705] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-03T17:08:43.990730] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-03T17:08:44.318053] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:08:44.320107] [INFO ] [REMOTE ] AIZ: Full fetch complete (42937 records). [2025-10-03T17:08:44.320232] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-03T17:08:44.781274] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-03T17:08:44.781422] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-03T17:08:44.782411] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-03T17:08:44.782513] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-03T17:08:44.793858] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-03T17:08:44.798590] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:08:44.804811] [DEBUG] [LOCAL ] AIZ: Trimmed 42937 records to 30255 (keeping 200 days of data) [2025-10-03T17:08:45.005821] [DEBUG] [LOCAL ] AIZ: Primary data saved (30255 records). [2025-10-03T17:08:45.005995] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-03T17:08:45.006092] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIZ took 26.1s. Estimated remaining: 4h 45m 1s. Rate: 8.1 symbols/min [2025-10-03T17:08:45.189766] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:45.195770] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T17:08:45.243908] [DEBUG] [LOCAL ] AJG: Loaded 47189 existing records from primary storage. [2025-10-03T17:08:45.244329] [INFO ] [MAIN ] AJG: Loaded 47189 existing records. [2025-10-03T17:08:45.430849] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:45.431120] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-03T17:08:45.431172] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-03T17:08:45.432803] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-03T17:08:45.432868] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-03T17:08:45.601087] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-03T17:08:45.825795] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:46.243674] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T17:08:46.390742] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-03T17:08:47.190727] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-03T17:08:47.490855] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T17:08:47.494151] [INFO ] [REMOTE ] AIT: Full fetch complete (39365 records). [2025-10-03T17:08:47.494448] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-03T17:08:47.997331] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-03T17:08:47.996125] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-03T17:08:47.997572] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-03T17:08:47.998497] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-03T17:08:47.999825] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-03T17:08:48.002083] [DEBUG] [LOCAL ] AIT: Trimmed 39365 records to 27793 (keeping 200 days of data) [2025-10-03T17:08:48.253761] [DEBUG] [LOCAL ] AIT: Primary data saved (27793 records). [2025-10-03T17:08:48.253926] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-03T17:08:48.254074] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIT took 37.4s. Estimated remaining: 4h 42m 38s. Rate: 8.1 symbols/min [2025-10-03T17:08:48.495169] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:48.496632] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-03T17:08:48.496729] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-03T17:08:48.496852] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-03T17:08:48.496898] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-03T17:08:48.496943] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-03T17:08:48.496979] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-03T17:08:48.591303] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T17:08:48.622399] [INFO ] [REMOTE ] AIZN: Full fetch complete (5918 records). [2025-10-03T17:08:48.635809] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-03T17:08:48.797896] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-03T17:08:49.313940] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:49.385488] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-03T17:08:49.385621] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-03T17:08:49.386022] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-03T17:08:49.386105] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-03T17:08:49.386811] [DEBUG] [LOCAL ] AIZN: Trimmed 5918 records to 4108 (keeping 200 days of data) [2025-10-03T17:08:49.444787] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T17:08:49.458961] [DEBUG] [LOCAL ] AIZN: Primary data saved (4108 records). [2025-10-03T17:08:49.459124] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-03T17:08:49.459221] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIZN took 22.7s. Estimated remaining: 4h 39m 13s. Rate: 8.2 symbols/min [2025-10-03T17:08:49.595794] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-03T17:08:49.646061] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:08:49.693615] [DEBUG] [LOCAL ] AKR: Loaded 46065 existing records from primary storage. [2025-10-03T17:08:49.693999] [INFO ] [MAIN ] AKR: Loaded 46065 existing records. [2025-10-03T17:08:49.880057] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:08:49.880355] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-03T17:08:49.880418] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-03T17:08:49.884172] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-03T17:08:49.884249] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-03T17:08:50.280780] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:08:50.309787] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:08:50.390718] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-03T17:08:51.190732] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-03T17:08:51.382008] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T17:08:51.563606] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:08:51.990695] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-03T17:08:52.790689] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-03T17:08:52.963142] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:08:53.065944] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T17:08:53.258761] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T17:08:53.590681] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-03T17:08:54.039174] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:08:54.390752] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-03T17:08:55.190729] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-03T17:08:55.840254] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:08:55.990705] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-03T17:08:56.245167] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T17:08:56.461172] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T17:08:56.790705] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-03T17:08:57.590674] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-03T17:08:58.031239] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:08:58.390729] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-03T17:08:58.456388] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:08:59.190734] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-03T17:08:59.853258] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:08:59.990724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-03T17:09:00.485774] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-03T17:09:00.517339] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T17:09:00.790704] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-03T17:09:01.590681] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-03T17:09:02.390730] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-03T17:09:02.601045] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:09:03.190670] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-03T17:09:03.346189] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:09:03.990719] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-03T17:09:04.234428] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:09:04.437501] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:09:04.440258] [INFO ] [REMOTE ] AIV: Full fetch complete (59929 records). [2025-10-03T17:09:04.440397] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-03T17:09:04.792406] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-03T17:09:04.895631] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-03T17:09:04.895763] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-03T17:09:04.896482] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-03T17:09:04.896546] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-03T17:09:04.898325] [DEBUG] [LOCAL ] AIV: Trimmed 59929 records to 41125 (keeping 200 days of data) [2025-10-03T17:09:05.140611] [DEBUG] [LOCAL ] AIV: Primary data saved (41125 records). [2025-10-03T17:09:05.140773] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-03T17:09:05.140879] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIV took 49.9s. Estimated remaining: 4h 43m 30s. Rate: 8.1 symbols/min [2025-10-03T17:09:05.344144] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:05.406354] [DEBUG] [LOCAL ] AL: Loaded 44640 existing records from primary storage. [2025-10-03T17:09:05.406944] [INFO ] [MAIN ] AL: Loaded 44640 existing records. [2025-10-03T17:09:05.593334] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-03T17:09:05.643560] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:05.649267] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-03T17:09:05.662428] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-03T17:09:05.666132] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-03T17:09:05.666237] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-03T17:09:05.667701] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T17:09:06.070737] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:06.367386] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T17:09:06.390628] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-03T17:09:06.506324] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:09:06.870739] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T17:09:07.190694] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-03T17:09:07.990695] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-03T17:09:08.309723] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-03T17:09:08.796440] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-03T17:09:08.799564] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:09:09.132680] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-03T17:09:09.590680] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-03T17:09:09.931144] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T17:09:10.390732] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-03T17:09:10.802257] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T17:09:10.802994] [INFO ] [REMOTE ] AKA: Full fetch complete (2406 records). [2025-10-03T17:09:10.803071] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-03T17:09:11.000674] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T17:09:11.000943] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:09:11.001010] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:09:11.001055] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-03T17:09:11.001173] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-03T17:09:11.001236] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-03T17:09:11.001285] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-03T17:09:11.001387] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AKA took 22.7s. Estimated remaining: 4h 42m 35s. Rate: 8.1 symbols/min [2025-10-03T17:09:11.179348] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:11.190719] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-03T17:09:11.243610] [DEBUG] [LOCAL ] ALB: Loaded 53622 existing records from primary storage. [2025-10-03T17:09:11.244003] [INFO ] [MAIN ] ALB: Loaded 53622 existing records. [2025-10-03T17:09:11.438755] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:11.438990] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-03T17:09:11.439040] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-03T17:09:11.439629] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-03T17:09:11.439728] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-03T17:09:11.844700] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:11.990733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-03T17:09:12.530721] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:09:12.790720] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-03T17:09:13.590733] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-03T17:09:13.916247] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:09:14.072349] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T17:09:14.390731] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-03T17:09:15.190685] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-03T17:09:15.344772] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T17:09:15.552122] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T17:09:15.990705] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-03T17:09:16.695926] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:09:16.790713] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-03T17:09:17.596801] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-03T17:09:17.603264] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:09:17.914712] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:09:18.390745] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-03T17:09:19.195807] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-03T17:09:19.215719] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T17:09:19.990687] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-03T17:09:20.056769] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:09:20.790704] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-03T17:09:20.874525] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:09:21.237467] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:09:21.590764] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-03T17:09:22.390635] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-03T17:09:22.503171] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:09:23.102414] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:09:23.190698] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-03T17:09:23.821239] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T17:09:23.990688] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-03T17:09:24.623897] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:09:24.626426] [INFO ] [REMOTE ] AJG: Full fetch complete (69444 records). [2025-10-03T17:09:24.626599] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-03T17:09:24.795847] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-03T17:09:25.067827] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-03T17:09:25.067918] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-03T17:09:25.068703] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-03T17:09:25.068775] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-03T17:09:25.070401] [DEBUG] [LOCAL ] AJG: Trimmed 69444 records to 47485 (keeping 200 days of data) [2025-10-03T17:09:25.390767] [DEBUG] [LOCAL ] AJG: Primary data saved (47485 records). [2025-10-03T17:09:25.390994] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-03T17:09:25.391128] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AJG took 40.4s. Estimated remaining: 4h 46m 2s. Rate: 8.0 symbols/min [2025-10-03T17:09:25.591137] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-03T17:09:25.591023] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:25.592336] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-03T17:09:25.592422] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-03T17:09:25.592615] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-03T17:09:25.592701] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-03T17:09:25.592799] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-03T17:09:25.592854] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-03T17:09:25.822919] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:09:26.068512] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:26.197633] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T17:09:26.390688] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-03T17:09:27.190673] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-03T17:09:27.394525] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:09:27.443234] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:09:27.990694] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-03T17:09:28.795732] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-03T17:09:28.812933] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:09:29.190027] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:09:29.590680] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-03T17:09:30.390628] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-03T17:09:30.680859] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:09:31.143360] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T17:09:31.190675] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-03T17:09:31.653906] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:09:31.656406] [INFO ] [REMOTE ] AKR: Full fetch complete (65502 records). [2025-10-03T17:09:31.656522] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-03T17:09:31.995724] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-03T17:09:32.089312] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-03T17:09:32.089404] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-03T17:09:32.090055] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-03T17:09:32.090119] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-03T17:09:32.091484] [DEBUG] [LOCAL ] AKR: Trimmed 65502 records to 46431 (keeping 200 days of data) [2025-10-03T17:09:32.388099] [DEBUG] [LOCAL ] AKR: Primary data saved (46431 records). [2025-10-03T17:09:32.388285] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-03T17:09:32.388430] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AKR took 42.9s. Estimated remaining: 4h 45m 40s. Rate: 8.0 symbols/min [2025-10-03T17:09:32.536145] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:09:32.630499] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:32.671607] [DEBUG] [LOCAL ] ALE: Loaded 30960 existing records from primary storage. [2025-10-03T17:09:32.671960] [INFO ] [MAIN ] ALE: Loaded 30960 existing records. [2025-10-03T17:09:32.795717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-03T17:09:32.865699] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:32.866310] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-03T17:09:32.866370] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-03T17:09:32.866750] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-03T17:09:32.866824] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-03T17:09:33.275538] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:33.591740] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-03T17:09:33.595084] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:09:34.390717] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-03T17:09:34.637426] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:09:34.866896] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T17:09:35.190758] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-03T17:09:35.990764] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-03T17:09:36.064167] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:09:36.790695] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-03T17:09:36.937941] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:09:37.287223] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:09:37.590699] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-03T17:09:38.390690] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-03T17:09:38.476376] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:09:38.686502] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:09:39.190727] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-03T17:09:39.990775] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-03T17:09:40.336252] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T17:09:40.542097] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-03T17:09:40.790722] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-03T17:09:41.475247] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T17:09:41.478720] [INFO ] [REMOTE ] AL: Full fetch complete (62761 records). [2025-10-03T17:09:41.478910] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-03T17:09:41.596213] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-03T17:09:41.908939] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-03T17:09:41.909043] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-03T17:09:41.909816] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-03T17:09:41.909892] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-03T17:09:41.911499] [DEBUG] [LOCAL ] AL: Trimmed 62761 records to 44986 (keeping 200 days of data) [2025-10-03T17:09:42.203722] [DEBUG] [LOCAL ] AL: Primary data saved (44986 records). [2025-10-03T17:09:42.203870] [INFO ] [MAIN ] AL: Full history saved. [2025-10-03T17:09:42.207220] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AL took 37.1s. Estimated remaining: 4h 46m 42s. Rate: 8.0 symbols/min [2025-10-03T17:09:42.390685] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-03T17:09:42.643358] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:09:42.960962] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:09:43.190710] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-03T17:09:43.990701] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-03T17:09:44.099227] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:09:44.378155] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:09:44.790736] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-03T17:09:45.590710] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-03T17:09:45.815857] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:09:46.390752] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-03T17:09:46.910888] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:09:47.131091] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T17:09:47.190632] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-03T17:09:47.990724] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-03T17:09:48.128155] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:09:48.790763] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-03T17:09:49.423246] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T17:09:49.461013] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:09:49.590734] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-03T17:09:50.390638] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-03T17:09:50.493163] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:09:51.190723] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-03T17:09:51.372411] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:09:51.990700] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-03T17:09:52.150004] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T17:09:52.790727] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-03T17:09:52.998713] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:09:53.434906] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:09:53.590721] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-03T17:09:54.390736] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-03T17:09:54.679480] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T17:09:54.682106] [INFO ] [REMOTE ] ALB: Full fetch complete (76855 records). [2025-10-03T17:09:54.682231] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-03T17:09:54.831432] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:09:54.862999] [INFO ] [REMOTE ] ALC: Full fetch complete (73041 records). [2025-10-03T17:09:54.893744] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-03T17:09:55.371746] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-03T17:09:55.371882] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-03T17:09:55.399287] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-03T17:09:55.428683] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-03T17:09:55.490204] [DEBUG] [LOCAL ] ALB: Trimmed 76855 records to 54012 (keeping 200 days of data) [2025-10-03T17:09:55.594858] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-10-03T17:09:55.594952] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-10-03T17:09:55.595751] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-10-03T17:09:55.595820] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-10-03T17:09:55.665705] [DEBUG] [LOCAL ] ALC: Trimmed 73041 records to 51600 (keeping 200 days of data) [2025-10-03T17:09:55.691910] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:09:55.696207] [INFO ] [REMOTE ] ALE: Full fetch complete (43110 records). [2025-10-03T17:09:55.697882] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-03T17:09:56.343227] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-03T17:09:56.343936] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-03T17:09:56.356263] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-03T17:09:56.384192] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-03T17:09:56.451809] [DEBUG] [LOCAL ] ALE: Trimmed 43110 records to 31333 (keeping 200 days of data) [2025-10-03T17:09:56.801707] [DEBUG] [LOCAL ] ALC: Primary data saved (51600 records). [2025-10-03T17:09:56.802725] [INFO ] [MAIN ] ALC: Full history saved. [2025-10-03T17:09:56.803469] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALC took 31.4s. Estimated remaining: 4h 50m 3s. Rate: 7.9 symbols/min [2025-10-03T17:09:56.916264] [DEBUG] [LOCAL ] ALE: Primary data saved (31333 records). [2025-10-03T17:09:56.911889] [DEBUG] [LOCAL ] ALB: Primary data saved (54012 records). [2025-10-03T17:09:56.916440] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-03T17:09:56.916563] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALE took 24.5s. Estimated remaining: 4h 46m 19s. Rate: 8.0 symbols/min [2025-10-03T17:09:56.916703] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-03T17:09:56.919498] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALB took 45.9s. Estimated remaining: 4h 42m 37s. Rate: 8.1 symbols/min [2025-10-03T17:09:57.478467] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.582034] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.654712] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.686580] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:09:57.696724] [DEBUG] [LOCAL ] ALG: Loaded 10293 existing records from primary storage. [2025-10-03T17:09:57.697047] [INFO ] [MAIN ] ALG: Loaded 10293 existing records. [2025-10-03T17:09:57.957588] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:57.989979] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-03T17:09:57.992029] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-03T17:09:57.992798] [DEBUG] [LOCAL ] ALIT: Loaded 53155 existing records from primary storage. [2025-10-03T17:09:57.991797] [DEBUG] [LOCAL ] ALEX: Loaded 31342 existing records from primary storage. [2025-10-03T17:09:57.993299] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-03T17:09:57.993708] [INFO ] [MAIN ] ALIT: Loaded 53155 existing records. [2025-10-03T17:09:57.993834] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-03T17:09:57.999387] [INFO ] [MAIN ] ALEX: Loaded 31342 existing records. [2025-10-03T17:09:58.300523] [DEBUG] [LOCAL ] ALK: Loaded 53444 existing records from primary storage. [2025-10-03T17:09:58.368230] [INFO ] [MAIN ] ALK: Loaded 53444 existing records. [2025-10-03T17:09:58.620128] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:58.748937] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:58.776794] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-03T17:09:58.768954] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-03T17:09:58.803708] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-03T17:09:58.825181] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-03T17:09:58.873568] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-03T17:09:58.888115] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-03T17:09:58.916849] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-03T17:09:58.946993] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-03T17:09:58.941702] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:09:59.043317] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-03T17:09:59.119466] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-03T17:09:59.226157] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-03T17:09:59.269215] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-03T17:09:59.296547] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:09:59.359350] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-03T17:10:00.213881] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.264065] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.275150] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-03T17:10:00.277434] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-03T17:10:00.398715] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:00.401489] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-03T17:10:00.401092] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T17:10:00.406777] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-03T17:10:01.380610] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:10:01.384868] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-03T17:10:02.056719] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:10:02.054823] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:10:02.083778] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-03T17:10:02.087001] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T17:10:02.087583] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-03T17:10:02.091124] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-03T17:10:02.255936] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:10:02.390763] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-03T17:10:03.174117] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:10:03.190627] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-03T17:10:03.270416] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T17:10:03.550637] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:10:03.990673] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-03T17:10:04.124910] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:10:04.144516] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T17:10:04.790729] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-03T17:10:05.540592] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:10:05.590637] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-03T17:10:06.172943] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T17:10:06.390702] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-03T17:10:07.190671] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-03T17:10:07.291132] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T17:10:07.331811] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T17:10:07.990701] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-03T17:10:08.790670] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-03T17:10:08.929353] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T17:10:09.014503] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T17:10:09.590728] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-03T17:10:09.922121] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T17:10:10.390734] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-03T17:10:11.013667] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:10:11.190733] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-03T17:10:11.990678] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-03T17:10:12.134870] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:10:12.160588] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T17:10:12.790746] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-03T17:10:13.348677] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T17:10:13.590722] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-03T17:10:14.390795] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-03T17:10:14.649804] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-10-03T17:10:15.132491] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:10:15.190735] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-03T17:10:15.909460] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T17:10:15.910558] [INFO ] [REMOTE ] ALG: Full fetch complete (15887 records). [2025-10-03T17:10:15.910711] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-03T17:10:15.996277] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-03T17:10:16.315990] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-03T17:10:16.316183] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-03T17:10:16.316689] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-03T17:10:16.316758] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-03T17:10:16.317392] [DEBUG] [LOCAL ] ALG: Trimmed 15887 records to 10359 (keeping 200 days of data) [2025-10-03T17:10:16.393685] [DEBUG] [LOCAL ] ALG: Primary data saved (10359 records). [2025-10-03T17:10:16.393911] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-03T17:10:16.394027] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 19.5s. Estimated remaining: 4h 48m 10s. Rate: 7.9 symbols/min [2025-10-03T17:10:16.588436] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:16.628079] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:10:16.691309] [DEBUG] [LOCAL ] ALL: Loaded 50411 existing records from primary storage. [2025-10-03T17:10:16.691799] [INFO ] [MAIN ] ALL: Loaded 50411 existing records. [2025-10-03T17:10:16.795966] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-03T17:10:16.908313] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:16.908738] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-03T17:10:16.908802] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-03T17:10:16.909326] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-03T17:10:16.909389] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-03T17:10:17.331047] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:17.453419] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:10:17.590773] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-03T17:10:18.390780] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-03T17:10:18.720682] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T17:10:19.190772] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-03T17:10:19.278913] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:10:19.867149] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:10:19.990761] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-03T17:10:20.686113] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:10:20.790715] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-03T17:10:21.590753] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-03T17:10:21.852534] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T17:10:22.266340] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:10:22.390712] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-03T17:10:22.588216] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:10:23.190716] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-03T17:10:24.003246] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-03T17:10:24.006971] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:10:24.790673] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-03T17:10:24.940205] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:10:25.590722] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-03T17:10:25.713183] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:10:25.761137] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:10:26.390720] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-03T17:10:27.190743] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-03T17:10:27.496861] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:10:27.561427] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:10:27.990738] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-03T17:10:28.790720] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-03T17:10:28.943861] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:10:29.590731] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-03T17:10:29.900806] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:10:30.305871] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:10:30.312551] [INFO ] [REMOTE ] ALIT: Full fetch complete (76432 records). [2025-10-03T17:10:30.313007] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-03T17:10:30.395817] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-03T17:10:30.764402] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T17:10:30.794446] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-03T17:10:30.794575] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-03T17:10:30.795481] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-03T17:10:30.795803] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-03T17:10:30.798515] [DEBUG] [LOCAL ] ALIT: Trimmed 76432 records to 53540 (keeping 200 days of data) [2025-10-03T17:10:31.127966] [DEBUG] [LOCAL ] ALIT: Primary data saved (53540 records). [2025-10-03T17:10:31.128152] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-03T17:10:31.129242] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALIT took 34.2s. Estimated remaining: 4h 51m 23s. Rate: 7.9 symbols/min [2025-10-03T17:10:31.201977] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-03T17:10:31.329254] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:31.389814] [DEBUG] [LOCAL ] ALLE: Loaded 45033 existing records from primary storage. [2025-10-03T17:10:31.390170] [INFO ] [MAIN ] ALLE: Loaded 45033 existing records. [2025-10-03T17:10:31.600002] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:31.601693] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-03T17:10:31.601770] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-03T17:10:31.602898] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-03T17:10:31.602961] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-03T17:10:31.995507] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-03T17:10:32.019935] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:32.307219] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:10:32.363861] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T17:10:32.790810] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-03T17:10:33.590744] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-03T17:10:33.861232] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:10:34.390739] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-03T17:10:34.534035] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T17:10:34.536128] [INFO ] [REMOTE ] ALEX: Full fetch complete (44626 records). [2025-10-03T17:10:34.536248] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-03T17:10:34.930597] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T17:10:35.042214] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-03T17:10:35.042307] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-03T17:10:35.042854] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-03T17:10:35.042923] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-03T17:10:35.044087] [DEBUG] [LOCAL ] ALEX: Trimmed 44626 records to 31583 (keeping 200 days of data) [2025-10-03T17:10:35.218962] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-03T17:10:35.264706] [DEBUG] [LOCAL ] ALEX: Primary data saved (31583 records). [2025-10-03T17:10:35.264870] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-03T17:10:35.264959] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALEX took 38.3s. Estimated remaining: 4h 49m 39s. Rate: 7.9 symbols/min [2025-10-03T17:10:35.456031] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:35.521668] [DEBUG] [LOCAL ] ALLY: Loaded 53605 existing records from primary storage. [2025-10-03T17:10:35.522097] [INFO ] [MAIN ] ALLY: Loaded 53605 existing records. [2025-10-03T17:10:35.728266] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:35.728592] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-03T17:10:35.728690] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-03T17:10:35.729140] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-03T17:10:35.729203] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-03T17:10:35.995872] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-03T17:10:36.132481] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:10:36.137209] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:36.143410] [INFO ] [REMOTE ] ALK: Full fetch complete (76834 records). [2025-10-03T17:10:36.143561] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-03T17:10:36.584586] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-03T17:10:36.584743] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-03T17:10:36.585632] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-03T17:10:36.585744] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-03T17:10:36.587453] [DEBUG] [LOCAL ] ALK: Trimmed 76834 records to 53834 (keeping 200 days of data) [2025-10-03T17:10:36.809962] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-03T17:10:36.950859] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:10:36.977695] [DEBUG] [LOCAL ] ALK: Primary data saved (53834 records). [2025-10-03T17:10:36.977867] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-03T17:10:36.979491] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 40.1s. Estimated remaining: 4h 46m 51s. Rate: 8.0 symbols/min [2025-10-03T17:10:37.160192] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:37.211125] [DEBUG] [LOCAL ] ALSN: Loaded 43607 existing records from primary storage. [2025-10-03T17:10:37.211504] [INFO ] [MAIN ] ALSN: Loaded 43607 existing records. [2025-10-03T17:10:37.414955] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:37.415221] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-03T17:10:37.415286] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-03T17:10:37.415761] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-03T17:10:37.415836] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-03T17:10:37.602588] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-03T17:10:37.854059] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:37.893233] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T17:10:38.390629] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-03T17:10:38.743965] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:10:39.190636] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-03T17:10:39.266904] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:10:39.723352] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:10:39.990707] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-03T17:10:40.790743] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-03T17:10:41.022889] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T17:10:41.590674] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-03T17:10:41.722216] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:10:42.403483] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-03T17:10:42.411968] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:10:43.017754] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:10:43.190744] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-03T17:10:43.990757] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-03T17:10:44.199125] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:10:44.790775] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-03T17:10:44.820980] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:10:45.135615] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T17:10:45.590730] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-03T17:10:46.351602] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:10:46.358455] [INFO ] [REMOTE ] ALL: Full fetch complete (72402 records). [2025-10-03T17:10:46.358588] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-03T17:10:46.395915] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-03T17:10:46.760636] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-03T17:10:46.760791] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-03T17:10:46.761818] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-03T17:10:46.761894] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-03T17:10:46.763967] [DEBUG] [LOCAL ] ALL: Trimmed 72402 records to 50729 (keeping 200 days of data) [2025-10-03T17:10:47.118903] [DEBUG] [LOCAL ] ALL: Primary data saved (50729 records). [2025-10-03T17:10:47.119167] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-03T17:10:47.119310] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 30.7s. Estimated remaining: 4h 47m 54s. Rate: 7.9 symbols/min [2025-10-03T17:10:47.195806] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-03T17:10:47.300015] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:10:47.334057] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:10:47.364425] [DEBUG] [LOCAL ] ALTG: Loaded 23685 existing records from primary storage. [2025-10-03T17:10:47.364800] [INFO ] [MAIN ] ALTG: Loaded 23685 existing records. [2025-10-03T17:10:47.547926] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:10:47.548254] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-03T17:10:47.548310] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-03T17:10:47.548579] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-03T17:10:47.548667] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-03T17:10:47.917266] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:10:47.990749] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-03T17:10:48.258875] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T17:10:48.498450] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:10:48.790735] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-03T17:10:49.203321] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:10:49.590716] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-03T17:10:50.390633] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-03T17:10:50.480953] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:10:51.081699] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:10:51.162686] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:10:51.190677] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-03T17:10:51.990703] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-03T17:10:52.798958] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-03T17:10:52.802361] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T17:10:52.855134] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:10:53.590735] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-03T17:10:54.319040] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T17:10:54.390694] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-03T17:10:54.813736] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T17:10:55.190703] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-03T17:10:55.923188] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:10:55.990742] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-03T17:10:56.280798] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:10:56.790703] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-03T17:10:57.590719] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-03T17:10:58.396383] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-03T17:10:58.425030] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-03T17:10:58.454777] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:10:59.190717] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-03T17:10:59.990728] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-03T17:11:00.656838] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:11:00.790726] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-03T17:11:00.895238] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (3.30 seconds). [2025-10-03T17:11:01.590635] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-03T17:11:01.746680] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (3.35 seconds). [2025-10-03T17:11:01.766016] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T17:11:02.085702] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:11:02.390717] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-03T17:11:03.190745] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-03T17:11:03.328586] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:11:03.340386] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:11:03.990707] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-03T17:11:04.790695] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-03T17:11:05.053371] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:11:05.467541] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T17:11:05.592342] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-03T17:11:05.594776] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:11:06.390695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-03T17:11:06.976438] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:11:07.190721] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-03T17:11:07.942589] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:11:07.990693] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-03T17:11:08.759045] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T17:11:08.790729] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-03T17:11:09.049502] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:11:09.590739] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-03T17:11:10.010719] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T17:11:10.390695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-03T17:11:11.190729] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-03T17:11:11.766900] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T17:11:11.769257] [INFO ] [REMOTE ] ALLE: Full fetch complete (64741 records). [2025-10-03T17:11:11.769392] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-03T17:11:11.996562] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-03T17:11:12.069275] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:11:12.110744] [INFO ] [REMOTE ] ALSN: Full fetch complete (62181 records). [2025-10-03T17:11:12.121959] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-03T17:11:12.337209] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-03T17:11:12.342806] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-03T17:11:12.343714] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-03T17:11:12.348970] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-03T17:11:12.430091] [DEBUG] [LOCAL ] ALLE: Trimmed 64741 records to 45291 (keeping 200 days of data) [2025-10-03T17:11:12.913286] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-03T17:11:12.913838] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-03T17:11:12.914879] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-03T17:11:12.941023] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-03T17:11:12.964908] [DEBUG] [LOCAL ] ALSN: Trimmed 62181 records to 43927 (keeping 200 days of data) [2025-10-03T17:11:13.125698] [DEBUG] [LOCAL ] ALLE: Primary data saved (45291 records). [2025-10-03T17:11:13.127200] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-03T17:11:13.128856] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLE took 42.0s. Estimated remaining: 4h 55m 56s. Rate: 7.7 symbols/min [2025-10-03T17:11:13.205553] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T17:11:13.239816] [INFO ] [REMOTE ] ALTG: Full fetch complete (33678 records). [2025-10-03T17:11:13.259990] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-03T17:11:13.362516] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:13.473812] [DEBUG] [LOCAL ] ALUR: Loaded 10816 existing records from primary storage. [2025-10-03T17:11:13.497926] [INFO ] [MAIN ] ALUR: Loaded 10816 existing records. [2025-10-03T17:11:14.029526] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:14.041886] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-03T17:11:14.042538] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-03T17:11:14.085219] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-03T17:11:14.096614] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-03T17:11:14.212036] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-03T17:11:14.222708] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-03T17:11:14.234354] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-03T17:11:14.271063] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-03T17:11:14.296884] [DEBUG] [LOCAL ] ALTG: Trimmed 33678 records to 23811 (keeping 200 days of data) [2025-10-03T17:11:14.515335] [DEBUG] [LOCAL ] ALSN: Primary data saved (43927 records). [2025-10-03T17:11:14.535393] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-03T17:11:14.594382] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALSN took 37.6s. Estimated remaining: 4h 53m 3s. Rate: 7.8 symbols/min [2025-10-03T17:11:14.630945] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-03T17:11:14.802305] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-03T17:11:14.993314] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:14.989881] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:14.996411] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-03T17:11:15.038589] [DEBUG] [LOCAL ] ALTG: Primary data saved (23811 records). [2025-10-03T17:11:15.038884] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-03T17:11:15.039038] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALTG took 27.9s. Estimated remaining: 4h 49m 47s. Rate: 7.9 symbols/min [2025-10-03T17:11:15.221703] [DEBUG] [LOCAL ] ALV: Loaded 42666 existing records from primary storage. [2025-10-03T17:11:15.248818] [INFO ] [MAIN ] ALV: Loaded 42666 existing records. [2025-10-03T17:11:15.342905] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:15.441019] [DEBUG] [LOCAL ] ALX: Loaded 6303 existing records from primary storage. [2025-10-03T17:11:15.452864] [INFO ] [MAIN ] ALX: Loaded 6303 existing records. [2025-10-03T17:11:15.523741] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:15.568458] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-03T17:11:15.568579] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-03T17:11:15.604404] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-03T17:11:15.604554] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-03T17:11:15.811849] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:15.856466] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-03T17:11:15.869245] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-03T17:11:15.889250] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-03T17:11:15.951681] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-03T17:11:16.283058] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:16.362335] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-03T17:11:16.540404] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:11:16.579171] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-03T17:11:16.583474] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:16.584272] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-03T17:11:16.624925] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:11:16.790711] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-03T17:11:17.175338] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T17:11:17.590745] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-03T17:11:17.713096] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T17:11:17.766934] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:11:17.976714] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T17:11:18.185011] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:11:18.188554] [INFO ] [REMOTE ] ALLY: Full fetch complete (76924 records). [2025-10-03T17:11:18.188790] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-03T17:11:18.391963] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-03T17:11:18.632876] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-03T17:11:18.632961] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-03T17:11:18.633728] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-03T17:11:18.633838] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-03T17:11:18.635505] [DEBUG] [LOCAL ] ALLY: Trimmed 76924 records to 53994 (keeping 200 days of data) [2025-10-03T17:11:18.984923] [DEBUG] [LOCAL ] ALLY: Primary data saved (53994 records). [2025-10-03T17:11:18.985304] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-03T17:11:18.986880] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALLY took 43.7s. Estimated remaining: 4h 48m 5s. Rate: 7.9 symbols/min [2025-10-03T17:11:19.183171] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:19.190678] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-03T17:11:19.242095] [DEBUG] [LOCAL ] AM: Loaded 52439 existing records from primary storage. [2025-10-03T17:11:19.242454] [INFO ] [MAIN ] AM: Loaded 52439 existing records. [2025-10-03T17:11:19.451366] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:19.451854] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-03T17:11:19.451963] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-03T17:11:19.457701] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-03T17:11:19.464533] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-03T17:11:19.465742] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:11:19.870573] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:19.990684] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-03T17:11:20.423045] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T17:11:20.790718] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-03T17:11:21.590741] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-03T17:11:21.844927] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:11:21.911139] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T17:11:22.159219] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:11:22.390727] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-03T17:11:23.190710] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-03T17:11:23.980175] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T17:11:23.990617] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-03T17:11:24.137486] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T17:11:24.790739] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-03T17:11:24.998927] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:11:25.590734] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-03T17:11:26.063680] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T17:11:26.322427] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:11:26.390730] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-03T17:11:27.190715] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-03T17:11:27.376459] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:11:27.990772] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-03T17:11:28.526540] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:11:28.790759] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-03T17:11:29.105162] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:11:29.590719] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-03T17:11:30.390759] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-03T17:11:30.537270] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:11:30.975380] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T17:11:31.032722] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T17:11:31.190722] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-03T17:11:31.990752] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-03T17:11:32.171825] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:11:32.790727] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-03T17:11:33.434631] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T17:11:33.590705] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-03T17:11:33.833341] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:11:34.390730] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-03T17:11:34.857773] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:11:35.168304] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:11:35.190675] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-03T17:11:35.943618] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T17:11:35.990723] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-03T17:11:36.790736] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-03T17:11:37.596889] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-03T17:11:37.623827] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:11:38.359519] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:11:38.389070] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:11:38.397786] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-03T17:11:39.190724] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-03T17:11:39.292449] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:11:39.990729] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-03T17:11:40.595930] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T17:11:40.790703] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-03T17:11:40.940767] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:11:41.319268] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:11:41.320774] [INFO ] [REMOTE ] ALUR: Full fetch complete (20216 records). [2025-10-03T17:11:41.320874] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-03T17:11:41.596780] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-03T17:11:41.787115] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-03T17:11:41.787221] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-03T17:11:41.787708] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-03T17:11:41.787778] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-03T17:11:41.788590] [DEBUG] [LOCAL ] ALUR: Trimmed 20216 records to 10863 (keeping 200 days of data) [2025-10-03T17:11:41.854294] [DEBUG] [LOCAL ] ALUR: Primary data saved (10863 records). [2025-10-03T17:11:41.854465] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-03T17:11:41.854577] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALUR took 28.7s. Estimated remaining: 4h 54m 25s. Rate: 7.7 symbols/min [2025-10-03T17:11:42.061181] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:42.061457] [DEBUG] [LOCAL ] AMBC: No existing data file found in primary storage. [2025-10-03T17:11:42.061541] [WARN ] [MAIN ] AMBC: No existing data found, performing full refresh instead. [2025-10-03T17:11:42.061736] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-03T17:11:42.061791] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-03T17:11:42.061838] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-10-03T17:11:42.061875] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-03T17:11:42.396217] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-03T17:11:42.436806] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:11:42.462212] [INFO ] [REMOTE ] ALX: Full fetch complete (7188 records). [2025-10-03T17:11:42.482266] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-03T17:11:42.844624] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:43.198562] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-03T17:11:43.250941] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-03T17:11:43.251040] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-03T17:11:43.251269] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-03T17:11:43.251313] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-03T17:11:43.251980] [DEBUG] [LOCAL ] ALX: Trimmed 7188 records to 6349 (keeping 200 days of data) [2025-10-03T17:11:43.299807] [DEBUG] [LOCAL ] ALX: Primary data saved (6349 records). [2025-10-03T17:11:43.300020] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-03T17:11:43.300377] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALX took 28.3s. Estimated remaining: 4h 51m 40s. Rate: 7.8 symbols/min [2025-10-03T17:11:43.515903] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:43.563383] [DEBUG] [LOCAL ] AMBP: Loaded 45246 existing records from primary storage. [2025-10-03T17:11:43.563850] [INFO ] [MAIN ] AMBP: Loaded 45246 existing records. [2025-10-03T17:11:43.764810] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:43.765210] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-03T17:11:43.765342] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-03T17:11:43.765728] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-03T17:11:43.765787] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-03T17:11:43.997073] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-03T17:11:44.120596] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T17:11:44.201297] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:44.584873] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T17:11:44.790740] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-03T17:11:45.412748] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:11:45.590719] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-03T17:11:46.351252] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:11:46.390680] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-03T17:11:46.431035] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T17:11:47.190757] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-03T17:11:47.896182] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:11:47.990733] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-03T17:11:48.452557] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:11:48.790727] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-03T17:11:49.451359] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:11:49.590735] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-03T17:11:50.370747] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T17:11:50.390637] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-03T17:11:51.190681] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-03T17:11:51.264014] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:11:51.483044] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T17:11:51.990728] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-03T17:11:52.478229] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:11:52.480451] [INFO ] [REMOTE ] ALV: Full fetch complete (61769 records). [2025-10-03T17:11:52.480585] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-03T17:11:52.795881] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-03T17:11:52.918780] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-03T17:11:52.918878] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-03T17:11:52.919536] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-03T17:11:52.919605] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-03T17:11:52.921167] [DEBUG] [LOCAL ] ALV: Trimmed 61769 records to 42942 (keeping 200 days of data) [2025-10-03T17:11:53.215756] [DEBUG] [LOCAL ] ALV: Primary data saved (42942 records). [2025-10-03T17:11:53.215908] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-03T17:11:53.216015] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALV took 38.6s. Estimated remaining: 4h 52m 27s. Rate: 7.8 symbols/min [2025-10-03T17:11:53.416523] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:53.416800] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-03T17:11:53.416911] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-03T17:11:53.417031] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-03T17:11:53.417074] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-03T17:11:53.417119] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-03T17:11:53.417152] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-03T17:11:53.593034] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-03T17:11:53.830708] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:53.862914] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:11:53.922430] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:11:54.390704] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-03T17:11:55.190664] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-03T17:11:55.265341] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:11:55.377073] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:11:55.377393] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-03T17:11:55.377508] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:11:55.377578] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-03T17:11:55.377664] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:11:55.377743] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-03T17:11:55.377818] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-03T17:11:55.377859] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-03T17:11:55.377900] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-03T17:11:55.377950] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBQ took 2.2s. Estimated remaining: 4h 50m 4s. Rate: 7.8 symbols/min [2025-10-03T17:11:55.559187] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:11:55.629132] [DEBUG] [LOCAL ] AMC: Loaded 54150 existing records from primary storage. [2025-10-03T17:11:55.629502] [INFO ] [MAIN ] AMC: Loaded 54150 existing records. [2025-10-03T17:11:55.836882] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:11:55.837151] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-03T17:11:55.837202] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-03T17:11:55.837814] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-03T17:11:55.837874] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-03T17:11:56.004201] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-03T17:11:56.291237] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:11:56.321836] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T17:11:56.790714] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-03T17:11:57.590689] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-03T17:11:57.657857] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:11:58.178439] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:11:58.390711] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-03T17:11:59.190638] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-03T17:11:59.315673] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:11:59.997741] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-03T17:12:00.020101] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T17:12:00.790688] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-03T17:12:01.590737] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-03T17:12:01.677609] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T17:12:01.807048] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:12:02.160725] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:12:02.390725] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-03T17:12:02.875055] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:12:02.877805] [INFO ] [REMOTE ] AM: Full fetch complete (75587 records). [2025-10-03T17:12:02.877966] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-03T17:12:03.195903] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-03T17:12:03.334437] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-03T17:12:03.334563] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-03T17:12:03.335419] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-03T17:12:03.335490] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-03T17:12:03.337278] [DEBUG] [LOCAL ] AM: Trimmed 75587 records to 52803 (keeping 200 days of data) [2025-10-03T17:12:03.680840] [DEBUG] [LOCAL ] AM: Primary data saved (52803 records). [2025-10-03T17:12:03.681022] [INFO ] [MAIN ] AM: Full history saved. [2025-10-03T17:12:03.684230] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AM took 44.7s. Estimated remaining: 4h 50m 12s. Rate: 7.8 symbols/min [2025-10-03T17:12:03.888056] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:03.915346] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T17:12:03.978790] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-10-03T17:12:03.979166] [INFO ] [MAIN ] AMCR: Loaded 54059 existing records. [2025-10-03T17:12:03.995809] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-03T17:12:04.184736] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:04.185008] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-03T17:12:04.185058] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-03T17:12:04.185680] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-03T17:12:04.185742] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-03T17:12:04.578722] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:04.790695] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-03T17:12:05.597941] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-03T17:12:05.621926] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T17:12:05.665271] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-03T17:12:06.272228] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:12:06.390685] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-03T17:12:07.190634] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-03T17:12:07.266752] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:12:07.973698] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:12:07.990607] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-03T17:12:08.790724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-03T17:12:09.431388] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:12:09.535590] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T17:12:09.590633] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-03T17:12:09.847755] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:12:10.390727] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-03T17:12:11.190724] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-03T17:12:11.588726] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:12:11.591438] [INFO ] [REMOTE ] AMBC: Full fetch complete (51336 records). [2025-10-03T17:12:11.591556] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-03T17:12:11.999728] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-03T17:12:12.038320] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-03T17:12:12.038875] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-03T17:12:12.039550] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-03T17:12:12.039756] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-03T17:12:12.041317] [DEBUG] [LOCAL ] AMBC: Trimmed 51336 records to 37179 (keeping 200 days of data) [2025-10-03T17:12:12.184953] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-03T17:12:12.309036] [DEBUG] [LOCAL ] AMBC: Primary data saved (37179 records). [2025-10-03T17:12:12.309194] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-03T17:12:12.309274] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AMBC took 30.5s. Estimated remaining: 4h 50m 28s. Rate: 7.8 symbols/min [2025-10-03T17:12:12.493853] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:12.558102] [DEBUG] [LOCAL ] AME: Loaded 48837 existing records from primary storage. [2025-10-03T17:12:12.558559] [INFO ] [MAIN ] AME: Loaded 48837 existing records. [2025-10-03T17:12:12.760536] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:12.760897] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-03T17:12:12.760960] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-03T17:12:12.761365] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-03T17:12:12.761425] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-03T17:12:12.794611] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-03T17:12:13.191272] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:13.207418] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T17:12:13.233214] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:12:13.235328] [INFO ] [REMOTE ] AMBP: Full fetch complete (65612 records). [2025-10-03T17:12:13.235437] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-03T17:12:13.603165] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-03T17:12:13.666000] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-03T17:12:13.666092] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-03T17:12:13.666843] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-03T17:12:13.666912] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-03T17:12:13.670202] [DEBUG] [LOCAL ] AMBP: Trimmed 65612 records to 45523 (keeping 200 days of data) [2025-10-03T17:12:13.952586] [DEBUG] [LOCAL ] AMBP: Primary data saved (45523 records). [2025-10-03T17:12:13.952764] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-03T17:12:13.952881] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 30.7s. Estimated remaining: 4h 47m 58s. Rate: 7.9 symbols/min [2025-10-03T17:12:14.187031] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:14.212528] [DEBUG] [LOCAL ] AMG: Loaded 20522 existing records from primary storage. [2025-10-03T17:12:14.212876] [INFO ] [MAIN ] AMG: Loaded 20522 existing records. [2025-10-03T17:12:14.395681] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-03T17:12:14.420214] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:14.420710] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-03T17:12:14.420773] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-03T17:12:14.421029] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-03T17:12:14.421089] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-03T17:12:14.802576] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:15.190637] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-03T17:12:15.312164] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-03T17:12:15.465270] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T17:12:15.990624] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-03T17:12:16.110629] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:12:16.150851] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:12:16.790686] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-03T17:12:17.590742] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-03T17:12:18.390630] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-03T17:12:18.519533] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-03T17:12:18.565849] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:12:18.698429] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:12:19.190725] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-03T17:12:19.990718] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-03T17:12:20.281527] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:12:20.790692] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-03T17:12:20.889886] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T17:12:21.590727] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-03T17:12:22.231212] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:12:22.390669] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-03T17:12:22.489115] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-03T17:12:22.513905] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:12:23.190695] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-03T17:12:23.990743] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-03T17:12:24.549585] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-03T17:12:24.790708] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-03T17:12:25.179291] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T17:12:25.511963] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:12:25.590699] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-03T17:12:26.236967] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:12:26.390696] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-03T17:12:26.845785] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T17:12:27.190739] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-03T17:12:27.990699] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-03T17:12:28.336236] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T17:12:28.528803] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T17:12:28.790742] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-03T17:12:29.590705] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-03T17:12:29.714083] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:12:29.898689] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:12:30.390710] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-03T17:12:31.190734] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-03T17:12:31.354556] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:12:31.990710] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-03T17:12:32.578102] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T17:12:32.790737] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-03T17:12:33.031816] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:12:33.555517] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:12:33.590697] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-03T17:12:34.390745] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-03T17:12:35.050699] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T17:12:35.054084] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-03T17:12:35.054301] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-03T17:12:35.192501] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-03T17:12:35.553908] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-03T17:12:35.554030] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-03T17:12:35.554989] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-03T17:12:35.555181] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-03T17:12:35.557117] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 54540 (keeping 200 days of data) [2025-10-03T17:12:35.684171] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T17:12:35.857722] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:12:35.965930] [DEBUG] [LOCAL ] AMC: Primary data saved (54540 records). [2025-10-03T17:12:35.966086] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-03T17:12:35.968160] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMC took 40.6s. Estimated remaining: 4h 53m 28s. Rate: 7.7 symbols/min [2025-10-03T17:12:36.002330] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-03T17:12:36.168673] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:36.228298] [DEBUG] [LOCAL ] AMH: Loaded 52100 existing records from primary storage. [2025-10-03T17:12:36.228723] [INFO ] [MAIN ] AMH: Loaded 52100 existing records. [2025-10-03T17:12:36.415118] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:12:36.459098] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:36.465567] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-03T17:12:36.465698] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-03T17:12:36.466296] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-03T17:12:36.466358] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-03T17:12:36.795857] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-03T17:12:36.874047] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:37.590629] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-03T17:12:37.882458] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T17:12:37.885482] [INFO ] [REMOTE ] AMCR: Full fetch complete (77679 records). [2025-10-03T17:12:37.885635] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-03T17:12:38.258934] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:12:38.372940] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-03T17:12:38.373092] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-03T17:12:38.373918] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-03T17:12:38.373989] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-03T17:12:38.375806] [DEBUG] [LOCAL ] AMCR: Trimmed 77679 records to 54449 (keeping 200 days of data) [2025-10-03T17:12:38.433769] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-03T17:12:38.727037] [DEBUG] [LOCAL ] AMCR: Primary data saved (54449 records). [2025-10-03T17:12:38.727226] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-03T17:12:38.728031] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AMCR took 35.0s. Estimated remaining: 4h 51m 25s. Rate: 7.8 symbols/min [2025-10-03T17:12:38.905591] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:38.950022] [DEBUG] [LOCAL ] AMN: Loaded 42097 existing records from primary storage. [2025-10-03T17:12:38.950323] [INFO ] [MAIN ] AMN: Loaded 42097 existing records. [2025-10-03T17:12:39.144823] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:39.145168] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-03T17:12:39.145287] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-03T17:12:39.146011] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-03T17:12:39.146131] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-03T17:12:39.193089] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-03T17:12:39.317883] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:12:39.581047] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:39.934810] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:12:39.990716] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-03T17:12:40.082336] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:12:40.790727] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-03T17:12:41.590630] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-03T17:12:41.780619] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T17:12:42.005342] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:12:42.390707] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-03T17:12:42.602080] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:12:42.603683] [INFO ] [REMOTE ] AMG: Full fetch complete (29901 records). [2025-10-03T17:12:42.603765] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-03T17:12:43.020432] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-03T17:12:43.020627] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-03T17:12:43.021763] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-03T17:12:43.021843] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-03T17:12:43.022871] [DEBUG] [LOCAL ] AMG: Trimmed 29901 records to 20722 (keeping 200 days of data) [2025-10-03T17:12:43.159803] [DEBUG] [LOCAL ] AMG: Primary data saved (20722 records). [2025-10-03T17:12:43.159960] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-03T17:12:43.160183] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMG took 29.2s. Estimated remaining: 4h 50m 2s. Rate: 7.8 symbols/min [2025-10-03T17:12:43.202353] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-03T17:12:43.405907] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:43.448467] [DEBUG] [LOCAL ] AMP: Loaded 32439 existing records from primary storage. [2025-10-03T17:12:43.448863] [INFO ] [MAIN ] AMP: Loaded 32439 existing records. [2025-10-03T17:12:43.670102] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:43.670744] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-03T17:12:43.670935] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-03T17:12:43.678817] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-03T17:12:43.693358] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:12:43.692535] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-03T17:12:43.998713] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-03T17:12:44.107272] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:44.790635] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-03T17:12:44.982240] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:12:45.590683] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-03T17:12:45.781193] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:12:46.227867] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:12:46.390711] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-03T17:12:47.066913] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:12:47.190701] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-03T17:12:47.990639] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-03T17:12:48.025224] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:12:48.625812] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:12:48.790701] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-03T17:12:49.590730] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-03T17:12:49.720152] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:12:50.294704] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:12:50.390715] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-03T17:12:51.190727] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-03T17:12:51.221505] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T17:12:51.990692] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-03T17:12:52.138258] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:12:52.726574] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:12:52.729280] [INFO ] [REMOTE ] AME: Full fetch complete (69879 records). [2025-10-03T17:12:52.729417] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-03T17:12:52.802970] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-03T17:12:53.151173] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-03T17:12:53.151260] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-03T17:12:53.152011] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-03T17:12:53.152081] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-03T17:12:53.154020] [DEBUG] [LOCAL ] AME: Trimmed 69879 records to 49208 (keeping 200 days of data) [2025-10-03T17:12:53.488416] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:12:53.515738] [DEBUG] [LOCAL ] AME: Primary data saved (49208 records). [2025-10-03T17:12:53.515903] [INFO ] [MAIN ] AME: Full history saved. [2025-10-03T17:12:53.517098] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AME took 41.2s. Estimated remaining: 4h 50m 56s. Rate: 7.8 symbols/min [2025-10-03T17:12:53.595748] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-03T17:12:53.709202] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:12:53.770569] [DEBUG] [LOCAL ] AMPX: Loaded 52687 existing records from primary storage. [2025-10-03T17:12:53.770958] [INFO ] [MAIN ] AMPX: Loaded 52687 existing records. [2025-10-03T17:12:53.966229] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:12:53.966476] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-03T17:12:53.966525] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-03T17:12:53.967005] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-03T17:12:53.967067] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-03T17:12:54.394196] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:12:54.391963] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-03T17:12:54.477265] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:12:54.981074] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T17:12:55.190715] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-03T17:12:55.895539] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:12:55.990706] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-03T17:12:56.790686] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-03T17:12:57.209634] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T17:12:57.273801] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T17:12:57.590714] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-03T17:12:58.390712] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-03T17:12:58.434395] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:12:58.533148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T17:12:59.190704] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-03T17:12:59.990729] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-03T17:13:00.790732] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-03T17:13:00.840425] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:13:01.247400] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (2.86 seconds). [2025-10-03T17:13:01.590741] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-03T17:13:02.237073] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:13:02.390706] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-03T17:13:03.015124] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:13:03.190733] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-03T17:13:03.995764] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-03T17:13:04.016169] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (4.03 seconds). [2025-10-03T17:13:04.054004] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:13:04.790671] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-03T17:13:05.027192] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:13:05.590688] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-03T17:13:05.974497] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T17:13:06.390706] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-03T17:13:07.190704] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-03T17:13:07.588621] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-03T17:13:07.990729] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-03T17:13:08.139030] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:13:08.395639] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:13:08.481191] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-10-03T17:13:08.790724] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-03T17:13:09.419336] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:13:09.590690] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-03T17:13:10.390710] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-03T17:13:10.527888] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:13:10.918218] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:13:10.920069] [INFO ] [REMOTE ] AMP: Full fetch complete (47657 records). [2025-10-03T17:13:10.920161] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-03T17:13:11.198622] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-03T17:13:11.337405] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-03T17:13:11.337595] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-03T17:13:11.338239] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-03T17:13:11.338313] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-03T17:13:11.339679] [DEBUG] [LOCAL ] AMP: Trimmed 47657 records to 32637 (keeping 200 days of data) [2025-10-03T17:13:11.553714] [DEBUG] [LOCAL ] AMP: Primary data saved (32637 records). [2025-10-03T17:13:11.553879] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-03T17:13:11.553969] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMP took 28.4s. Estimated remaining: 4h 54m 40s. Rate: 7.7 symbols/min [2025-10-03T17:13:11.738997] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:11.780579] [DEBUG] [LOCAL ] AMPY: Loaded 38186 existing records from primary storage. [2025-10-03T17:13:11.780905] [INFO ] [MAIN ] AMPY: Loaded 38186 existing records. [2025-10-03T17:13:11.972414] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:11.972919] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-03T17:13:11.973001] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-03T17:13:11.973602] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-03T17:13:11.973709] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-03T17:13:11.996305] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-03T17:13:12.117029] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:13:12.419080] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:12.739977] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:13:12.790586] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-03T17:13:13.590684] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-03T17:13:13.721161] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T17:13:13.726116] [INFO ] [REMOTE ] AMH: Full fetch complete (74800 records). [2025-10-03T17:13:13.726368] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-03T17:13:14.162376] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-03T17:13:14.165148] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-03T17:13:14.169376] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-03T17:13:14.169837] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-03T17:13:14.169744] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:13:14.173775] [DEBUG] [LOCAL ] AMH: Trimmed 74800 records to 52479 (keeping 200 days of data) [2025-10-03T17:13:14.174592] [INFO ] [REMOTE ] AMN: Full fetch complete (60449 records). [2025-10-03T17:13:14.174779] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-03T17:13:14.394941] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-03T17:13:14.745508] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-03T17:13:14.748010] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-03T17:13:14.752213] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-03T17:13:14.752526] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-03T17:13:14.845637] [DEBUG] [LOCAL ] AMN: Trimmed 60449 records to 42418 (keeping 200 days of data) [2025-10-03T17:13:14.959067] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:13:15.191685] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-03T17:13:15.203428] [DEBUG] [LOCAL ] AMH: Primary data saved (52479 records). [2025-10-03T17:13:15.207839] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-03T17:13:15.209331] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMH took 39.2s. Estimated remaining: 4h 53m 1s. Rate: 7.7 symbols/min [2025-10-03T17:13:15.412867] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:15.433985] [DEBUG] [LOCAL ] AMN: Primary data saved (42418 records). [2025-10-03T17:13:15.434160] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-03T17:13:15.434857] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMN took 36.7s. Estimated remaining: 4h 50m 7s. Rate: 7.8 symbols/min [2025-10-03T17:13:15.648622] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:15.649869] [DEBUG] [LOCAL ] AMR: Loaded 29181 existing records from primary storage. [2025-10-03T17:13:15.650799] [INFO ] [MAIN ] AMR: Loaded 29181 existing records. [2025-10-03T17:13:15.861342] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:15.873297] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-03T17:13:15.873445] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-03T17:13:15.874331] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-03T17:13:15.874294] [DEBUG] [LOCAL ] AMRC: Loaded 38431 existing records from primary storage. [2025-10-03T17:13:15.874439] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-03T17:13:15.920364] [INFO ] [MAIN ] AMRC: Loaded 38431 existing records. [2025-10-03T17:13:16.393229] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:16.420167] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-03T17:13:16.420806] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-03T17:13:16.421492] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-03T17:13:16.421589] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-03T17:13:16.569125] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:16.611635] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-03T17:13:16.785042] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:13:16.802733] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T17:13:16.844489] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-03T17:13:16.999952] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:17.590638] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-03T17:13:17.868033] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T17:13:17.952135] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:13:18.390726] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-03T17:13:18.962274] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:13:19.190696] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-03T17:13:19.639449] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:13:19.990730] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-03T17:13:20.790702] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-03T17:13:21.299387] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T17:13:21.516579] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T17:13:21.590730] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-03T17:13:22.390738] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-03T17:13:22.776322] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:13:23.190704] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-03T17:13:23.833447] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:13:23.990700] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-03T17:13:24.790683] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-03T17:13:25.040207] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:13:25.590683] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-03T17:13:26.272798] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T17:13:26.390692] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-03T17:13:26.520768] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T17:13:26.750791] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-10-03T17:13:27.190693] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-03T17:13:27.889244] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:13:27.990748] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-03T17:13:28.630804] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:13:28.790751] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-03T17:13:29.590735] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-03T17:13:29.656303] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:13:30.040024] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:13:30.390704] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-03T17:13:31.116413] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T17:13:31.190728] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-03T17:13:31.665865] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:13:31.990738] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-03T17:13:32.654479] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:13:32.790736] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-03T17:13:33.161901] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:13:33.590635] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-03T17:13:34.068495] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:13:34.390733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-03T17:13:34.890751] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:13:35.190718] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-03T17:13:35.734048] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:13:35.990716] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-03T17:13:36.627546] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:13:36.790689] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-03T17:13:37.216589] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:13:37.590718] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-03T17:13:38.359504] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:13:38.390632] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-03T17:13:39.153812] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:13:39.190733] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-03T17:13:39.990718] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-03T17:13:40.040729] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T17:13:40.537450] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:13:40.539445] [INFO ] [REMOTE ] AMR: Full fetch complete (40217 records). [2025-10-03T17:13:40.539540] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-03T17:13:40.795836] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-03T17:13:40.994874] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-03T17:13:40.996871] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-03T17:13:40.997491] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-03T17:13:40.997611] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-03T17:13:40.996753] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (21.81 seconds). [2025-10-03T17:13:41.010479] [DEBUG] [LOCAL ] AMR: Trimmed 40217 records to 29401 (keeping 200 days of data) [2025-10-03T17:13:41.200288] [DEBUG] [LOCAL ] AMR: Primary data saved (29401 records). [2025-10-03T17:13:41.200454] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-03T17:13:41.200567] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMR took 26.0s. Estimated remaining: 4h 56m 34s. Rate: 7.6 symbols/min [2025-10-03T17:13:41.384949] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:41.385144] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-03T17:13:41.385217] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-03T17:13:41.385342] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-03T17:13:41.385388] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-03T17:13:41.385433] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-03T17:13:41.385467] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-03T17:13:41.599376] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-03T17:13:41.642358] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T17:13:41.689488] [INFO ] [REMOTE ] AMPY: Full fetch complete (51661 records). [2025-10-03T17:13:41.715853] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-03T17:13:41.930269] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:42.231159] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-03T17:13:42.231345] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-03T17:13:42.232066] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-03T17:13:42.232152] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-03T17:13:42.233542] [DEBUG] [LOCAL ] AMPY: Trimmed 51661 records to 38558 (keeping 200 days of data) [2025-10-03T17:13:42.319464] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:13:42.331880] [INFO ] [REMOTE ] AMRC: Full fetch complete (53220 records). [2025-10-03T17:13:42.336585] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-03T17:13:42.397011] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-03T17:13:42.673873] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:13:42.700612] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-03T17:13:42.718276] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:13:42.718735] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-03T17:13:42.750750] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:13:42.759759] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-03T17:13:42.789522] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-03T17:13:42.804871] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-03T17:13:42.808988] [DEBUG] [LOCAL ] AMPY: Primary data saved (38558 records). [2025-10-03T17:13:42.814366] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-03T17:13:42.819632] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-03T17:13:42.830086] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMRZ took 1.6s. Estimated remaining: 4h 54m 11s. Rate: 7.7 symbols/min [2025-10-03T17:13:42.868096] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMPY took 31.3s. Estimated remaining: 4h 51m 18s. Rate: 7.8 symbols/min [2025-10-03T17:13:43.001070] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-03T17:13:43.077218] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-03T17:13:43.102637] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-03T17:13:43.147399] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-03T17:13:43.274637] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:43.299211] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:43.300178] [DEBUG] [LOCAL ] AMRC: Trimmed 53220 records to 38763 (keeping 200 days of data) [2025-10-03T17:13:43.412335] [DEBUG] [LOCAL ] AMTB: Loaded 20465 existing records from primary storage. [2025-10-03T17:13:43.415235] [INFO ] [MAIN ] AMTB: Loaded 20465 existing records. [2025-10-03T17:13:43.646850] [DEBUG] [LOCAL ] AMT: Loaded 52808 existing records from primary storage. [2025-10-03T17:13:43.680193] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:43.681712] [INFO ] [MAIN ] AMT: Loaded 52808 existing records. [2025-10-03T17:13:43.681593] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-03T17:13:43.722253] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-03T17:13:43.765338] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-03T17:13:43.781959] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-03T17:13:44.015285] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:44.032454] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-03T17:13:44.057191] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-03T17:13:44.155367] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-03T17:13:44.161326] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-03T17:13:44.704164] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:44.716313] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-03T17:13:44.796760] [DEBUG] [LOCAL ] AMRC: Primary data saved (38763 records). [2025-10-03T17:13:44.804728] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-03T17:13:44.847076] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMRC took 29.4s. Estimated remaining: 4h 49m 9s. Rate: 7.8 symbols/min [2025-10-03T17:13:44.918473] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-03T17:13:45.001962] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:45.018151] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-03T17:13:45.052894] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-03T17:13:45.155968] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:13:45.162748] [DEBUG] [LOCAL ] AMTD: Loaded 3668 existing records from primary storage. [2025-10-03T17:13:45.162997] [INFO ] [MAIN ] AMTD: Loaded 3668 existing records. [2025-10-03T17:13:45.364174] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:13:45.364461] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-03T17:13:45.364513] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-03T17:13:45.364770] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-03T17:13:45.364833] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-03T17:13:45.762836] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:13:45.763249] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-03T17:13:45.980771] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:13:46.390713] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-03T17:13:46.676143] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T17:13:47.190677] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-03T17:13:47.280027] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T17:13:47.317360] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T17:13:47.365403] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:13:47.791959] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T17:13:47.990701] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-03T17:13:48.576727] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:13:48.790682] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-03T17:13:49.278700] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:13:49.590706] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-03T17:13:50.390633] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-03T17:13:50.711055] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:13:50.840399] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T17:13:51.190726] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-03T17:13:51.677773] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:13:51.990710] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-03T17:13:52.621197] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:13:52.790705] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-03T17:13:53.590683] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-03T17:13:53.813813] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:13:54.390719] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-03T17:13:55.190708] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-03T17:13:55.410164] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T17:13:55.516051] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:13:55.990737] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-03T17:13:56.790665] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-03T17:13:56.866594] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:13:57.516165] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T17:13:57.590679] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-03T17:13:58.390721] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-03T17:13:58.425045] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:13:58.610586] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T17:13:59.190716] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-03T17:13:59.774012] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:13:59.990717] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-03T17:14:00.360324] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T17:14:00.363624] [INFO ] [REMOTE ] AMPX: Full fetch complete (74763 records). [2025-10-03T17:14:00.363801] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-03T17:14:00.704406] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T17:14:00.803029] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-03T17:14:00.807626] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-03T17:14:00.808494] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-03T17:14:00.809354] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-03T17:14:00.809532] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-03T17:14:00.811533] [DEBUG] [LOCAL ] AMPX: Trimmed 74763 records to 53077 (keeping 200 days of data) [2025-10-03T17:14:01.127766] [DEBUG] [LOCAL ] AMPX: Primary data saved (53077 records). [2025-10-03T17:14:01.127938] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-03T17:14:01.128152] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMPX took 1m 8s. Estimated remaining: 4h 52m 2s. Rate: 7.7 symbols/min [2025-10-03T17:14:01.314151] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:01.365997] [DEBUG] [LOCAL ] AMTM: Loaded 51033 existing records from primary storage. [2025-10-03T17:14:01.366385] [INFO ] [MAIN ] AMTM: Loaded 51033 existing records. [2025-10-03T17:14:01.565109] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:01.565335] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-03T17:14:01.565387] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-03T17:14:01.565700] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-03T17:14:01.565787] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-03T17:14:01.598930] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-03T17:14:02.001432] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:02.053064] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:14:02.219425] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:14:02.390687] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-03T17:14:02.966775] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T17:14:02.967668] [INFO ] [REMOTE ] AMTD: Full fetch complete (5580 records). [2025-10-03T17:14:02.967745] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-03T17:14:03.195853] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-03T17:14:03.359073] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-03T17:14:03.359164] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-03T17:14:03.359368] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-03T17:14:03.359439] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-03T17:14:03.359936] [DEBUG] [LOCAL ] AMTD: Trimmed 5580 records to 3698 (keeping 200 days of data) [2025-10-03T17:14:03.381718] [DEBUG] [LOCAL ] AMTD: Primary data saved (3698 records). [2025-10-03T17:14:03.381841] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-03T17:14:03.381945] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMTD took 18.5s. Estimated remaining: 4h 50m 0s. Rate: 7.8 symbols/min [2025-10-03T17:14:03.583403] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:03.594217] [DEBUG] [LOCAL ] AMWL: Loaded 8926 existing records from primary storage. [2025-10-03T17:14:03.594451] [INFO ] [MAIN ] AMWL: Loaded 8926 existing records. [2025-10-03T17:14:03.778881] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:03.779125] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-03T17:14:03.779173] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-03T17:14:03.779379] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-03T17:14:03.779437] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-03T17:14:03.996841] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-03T17:14:04.179270] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:04.272837] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T17:14:04.790684] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-03T17:14:05.590676] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-03T17:14:05.921587] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T17:14:06.390634] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-03T17:14:06.556718] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:14:06.646305] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:14:07.190688] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-03T17:14:07.990701] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-03T17:14:08.271602] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:14:08.273281] [INFO ] [REMOTE ] AMTB: Full fetch complete (29921 records). [2025-10-03T17:14:08.273377] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-03T17:14:08.496020] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T17:14:08.765357] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-03T17:14:08.765472] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-03T17:14:08.765993] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-03T17:14:08.766059] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-03T17:14:08.767472] [DEBUG] [LOCAL ] AMTB: Trimmed 29921 records to 20620 (keeping 200 days of data) [2025-10-03T17:14:08.823009] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-03T17:14:08.908141] [DEBUG] [LOCAL ] AMTB: Primary data saved (20620 records). [2025-10-03T17:14:08.908337] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-03T17:14:08.908475] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMTB took 26.0s. Estimated remaining: 4h 49m 8s. Rate: 7.8 symbols/min [2025-10-03T17:14:09.122614] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:09.132041] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:14:09.184487] [DEBUG] [LOCAL ] AMX: Loaded 49493 existing records from primary storage. [2025-10-03T17:14:09.184911] [INFO ] [MAIN ] AMX: Loaded 49493 existing records. [2025-10-03T17:14:09.376661] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:09.376898] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-03T17:14:09.376951] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-03T17:14:09.377524] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-03T17:14:09.377585] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-03T17:14:09.595932] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-03T17:14:09.779628] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:10.390673] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-03T17:14:10.591492] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:14:10.635119] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:14:11.190718] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-03T17:14:11.990715] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-03T17:14:12.054184] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T17:14:12.144798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:14:12.790741] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-03T17:14:13.590634] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-03T17:14:13.788226] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:14:14.329929] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:14:14.390723] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-03T17:14:15.190687] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-03T17:14:15.226409] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:14:15.990729] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-03T17:14:16.007171] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T17:14:16.112011] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:14:16.790701] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-03T17:14:17.590870] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-03T17:14:17.958586] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T17:14:18.232488] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:14:18.317766] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T17:14:18.390638] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-03T17:14:19.190718] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-03T17:14:19.990696] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-03T17:14:20.117889] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:14:20.790748] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-03T17:14:20.858415] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:14:21.590723] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-03T17:14:21.903428] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:14:21.923977] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:14:22.390695] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-03T17:14:22.972737] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:14:23.122315] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:14:23.190720] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-03T17:14:23.990733] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-03T17:14:24.790638] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-03T17:14:24.799718] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:14:25.287776] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T17:14:25.590695] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-03T17:14:26.390621] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-03T17:14:26.510266] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:14:27.190630] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-03T17:14:27.370588] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:14:27.704725] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T17:14:27.990661] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-03T17:14:28.186359] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T17:14:28.189363] [INFO ] [REMOTE ] AMT: Full fetch complete (76016 records). [2025-10-03T17:14:28.189531] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-03T17:14:28.658924] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-03T17:14:28.659115] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-03T17:14:28.660019] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-03T17:14:28.660116] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-03T17:14:28.661912] [DEBUG] [LOCAL ] AMT: Trimmed 76016 records to 53193 (keeping 200 days of data) [2025-10-03T17:14:28.792177] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-03T17:14:29.029813] [DEBUG] [LOCAL ] AMT: Primary data saved (53193 records). [2025-10-03T17:14:29.029964] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-03T17:14:29.031347] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMT took 46.2s. Estimated remaining: 4h 53m 13s. Rate: 7.7 symbols/min [2025-10-03T17:14:29.238030] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:29.238427] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-03T17:14:29.238486] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-03T17:14:29.238612] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-03T17:14:29.238688] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-03T17:14:29.238751] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-03T17:14:29.238787] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-03T17:14:29.603215] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-03T17:14:29.661417] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:29.666210] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T17:14:29.858106] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:14:30.390690] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-03T17:14:31.170144] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:14:31.171562] [INFO ] [REMOTE ] AMWL: Full fetch complete (14144 records). [2025-10-03T17:14:31.171777] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-03T17:14:31.196880] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-03T17:14:31.627409] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-03T17:14:31.650922] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-03T17:14:31.651309] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-03T17:14:31.651674] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-03T17:14:31.654587] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T17:14:31.670351] [DEBUG] [LOCAL ] AMWL: Trimmed 14144 records to 9067 (keeping 200 days of data) [2025-10-03T17:14:31.725664] [DEBUG] [LOCAL ] AMWL: Primary data saved (9067 records). [2025-10-03T17:14:31.725822] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-03T17:14:31.725910] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMWL took 28.3s. Estimated remaining: 4h 51m 23s. Rate: 7.7 symbols/min [2025-10-03T17:14:31.908281] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:31.966575] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-10-03T17:14:31.967006] [INFO ] [MAIN ] ANET: Loaded 54156 existing records. [2025-10-03T17:14:31.999408] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-03T17:14:32.165300] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:32.165565] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-03T17:14:32.165617] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-03T17:14:32.166238] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-03T17:14:32.166303] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-03T17:14:32.571176] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:32.790740] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-03T17:14:33.040024] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T17:14:33.578066] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T17:14:33.590626] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-03T17:14:34.390667] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-03T17:14:34.500298] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:14:34.652239] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T17:14:35.190730] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-03T17:14:35.990729] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-03T17:14:36.050476] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T17:14:36.606373] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T17:14:36.790735] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-03T17:14:37.590638] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-03T17:14:38.082855] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:14:38.390740] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-03T17:14:38.562148] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T17:14:38.565145] [INFO ] [REMOTE ] AMTM: Full fetch complete (73997 records). [2025-10-03T17:14:38.565315] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-03T17:14:39.016448] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-03T17:14:39.016576] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-03T17:14:39.017538] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-03T17:14:39.017671] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-03T17:14:39.019919] [DEBUG] [LOCAL ] AMTM: Trimmed 73997 records to 51421 (keeping 200 days of data) [2025-10-03T17:14:39.142144] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:14:39.232930] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-03T17:14:39.390532] [DEBUG] [LOCAL ] AMTM: Primary data saved (51421 records). [2025-10-03T17:14:39.390714] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-03T17:14:39.393549] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMTM took 38.3s. Estimated remaining: 4h 51m 14s. Rate: 7.7 symbols/min [2025-10-03T17:14:39.579045] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:39.579226] [DEBUG] [LOCAL ] ANF: No existing data file found in primary storage. [2025-10-03T17:14:39.579267] [WARN ] [MAIN ] ANF: No existing data found, performing full refresh instead. [2025-10-03T17:14:39.579388] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-03T17:14:39.579432] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-03T17:14:39.579476] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-03T17:14:39.579512] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-03T17:14:39.985447] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:40.000094] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-03T17:14:40.021216] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T17:14:40.790708] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-03T17:14:40.822505] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:14:41.590737] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-03T17:14:42.117587] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T17:14:42.390698] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-03T17:14:42.836670] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T17:14:42.992013] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:14:43.190734] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-03T17:14:43.990670] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-03T17:14:44.405345] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T17:14:44.619435] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:14:44.790737] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-03T17:14:45.534499] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:14:45.590681] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-03T17:14:46.037403] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T17:14:46.390704] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-03T17:14:47.190710] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-03T17:14:47.728297] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T17:14:47.990734] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-03T17:14:48.080407] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:14:48.349012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:14:48.351453] [INFO ] [REMOTE ] AMX: Full fetch complete (70766 records). [2025-10-03T17:14:48.351573] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-03T17:14:48.786896] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-03T17:14:48.786990] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-03T17:14:48.787762] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-03T17:14:48.787831] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-03T17:14:48.790700] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-03T17:14:48.791746] [DEBUG] [LOCAL ] AMX: Trimmed 70766 records to 49863 (keeping 200 days of data) [2025-10-03T17:14:49.109304] [DEBUG] [LOCAL ] AMX: Primary data saved (49863 records). [2025-10-03T17:14:49.109456] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-03T17:14:49.109559] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AMX took 40.2s. Estimated remaining: 4h 51m 45s. Rate: 7.7 symbols/min [2025-10-03T17:14:49.294701] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:49.294933] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-03T17:14:49.294991] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-03T17:14:49.295143] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-03T17:14:49.295188] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-03T17:14:49.295234] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-03T17:14:49.295275] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-03T17:14:49.601492] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-03T17:14:49.688823] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:49.833420] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T17:14:49.989309] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-03T17:14:50.390697] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-03T17:14:51.190696] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-03T17:14:51.485926] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T17:14:51.591573] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T17:14:51.990704] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-03T17:14:52.790695] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-03T17:14:53.597910] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-03T17:14:53.627736] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-03T17:14:53.660950] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T17:14:53.834559] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:14:53.834915] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-03T17:14:53.835027] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:14:53.835095] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-03T17:14:53.835164] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:14:53.835236] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-03T17:14:53.835303] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-03T17:14:53.835340] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-03T17:14:53.835432] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-03T17:14:53.835553] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. ANGX took 4.7s. Estimated remaining: 4h 50m 38s. Rate: 7.8 symbols/min [2025-10-03T17:14:54.031774] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:54.073610] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T17:14:54.092713] [DEBUG] [LOCAL ] ANRO: Loaded 18833 existing records from primary storage. [2025-10-03T17:14:54.092997] [INFO ] [MAIN ] ANRO: Loaded 18833 existing records. [2025-10-03T17:14:54.280856] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:54.281093] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-03T17:14:54.281144] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-03T17:14:54.281521] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-03T17:14:54.281582] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-03T17:14:54.399459] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-03T17:14:54.674616] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:55.190707] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-03T17:14:55.990704] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-03T17:14:56.153152] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:14:56.335424] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:14:56.337250] [INFO ] [REMOTE ] AN: Full fetch complete (47483 records). [2025-10-03T17:14:56.337342] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-03T17:14:56.753837] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-03T17:14:56.753935] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-03T17:14:56.754506] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-03T17:14:56.754555] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-03T17:14:56.755891] [DEBUG] [LOCAL ] AN: Trimmed 47483 records to 32323 (keeping 200 days of data) [2025-10-03T17:14:56.817941] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-03T17:14:56.968199] [DEBUG] [LOCAL ] AN: Primary data saved (32323 records). [2025-10-03T17:14:56.968361] [INFO ] [MAIN ] AN: Full history saved. [2025-10-03T17:14:56.968441] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. AN took 27.9s. Estimated remaining: 4h 49m 1s. Rate: 7.8 symbols/min [2025-10-03T17:14:57.202475] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:14:57.225456] [DEBUG] [LOCAL ] ANVS: Loaded 23369 existing records from primary storage. [2025-10-03T17:14:57.225892] [INFO ] [MAIN ] ANVS: Loaded 23369 existing records. [2025-10-03T17:14:57.416031] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:14:57.447125] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:14:57.447374] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-03T17:14:57.447431] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-03T17:14:57.447706] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-03T17:14:57.447772] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-03T17:14:57.595833] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-03T17:14:57.835034] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:14:58.390719] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-03T17:14:58.619541] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:14:58.974569] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T17:14:59.190707] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-03T17:14:59.906234] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T17:14:59.990671] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-03T17:15:00.302767] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:15:00.790749] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-03T17:15:01.375491] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:15:01.590729] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-03T17:15:02.390697] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-03T17:15:03.120697] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:15:03.193956] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-03T17:15:03.201730] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T17:15:03.300090] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:15:03.990701] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-03T17:15:04.790726] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-03T17:15:05.486398] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-03T17:15:05.590694] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-03T17:15:05.923033] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:15:06.390682] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-03T17:15:06.535806] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-10-03T17:15:07.141286] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:15:07.190734] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-03T17:15:07.365633] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T17:15:07.990744] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-03T17:15:08.790720] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-03T17:15:09.169076] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T17:15:09.306624] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:15:09.590703] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-03T17:15:10.039034] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:15:10.390740] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-03T17:15:11.190770] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-03T17:15:11.324334] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:15:11.598245] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:15:11.787089] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T17:15:11.990744] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-03T17:15:12.790728] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-03T17:15:13.168436] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:15:13.590719] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-03T17:15:14.390753] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-03T17:15:14.414480] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:15:14.418284] [INFO ] [REMOTE ] ANF: Full fetch complete (75603 records). [2025-10-03T17:15:14.418522] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-03T17:15:14.879099] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-03T17:15:14.879221] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-03T17:15:14.880133] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-03T17:15:14.880250] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-03T17:15:14.882013] [DEBUG] [LOCAL ] ANF: Trimmed 75603 records to 52869 (keeping 200 days of data) [2025-10-03T17:15:15.006446] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:15:15.205068] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-03T17:15:15.255302] [DEBUG] [LOCAL ] ANF: Primary data saved (52869 records). [2025-10-03T17:15:15.255454] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-03T17:15:15.255533] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. ANF took 35.9s. Estimated remaining: 4h 52m 17s. Rate: 7.7 symbols/min [2025-10-03T17:15:15.990732] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-03T17:15:16.453959] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:15:16.685413] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T17:15:16.790686] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-03T17:15:16.949985] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T17:15:17.590734] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-03T17:15:18.390739] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-03T17:15:18.718786] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:15:18.814055] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T17:15:19.190717] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-03T17:15:19.393425] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:15:19.990711] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-03T17:15:20.588564] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T17:15:20.590012] [INFO ] [REMOTE ] ANRO: Full fetch complete (28975 records). [2025-10-03T17:15:20.590175] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-03T17:15:20.590913] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:15:20.591022] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:15:20.591109] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:15:20.591198] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-03T17:15:20.591277] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-03T17:15:20.591326] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-10-03T17:15:20.591739] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-10-03T17:15:20.591930] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANRO took 26.8s. Estimated remaining: 4h 51m 22s. Rate: 7.7 symbols/min [2025-10-03T17:15:20.790715] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-03T17:15:21.636480] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-03T17:15:21.652043] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-03T17:15:21.929720] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:15:22.390701] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-03T17:15:23.360531] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:15:23.362217] [INFO ] [REMOTE ] ANVS: Full fetch complete (36333 records). [2025-10-03T17:15:23.362311] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-03T17:15:23.802065] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-03T17:15:23.802162] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-03T17:15:23.802630] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-03T17:15:23.802724] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-03T17:15:23.803801] [DEBUG] [LOCAL ] ANVS: Trimmed 36333 records to 23555 (keeping 200 days of data) [2025-10-03T17:15:23.924172] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T17:15:23.928850] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-03T17:15:23.931784] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-03T17:15:24.124582] [DEBUG] [LOCAL ] ANVS: Primary data saved (23555 records). [2025-10-03T17:15:24.155786] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-03T17:15:24.176611] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANVS took 27.2s. Estimated remaining: 4h 49m 56s. Rate: 7.8 symbols/min [2025-10-03T17:15:24.392572] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-03T17:15:24.392687] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-03T17:15:24.393488] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-03T17:15:24.393554] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-03T17:15:24.395232] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54546 (keeping 200 days of data) [2025-10-03T17:15:24.743429] [DEBUG] [LOCAL ] ANET: Primary data saved (54546 records). [2025-10-03T17:15:24.743584] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-03T17:15:24.743696] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANET took 53.0s. Estimated remaining: 4h 47m 34s. Rate: 7.8 symbols/min [2025-10-03T17:15:25.416832] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.512124] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-03T17:15:25.518919] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.509253] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.512419] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-03T17:15:25.540081] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-03T17:15:25.540306] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-03T17:15:25.542810] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-03T17:15:25.542894] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-03T17:15:25.542545] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:25.688284] [DEBUG] [LOCAL ] AOMR: Loaded 16644 existing records from primary storage. [2025-10-03T17:15:25.689329] [INFO ] [MAIN ] AOMR: Loaded 16644 existing records. [2025-10-03T17:15:25.854075] [DEBUG] [LOCAL ] AOD: Loaded 30406 existing records from primary storage. [2025-10-03T17:15:25.977459] [DEBUG] [LOCAL ] AON: Loaded 45726 existing records from primary storage. [2025-10-03T17:15:25.981898] [INFO ] [MAIN ] AOD: Loaded 30406 existing records. [2025-10-03T17:15:26.101940] [INFO ] [MAIN ] AON: Loaded 45726 existing records. [2025-10-03T17:15:26.273880] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.382923] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.416729] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-03T17:15:26.498719] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:26.480285] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-03T17:15:26.536105] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-03T17:15:26.536675] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-03T17:15:26.661024] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.830107] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.841159] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-03T17:15:26.840855] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:26.847232] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-03T17:15:26.847547] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-03T17:15:26.847437] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-03T17:15:26.858703] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:15:26.863930] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-03T17:15:26.904133] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-03T17:15:26.925051] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-03T17:15:26.975928] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:15:27.021515] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-03T17:15:27.021583] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-03T17:15:27.073623] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:15:27.130742] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-03T17:15:27.244405] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-03T17:15:27.270444] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-03T17:15:27.333984] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-03T17:15:27.415052] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOMD took 2.7s. Estimated remaining: 4h 45m 53s. Rate: 7.9 symbols/min [2025-10-03T17:15:27.608939] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:27.701627] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-03T17:15:27.950101] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:27.997502] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-03T17:15:28.160076] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:28.164843] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-03T17:15:28.164492] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:28.165806] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-03T17:15:28.165865] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-03T17:15:28.165982] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-03T17:15:28.166027] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-03T17:15:28.166070] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-03T17:15:28.166104] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-03T17:15:28.562124] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:28.563012] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-03T17:15:28.868571] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:15:28.871879] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-03T17:15:29.406805] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T17:15:29.415384] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-03T17:15:29.493591] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:15:29.510064] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T17:15:29.511875] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-03T17:15:29.590747] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-03T17:15:29.896453] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:15:30.389071] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T17:15:30.395286] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-03T17:15:30.505801] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:15:30.772712] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:15:31.190711] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-03T17:15:31.990707] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-03T17:15:32.127046] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:15:32.417979] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:15:32.790682] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-03T17:15:33.122765] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T17:15:33.590757] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-03T17:15:34.183206] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:15:34.390723] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-03T17:15:35.190706] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-03T17:15:35.224205] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:15:35.333248] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:15:35.990730] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-03T17:15:36.503372] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:15:36.790675] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-03T17:15:37.025028] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:15:37.590734] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-03T17:15:38.043916] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T17:15:38.390735] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-03T17:15:38.622868] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:15:39.190752] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-03T17:15:39.710221] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T17:15:39.756810] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:15:39.990718] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-03T17:15:40.790730] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-03T17:15:41.590740] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-03T17:15:41.906344] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T17:15:41.956937] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:15:42.387537] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-03T17:15:42.390895] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-03T17:15:43.191155] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-03T17:15:43.595097] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:15:43.990724] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-03T17:15:44.790720] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-03T17:15:45.179005] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:15:45.233755] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:15:45.375191] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:15:45.590719] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-03T17:15:46.390735] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-03T17:15:46.983484] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T17:15:47.182237] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:15:47.183437] [INFO ] [REMOTE ] AOMR: Full fetch complete (23218 records). [2025-10-03T17:15:47.183569] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-03T17:15:47.195827] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-03T17:15:47.596413] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-03T17:15:47.596782] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-03T17:15:47.597239] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-03T17:15:47.597307] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-03T17:15:47.599340] [DEBUG] [LOCAL ] AOMR: Trimmed 23218 records to 16719 (keeping 200 days of data) [2025-10-03T17:15:47.711607] [DEBUG] [LOCAL ] AOMR: Primary data saved (16719 records). [2025-10-03T17:15:47.711798] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-03T17:15:47.711944] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AOMR took 23.0s. Estimated remaining: 4h 49m 39s. Rate: 7.8 symbols/min [2025-10-03T17:15:47.900455] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:47.950078] [DEBUG] [LOCAL ] AOS: Loaded 49194 existing records from primary storage. [2025-10-03T17:15:47.950468] [INFO ] [MAIN ] AOS: Loaded 49194 existing records. [2025-10-03T17:15:47.995890] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-03T17:15:48.142896] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:48.143209] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-03T17:15:48.143267] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-03T17:15:48.144082] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-03T17:15:48.144145] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-03T17:15:48.533283] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:15:48.790631] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-03T17:15:48.996700] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:15:49.253016] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T17:15:49.590739] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-03T17:15:50.390698] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-03T17:15:50.668526] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:15:50.772670] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:15:51.190690] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-03T17:15:51.532022] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:15:51.990749] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-03T17:15:52.790704] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-03T17:15:52.966116] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:15:53.366524] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T17:15:53.590690] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-03T17:15:53.832226] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:15:54.390688] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-03T17:15:55.190682] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-03T17:15:55.243521] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:15:55.990680] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-03T17:15:56.208668] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:15:56.611450] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:15:56.790740] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-03T17:15:57.390706] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:15:57.590716] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-03T17:15:57.919793] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:15:58.390707] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-03T17:15:58.656470] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:15:58.658876] [INFO ] [REMOTE ] AORT: Full fetch complete (41997 records). [2025-10-03T17:15:58.659047] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-03T17:15:59.141750] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-03T17:15:59.141911] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-03T17:15:59.142465] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-03T17:15:59.142531] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-03T17:15:59.143965] [DEBUG] [LOCAL ] AORT: Trimmed 41997 records to 29872 (keeping 200 days of data) [2025-10-03T17:15:59.194433] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-03T17:15:59.328113] [DEBUG] [LOCAL ] AORT: Primary data saved (29872 records). [2025-10-03T17:15:59.328260] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-03T17:15:59.328335] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AORT took 31.8s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-03T17:15:59.514143] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:15:59.525936] [DEBUG] [LOCAL ] AP: Loaded 7211 existing records from primary storage. [2025-10-03T17:15:59.526152] [INFO ] [MAIN ] AP: Loaded 7211 existing records. [2025-10-03T17:15:59.717246] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:15:59.717451] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-03T17:15:59.717500] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-03T17:15:59.717768] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-03T17:15:59.717861] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-03T17:15:59.998113] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-03T17:16:00.123788] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:00.164886] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T17:16:00.436223] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:16:00.438279] [INFO ] [REMOTE ] AOD: Full fetch complete (44307 records). [2025-10-03T17:16:00.438365] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-03T17:16:00.795764] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-03T17:16:00.885818] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-03T17:16:00.885900] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-03T17:16:00.886407] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-03T17:16:00.886470] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-03T17:16:00.887481] [DEBUG] [LOCAL ] AOD: Trimmed 44307 records to 30678 (keeping 200 days of data) [2025-10-03T17:16:01.086863] [DEBUG] [LOCAL ] AOD: Primary data saved (30678 records). [2025-10-03T17:16:01.087009] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-03T17:16:01.087109] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AOD took 36.3s. Estimated remaining: 4h 48m 46s. Rate: 7.8 symbols/min [2025-10-03T17:16:01.266471] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:01.306855] [DEBUG] [LOCAL ] APAM: Loaded 36350 existing records from primary storage. [2025-10-03T17:16:01.307692] [INFO ] [MAIN ] APAM: Loaded 36350 existing records. [2025-10-03T17:16:01.512998] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:01.513300] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-03T17:16:01.513426] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-03T17:16:01.513894] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-03T17:16:01.513965] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-03T17:16:01.601471] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-03T17:16:01.865763] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T17:16:02.037436] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:02.067131] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T17:16:02.390689] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-03T17:16:02.850476] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:16:03.114195] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T17:16:03.190741] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-03T17:16:03.843608] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:16:03.990689] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-03T17:16:04.790665] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-03T17:16:05.240577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:16:05.375802] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T17:16:05.590739] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-03T17:16:06.176076] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T17:16:06.390698] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-03T17:16:07.190714] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-03T17:16:07.749715] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:16:07.990714] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-03T17:16:08.619434] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:16:08.790720] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-03T17:16:09.369961] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T17:16:09.590738] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-03T17:16:10.202181] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T17:16:10.390713] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-03T17:16:11.122512] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T17:16:11.190633] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-03T17:16:11.435820] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:16:11.990706] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-03T17:16:12.594689] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:16:12.790703] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-03T17:16:13.516670] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:16:13.590726] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-03T17:16:13.916720] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:16:14.390724] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-03T17:16:14.940795] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:16:14.943118] [INFO ] [REMOTE ] AON: Full fetch complete (64693 records). [2025-10-03T17:16:14.943221] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-03T17:16:15.199960] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-03T17:16:15.394782] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-03T17:16:15.402728] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-03T17:16:15.403672] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-03T17:16:15.404153] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T17:16:15.404359] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-03T17:16:15.409059] [DEBUG] [LOCAL ] AON: Trimmed 64693 records to 45997 (keeping 200 days of data) [2025-10-03T17:16:15.720174] [DEBUG] [LOCAL ] AON: Primary data saved (45997 records). [2025-10-03T17:16:15.720321] [INFO ] [MAIN ] AON: Full history saved. [2025-10-03T17:16:15.721571] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 51.0s. Estimated remaining: 4h 50m 42s. Rate: 7.7 symbols/min [2025-10-03T17:16:15.910001] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:15.957828] [DEBUG] [LOCAL ] APD: Loaded 45731 existing records from primary storage. [2025-10-03T17:16:15.958226] [INFO ] [MAIN ] APD: Loaded 45731 existing records. [2025-10-03T17:16:15.995829] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-03T17:16:16.170375] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:16.170636] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-03T17:16:16.170725] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-03T17:16:16.170989] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-03T17:16:16.171050] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-03T17:16:16.572337] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:16.772671] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:16:16.801689] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-03T17:16:16.808042] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T17:16:17.590738] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-03T17:16:18.334892] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:16:18.390693] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-03T17:16:18.537305] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:16:18.983952] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T17:16:18.984985] [INFO ] [REMOTE ] AP: Full fetch complete (8951 records). [2025-10-03T17:16:18.985068] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-03T17:16:19.200027] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-03T17:16:19.412380] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-03T17:16:19.412466] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-03T17:16:19.412728] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-03T17:16:19.412794] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-03T17:16:19.413446] [DEBUG] [LOCAL ] AP: Trimmed 8951 records to 7267 (keeping 200 days of data) [2025-10-03T17:16:19.457297] [DEBUG] [LOCAL ] AP: Primary data saved (7267 records). [2025-10-03T17:16:19.457471] [INFO ] [MAIN ] AP: Full history saved. [2025-10-03T17:16:19.457571] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AP took 20.1s. Estimated remaining: 4h 49m 23s. Rate: 7.8 symbols/min [2025-10-03T17:16:19.687624] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:19.752406] [DEBUG] [LOCAL ] APG: Loaded 50572 existing records from primary storage. [2025-10-03T17:16:19.752858] [INFO ] [MAIN ] APG: Loaded 50572 existing records. [2025-10-03T17:16:19.951945] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:19.952192] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-03T17:16:19.952241] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-03T17:16:19.952508] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-10-03T17:16:19.952569] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-03T17:16:19.999154] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-03T17:16:20.361076] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:20.790702] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-03T17:16:20.967260] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:16:21.366819] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:16:21.369362] [INFO ] [REMOTE ] AOS: Full fetch complete (70617 records). [2025-10-03T17:16:21.369491] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-03T17:16:21.595926] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-03T17:16:21.813792] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-03T17:16:21.813898] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-03T17:16:21.814707] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-03T17:16:21.814853] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-03T17:16:21.816721] [DEBUG] [LOCAL ] AOS: Trimmed 70617 records to 49496 (keeping 200 days of data) [2025-10-03T17:16:22.227435] [DEBUG] [LOCAL ] AOS: Primary data saved (49496 records). [2025-10-03T17:16:22.227717] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-03T17:16:22.227880] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. AOS took 34.5s. Estimated remaining: 4h 47m 47s. Rate: 7.8 symbols/min [2025-10-03T17:16:22.402585] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-03T17:16:22.528838] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:22.606423] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:16:22.654195] [DEBUG] [LOCAL ] APH: Loaded 54081 existing records from primary storage. [2025-10-03T17:16:22.654760] [INFO ] [MAIN ] APH: Loaded 54081 existing records. [2025-10-03T17:16:22.890134] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:22.890407] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-03T17:16:22.890458] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-03T17:16:22.890712] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-03T17:16:22.890784] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-03T17:16:23.195815] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-03T17:16:23.351789] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:23.385120] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:16:23.990726] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-03T17:16:24.064448] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T17:16:24.523113] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:16:24.790701] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-03T17:16:25.378749] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T17:16:25.590707] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-03T17:16:26.390631] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-03T17:16:26.649234] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T17:16:26.940079] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:16:27.190686] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-03T17:16:27.990728] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-03T17:16:28.145311] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:16:28.601407] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:16:28.790751] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-03T17:16:29.590726] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-03T17:16:29.664206] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:16:30.288423] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:16:30.390689] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-03T17:16:31.190709] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-03T17:16:31.711327] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:16:31.990717] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-03T17:16:32.054525] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:16:32.672444] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T17:16:32.790713] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-03T17:16:33.565392] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T17:16:33.590634] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-03T17:16:34.364414] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:16:34.390701] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-03T17:16:35.083720] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:16:35.190706] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-03T17:16:35.990760] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-03T17:16:36.025795] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:16:36.543433] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T17:16:36.790718] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-03T17:16:37.590690] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-03T17:16:38.173084] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T17:16:38.390710] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-03T17:16:38.524262] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:16:38.913790] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T17:16:39.190698] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-03T17:16:39.990707] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-03T17:16:40.030038] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:16:40.790715] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-03T17:16:40.939739] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:16:41.005413] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T17:16:41.590727] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-03T17:16:42.390706] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-03T17:16:42.678415] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T17:16:43.204674] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-03T17:16:43.213461] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:16:43.630605] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:16:43.632794] [INFO ] [REMOTE ] APAM: Full fetch complete (51814 records). [2025-10-03T17:16:43.633015] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-03T17:16:43.999718] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-03T17:16:44.063278] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-03T17:16:44.063411] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-03T17:16:44.064180] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-03T17:16:44.064260] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-03T17:16:44.065688] [DEBUG] [LOCAL ] APAM: Trimmed 51814 records to 36607 (keeping 200 days of data) [2025-10-03T17:16:44.295149] [DEBUG] [LOCAL ] APAM: Primary data saved (36607 records). [2025-10-03T17:16:44.295310] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-03T17:16:44.296379] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APAM took 43.2s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-03T17:16:44.485759] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:44.486004] [DEBUG] [LOCAL ] APLE: No existing data file found in primary storage. [2025-10-03T17:16:44.486064] [WARN ] [MAIN ] APLE: No existing data found, performing full refresh instead. [2025-10-03T17:16:44.486229] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-03T17:16:44.486285] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-03T17:16:44.486329] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-03T17:16:44.486362] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-03T17:16:44.795890] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-03T17:16:44.927117] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:45.395185] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-03T17:16:45.590636] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-03T17:16:45.937240] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T17:16:46.390683] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-03T17:16:46.603328] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T17:16:47.180707] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:16:47.192198] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-03T17:16:47.992889] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-03T17:16:47.995718] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:16:48.471515] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:16:48.790699] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-03T17:16:49.590743] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-03T17:16:50.249235] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T17:16:50.390718] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-03T17:16:50.525001] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:16:50.847178] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:16:50.850627] [INFO ] [REMOTE ] APG: Full fetch complete (71734 records). [2025-10-03T17:16:50.850817] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-03T17:16:51.196608] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-03T17:16:51.315692] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-03T17:16:51.315812] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-03T17:16:51.316704] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-03T17:16:51.316772] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-03T17:16:51.318383] [DEBUG] [LOCAL ] APG: Trimmed 71734 records to 50954 (keeping 200 days of data) [2025-10-03T17:16:51.637340] [DEBUG] [LOCAL ] APG: Primary data saved (50954 records). [2025-10-03T17:16:51.637499] [INFO ] [MAIN ] APG: Full history saved. [2025-10-03T17:16:51.637691] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. APG took 32.2s. Estimated remaining: 4h 51m 35s. Rate: 7.7 symbols/min [2025-10-03T17:16:51.821502] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:51.884797] [DEBUG] [LOCAL ] APO: Loaded 53773 existing records from primary storage. [2025-10-03T17:16:51.885180] [INFO ] [MAIN ] APO: Loaded 53773 existing records. [2025-10-03T17:16:51.992031] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-03T17:16:52.075567] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:52.075813] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-03T17:16:52.075866] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-03T17:16:52.076893] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-03T17:16:52.076957] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-03T17:16:52.383930] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T17:16:52.403577] [INFO ] [REMOTE ] APH: Full fetch complete (77691 records). [2025-10-03T17:16:52.439829] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-03T17:16:52.472271] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:52.800974] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-03T17:16:52.948148] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-03T17:16:52.948286] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-03T17:16:52.949462] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-03T17:16:52.949606] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-03T17:16:52.976497] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T17:16:52.987191] [DEBUG] [LOCAL ] APH: Trimmed 77691 records to 54471 (keeping 200 days of data) [2025-10-03T17:16:53.364887] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:16:53.397260] [DEBUG] [LOCAL ] APH: Primary data saved (54471 records). [2025-10-03T17:16:53.397429] [INFO ] [MAIN ] APH: Full history saved. [2025-10-03T17:16:53.397521] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APH took 31.2s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-03T17:16:53.589106] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:53.589277] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-03T17:16:53.589360] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-03T17:16:53.589484] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-03T17:16:53.589540] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-03T17:16:53.589584] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-03T17:16:53.589618] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-03T17:16:53.601468] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-03T17:16:53.972506] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:54.390705] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-03T17:16:54.929522] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T17:16:55.190630] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-03T17:16:55.416179] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:16:55.842499] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:16:55.990715] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-03T17:16:56.586074] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:16:56.790698] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-03T17:16:57.085416] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:16:57.087593] [INFO ] [REMOTE ] APD: Full fetch complete (66482 records). [2025-10-03T17:16:57.087726] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-03T17:16:57.088733] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:16:57.088824] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:16:57.088873] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:16:57.088958] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-03T17:16:57.089040] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-10-03T17:16:57.089093] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-10-03T17:16:57.089497] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-10-03T17:16:57.090549] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APD took 41.4s. Estimated remaining: 4h 48m 26s. Rate: 7.8 symbols/min [2025-10-03T17:16:57.282085] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:16:57.338080] [DEBUG] [LOCAL ] APTV: Loaded 52472 existing records from primary storage. [2025-10-03T17:16:57.338500] [INFO ] [MAIN ] APTV: Loaded 52472 existing records. [2025-10-03T17:16:57.542383] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:16:57.542624] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-03T17:16:57.542722] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-03T17:16:57.544438] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-03T17:16:57.544503] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-03T17:16:57.592086] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-03T17:16:57.755577] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:16:57.948566] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:16:58.390725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-03T17:16:59.190685] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-03T17:16:59.439421] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:16:59.859223] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T17:16:59.990742] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-03T17:17:00.326195] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T17:17:00.757104] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:17:00.790712] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-03T17:17:01.590725] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-03T17:17:02.390702] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-03T17:17:02.716595] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:17:02.855273] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-03T17:17:03.190724] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-03T17:17:03.407277] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:17:03.990747] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-03T17:17:04.790732] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-03T17:17:05.432217] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:17:05.590728] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-03T17:17:05.716636] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:17:06.390710] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-03T17:17:06.782094] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:17:07.004846] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T17:17:07.190672] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-03T17:17:07.339291] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:17:07.990705] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-03T17:17:08.258933] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:17:08.790738] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-03T17:17:09.576440] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:17:09.590611] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-03T17:17:10.390684] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-03T17:17:10.523140] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T17:17:11.148424] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:17:11.190695] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-03T17:17:11.563296] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T17:17:11.790222] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T17:17:11.990731] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-03T17:17:12.596482] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:17:12.790736] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-03T17:17:12.899579] [DEBUG] [REMOTE ] APLE: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T17:17:12.899960] [WARN ] [REMOTE ] APLE: No data returned for month 2025-08 [2025-10-03T17:17:12.900069] [FATAL] [REMOTE ] APLE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:17:12.900221] [FATAL] [MAIN ] APLE: Failed to fetch primary data. [2025-10-03T17:17:12.900302] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:17:12.900378] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-03T17:17:12.900451] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-03T17:17:12.900492] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-03T17:17:12.900555] [DEBUG] [LOCAL ] APLE: No derivative data file found to delete. [2025-10-03T17:17:12.900708] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APLE took 28.6s. Estimated remaining: 4h 50m 35s. Rate: 7.7 symbols/min [2025-10-03T17:17:13.100043] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:13.160867] [DEBUG] [LOCAL ] AQN: Loaded 52288 existing records from primary storage. [2025-10-03T17:17:13.161233] [INFO ] [MAIN ] AQN: Loaded 52288 existing records. [2025-10-03T17:17:13.353598] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:13.353857] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-03T17:17:13.353911] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-03T17:17:13.355552] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-03T17:17:13.355618] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-03T17:17:13.595898] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-03T17:17:13.776172] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:14.390713] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-03T17:17:15.190738] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-03T17:17:15.481752] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:17:15.990729] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-03T17:17:16.250299] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T17:17:16.790738] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-03T17:17:17.097886] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T17:17:17.277622] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-03T17:17:17.590623] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-03T17:17:17.797288] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:17:18.390731] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-03T17:17:19.190621] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-03T17:17:19.334749] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T17:17:19.335755] [INFO ] [REMOTE ] APOS: Full fetch complete (10440 records). [2025-10-03T17:17:19.335830] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-03T17:17:19.663073] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T17:17:19.784128] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-03T17:17:19.784231] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-03T17:17:19.784542] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-03T17:17:19.784587] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-03T17:17:19.785136] [DEBUG] [LOCAL ] APOS: Trimmed 10440 records to 7664 (keeping 200 days of data) [2025-10-03T17:17:19.834989] [DEBUG] [LOCAL ] APOS: Primary data saved (7664 records). [2025-10-03T17:17:19.835143] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-03T17:17:19.835251] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APOS took 26.4s. Estimated remaining: 4h 50m 13s. Rate: 7.7 symbols/min [2025-10-03T17:17:20.017004] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-03T17:17:20.059493] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:20.067110] [DEBUG] [LOCAL ] AQNB: Loaded 4183 existing records from primary storage. [2025-10-03T17:17:20.067284] [INFO ] [MAIN ] AQNB: Loaded 4183 existing records. [2025-10-03T17:17:20.265800] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:20.266039] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-03T17:17:20.266089] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-03T17:17:20.266418] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-03T17:17:20.266481] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-03T17:17:20.657946] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:20.790713] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-03T17:17:21.041098] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:17:21.590737] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-03T17:17:22.026182] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:17:22.201355] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:17:22.390727] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-03T17:17:23.180451] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T17:17:23.190627] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-03T17:17:23.320350] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T17:17:23.990721] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-03T17:17:24.790730] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-03T17:17:24.972449] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:17:25.281839] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T17:17:25.590740] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-03T17:17:25.929758] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T17:17:26.390725] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-03T17:17:26.823701] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:17:27.190706] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-03T17:17:27.481674] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T17:17:27.761341] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:17:27.990712] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-03T17:17:28.695841] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T17:17:28.790717] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-03T17:17:29.590743] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-03T17:17:30.193026] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T17:17:30.390746] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-03T17:17:30.694617] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:17:31.190727] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-03T17:17:31.990689] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-03T17:17:32.137684] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T17:17:32.790724] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-03T17:17:33.070107] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:17:33.585905] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:17:33.596860] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-03T17:17:34.390688] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-03T17:17:34.535448] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:17:34.538105] [INFO ] [REMOTE ] APO: Full fetch complete (76902 records). [2025-10-03T17:17:34.538221] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-03T17:17:34.539196] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:17:34.539295] [FATAL] [MAIN ] APO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:17:34.539341] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:17:34.539384] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-03T17:17:34.539445] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-03T17:17:34.539482] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-10-03T17:17:34.539745] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-10-03T17:17:34.539864] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APO took 42.9s. Estimated remaining: 4h 52m 1s. Rate: 7.7 symbols/min [2025-10-03T17:17:34.735005] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:34.730840] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:17:34.797762] [DEBUG] [LOCAL ] AR: Loaded 53973 existing records from primary storage. [2025-10-03T17:17:34.798191] [INFO ] [MAIN ] AR: Loaded 53973 existing records. [2025-10-03T17:17:34.994252] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:34.994496] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-03T17:17:34.994547] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-03T17:17:34.995792] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-03T17:17:34.995853] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-03T17:17:35.200186] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-03T17:17:35.389918] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:35.990699] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-03T17:17:36.563953] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T17:17:36.733364] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-10-03T17:17:36.790742] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-03T17:17:36.962725] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T17:17:37.264788] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T17:17:37.590729] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-03T17:17:38.390808] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-03T17:17:39.190687] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-03T17:17:39.527755] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:17:39.909990] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:17:39.913002] [INFO ] [REMOTE ] APTV: Full fetch complete (75915 records). [2025-10-03T17:17:39.913155] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-03T17:17:39.995803] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-03T17:17:40.356818] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-03T17:17:40.356956] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-03T17:17:40.357911] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-03T17:17:40.358045] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-03T17:17:40.359795] [DEBUG] [LOCAL ] APTV: Trimmed 75915 records to 52852 (keeping 200 days of data) [2025-10-03T17:17:40.460197] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T17:17:40.698340] [DEBUG] [LOCAL ] APTV: Primary data saved (52852 records). [2025-10-03T17:17:40.698491] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-03T17:17:40.699228] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. APTV took 43.6s. Estimated remaining: 4h 51m 25s. Rate: 7.7 symbols/min [2025-10-03T17:17:40.795748] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-03T17:17:40.896253] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:40.942455] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:17:40.988859] [DEBUG] [LOCAL ] ARCO: Loaded 44724 existing records from primary storage. [2025-10-03T17:17:40.989206] [INFO ] [MAIN ] ARCO: Loaded 44724 existing records. [2025-10-03T17:17:41.183882] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:41.184101] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-03T17:17:41.184152] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-03T17:17:41.184408] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-03T17:17:41.184468] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-03T17:17:41.584862] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:41.590688] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-03T17:17:42.390724] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-03T17:17:42.684600] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T17:17:43.190678] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-03T17:17:43.249504] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:17:43.955818] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:17:43.990735] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-03T17:17:44.694194] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:17:44.695105] [INFO ] [REMOTE ] AQNB: Full fetch complete (5690 records). [2025-10-03T17:17:44.695213] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-03T17:17:44.793748] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-03T17:17:45.050390] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T17:17:45.140233] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-03T17:17:45.140320] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-03T17:17:45.140486] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-03T17:17:45.140530] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-03T17:17:45.141091] [DEBUG] [LOCAL ] AQNB: Trimmed 5690 records to 4198 (keeping 200 days of data) [2025-10-03T17:17:45.169425] [DEBUG] [LOCAL ] AQNB: Primary data saved (4198 records). [2025-10-03T17:17:45.169575] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-03T17:17:45.169708] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. AQNB took 25.3s. Estimated remaining: 4h 50m 22s. Rate: 7.7 symbols/min [2025-10-03T17:17:45.349291] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:45.371356] [DEBUG] [LOCAL ] ARDC: Loaded 14882 existing records from primary storage. [2025-10-03T17:17:45.371615] [INFO ] [MAIN ] ARDC: Loaded 14882 existing records. [2025-10-03T17:17:45.567049] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:45.567266] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-03T17:17:45.567320] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-03T17:17:45.567578] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-03T17:17:45.567639] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-03T17:17:45.603440] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-03T17:17:45.976810] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:46.390758] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-03T17:17:46.611120] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T17:17:47.145762] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:17:47.149170] [INFO ] [REMOTE ] AQN: Full fetch complete (74928 records). [2025-10-03T17:17:47.149346] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-03T17:17:47.150333] [FATAL] [VALIDATOR ] AQN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:17:47.150485] [FATAL] [MAIN ] AQN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:17:47.150549] [WARN ] [MAIN ] AQN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:17:47.150634] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-03T17:17:47.150760] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-03T17:17:47.150828] [INFO ] [LOCAL ] AQN: Starting deletion of derivative data. [2025-10-03T17:17:47.151297] [DEBUG] [LOCAL ] AQN: Deleted derivative data file. [2025-10-03T17:17:47.152016] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. AQN took 34.3s. Estimated remaining: 4h 48m 40s. Rate: 7.7 symbols/min [2025-10-03T17:17:47.198510] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-03T17:17:47.353872] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:17:47.355143] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:17:47.394946] [DEBUG] [LOCAL ] ARDT: Loaded 27847 existing records from primary storage. [2025-10-03T17:17:47.395273] [INFO ] [MAIN ] ARDT: Loaded 27847 existing records. [2025-10-03T17:17:47.585803] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:17:47.586046] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-03T17:17:47.586117] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-03T17:17:47.586387] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-03T17:17:47.586446] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-03T17:17:47.971479] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:17:47.990674] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-03T17:17:48.790634] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-03T17:17:49.087865] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:17:49.250694] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:17:49.590739] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-03T17:17:50.390630] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-03T17:17:50.431257] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:17:50.449544] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T17:17:51.190690] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-03T17:17:51.990671] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-03T17:17:52.128131] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:17:52.507058] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:17:52.790697] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-03T17:17:53.590711] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-03T17:17:53.684755] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:17:53.741503] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:17:54.390702] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-03T17:17:55.190683] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-03T17:17:55.558801] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T17:17:55.799342] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:17:55.990765] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-03T17:17:56.533460] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T17:17:56.790677] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-03T17:17:56.908318] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:17:57.590766] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-03T17:17:58.390736] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-03T17:17:58.467821] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:17:58.492435] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T17:17:59.190765] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-03T17:17:59.990693] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-03T17:18:00.134825] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:18:00.183297] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:18:00.790770] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-03T17:18:01.590715] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-03T17:18:01.899598] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:18:02.064137] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T17:18:02.390745] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-03T17:18:02.455552] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T17:18:03.190713] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-03T17:18:03.524966] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:18:03.990771] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-03T17:18:04.790739] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-03T17:18:05.089290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:18:05.118765] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:18:05.590750] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-03T17:18:06.390729] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-03T17:18:06.899778] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T17:18:07.146932] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:18:07.190732] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-03T17:18:07.711156] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:18:07.990738] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-03T17:18:08.200830] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:18:08.790703] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-03T17:18:09.590684] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-03T17:18:09.830937] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T17:18:10.077080] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T17:18:10.390633] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-03T17:18:10.843628] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T17:18:11.190697] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-03T17:18:11.990685] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-03T17:18:12.095595] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T17:18:12.100073] [INFO ] [REMOTE ] AR: Full fetch complete (77541 records). [2025-10-03T17:18:12.100198] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-03T17:18:12.542503] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-03T17:18:12.542620] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-03T17:18:12.543729] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-03T17:18:12.543867] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-03T17:18:12.560482] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:18:12.568039] [DEBUG] [LOCAL ] AR: Trimmed 77541 records to 54363 (keeping 200 days of data) [2025-10-03T17:18:12.790780] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-03T17:18:12.907406] [DEBUG] [LOCAL ] AR: Primary data saved (54363 records). [2025-10-03T17:18:12.907585] [INFO ] [MAIN ] AR: Full history saved. [2025-10-03T17:18:12.907755] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 38.4s. Estimated remaining: 4h 53m 23s. Rate: 7.6 symbols/min [2025-10-03T17:18:13.039974] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:18:13.116407] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:13.166818] [DEBUG] [LOCAL ] ARE: Loaded 51001 existing records from primary storage. [2025-10-03T17:18:13.167169] [INFO ] [MAIN ] ARE: Loaded 51001 existing records. [2025-10-03T17:18:13.354763] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:13.354998] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-03T17:18:13.355069] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-03T17:18:13.355327] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-03T17:18:13.355389] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-03T17:18:13.597154] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-03T17:18:13.734834] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:13.833597] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:18:13.835539] [INFO ] [REMOTE ] ARDT: Full fetch complete (41396 records). [2025-10-03T17:18:13.835632] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-03T17:18:14.241673] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-03T17:18:14.241769] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-03T17:18:14.242329] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-03T17:18:14.242393] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-03T17:18:14.243515] [DEBUG] [LOCAL ] ARDT: Trimmed 41396 records to 28156 (keeping 200 days of data) [2025-10-03T17:18:14.393827] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-03T17:18:14.429078] [DEBUG] [LOCAL ] ARDT: Primary data saved (28156 records). [2025-10-03T17:18:14.429215] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-03T17:18:14.429307] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDT took 27.3s. Estimated remaining: 4h 51m 33s. Rate: 7.7 symbols/min [2025-10-03T17:18:14.642879] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:14.654603] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:18:14.715787] [DEBUG] [LOCAL ] ARES: Loaded 49934 existing records from primary storage. [2025-10-03T17:18:14.716204] [INFO ] [MAIN ] ARES: Loaded 49934 existing records. [2025-10-03T17:18:14.912612] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:14.912921] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-03T17:18:14.912997] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-03T17:18:14.913253] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-03T17:18:14.913315] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-03T17:18:15.195799] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-03T17:18:15.318192] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:15.990667] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-03T17:18:16.164946] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T17:18:16.743220] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:18:16.790690] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-03T17:18:16.851199] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:18:16.852557] [INFO ] [REMOTE ] ARDC: Full fetch complete (20806 records). [2025-10-03T17:18:16.852661] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-03T17:18:17.263209] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-03T17:18:17.263288] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-03T17:18:17.263594] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-03T17:18:17.263635] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-03T17:18:17.264259] [DEBUG] [LOCAL ] ARDC: Trimmed 20806 records to 15051 (keeping 200 days of data) [2025-10-03T17:18:17.368602] [DEBUG] [LOCAL ] ARDC: Primary data saved (15051 records). [2025-10-03T17:18:17.368958] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-03T17:18:17.369078] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARDC took 32.2s. Estimated remaining: 4h 50m 7s. Rate: 7.7 symbols/min [2025-10-03T17:18:17.561675] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:17.590736] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-03T17:18:17.609521] [DEBUG] [LOCAL ] ARI: Loaded 43834 existing records from primary storage. [2025-10-03T17:18:17.609887] [INFO ] [MAIN ] ARI: Loaded 43834 existing records. [2025-10-03T17:18:17.810856] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:17.811104] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-03T17:18:17.811164] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-03T17:18:17.811490] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-03T17:18:17.811553] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-03T17:18:18.225824] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:18.390724] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-03T17:18:18.481414] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:18:19.190693] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-03T17:18:19.404231] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:18:19.990737] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-03T17:18:20.216913] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:18:20.790754] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-03T17:18:20.830217] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:18:21.595851] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-03T17:18:21.599275] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:18:22.390683] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-03T17:18:22.500872] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:18:23.173370] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:18:23.190608] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-03T17:18:23.845200] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:18:23.990693] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-03T17:18:24.445720] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:18:24.448414] [INFO ] [REMOTE ] ARCO: Full fetch complete (65379 records). [2025-10-03T17:18:24.448770] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-03T17:18:24.795769] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-03T17:18:24.884248] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-03T17:18:24.884345] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-03T17:18:24.885076] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-03T17:18:24.885149] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-03T17:18:24.886616] [DEBUG] [LOCAL ] ARCO: Trimmed 65379 records to 44983 (keeping 200 days of data) [2025-10-03T17:18:25.165096] [DEBUG] [LOCAL ] ARCO: Primary data saved (44983 records). [2025-10-03T17:18:25.165243] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-03T17:18:25.165905] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARCO took 44.5s. Estimated remaining: 4h 49m 59s. Rate: 7.7 symbols/min [2025-10-03T17:18:25.395945] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:25.396274] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-10-03T17:18:25.396351] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-10-03T17:18:25.396742] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-03T17:18:25.396848] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-03T17:18:25.397035] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-03T17:18:25.397094] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-03T17:18:25.592248] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-03T17:18:25.655708] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T17:18:25.829460] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:26.390910] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-03T17:18:26.593725] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:18:27.190633] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-03T17:18:27.298466] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:18:27.753940] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:18:27.990710] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-03T17:18:28.790707] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-03T17:18:29.228718] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:18:29.285679] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:18:29.590692] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-03T17:18:30.204586] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:18:30.390733] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-03T17:18:31.190639] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-03T17:18:31.668932] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T17:18:31.763100] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:18:31.990700] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-03T17:18:32.790706] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-03T17:18:32.833439] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:18:33.590696] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-03T17:18:33.855180] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T17:18:34.392527] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-03T17:18:34.395278] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:18:35.190745] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-03T17:18:35.431396] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T17:18:35.988562] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:18:35.991996] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-03T17:18:36.790671] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-03T17:18:36.880305] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T17:18:37.590744] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-03T17:18:37.846099] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T17:18:38.390744] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-03T17:18:38.510105] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:18:39.190742] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-03T17:18:39.456272] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:18:39.990623] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-03T17:18:40.269062] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:18:40.790691] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-03T17:18:40.881909] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:18:41.590677] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-03T17:18:41.734751] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:18:42.390731] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-03T17:18:42.461585] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:18:43.143317] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:18:43.190700] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-03T17:18:43.886613] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:18:43.990720] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-03T17:18:44.421690] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:18:44.424394] [INFO ] [REMOTE ] ARE: Full fetch complete (72649 records). [2025-10-03T17:18:44.424520] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-03T17:18:44.797229] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-03T17:18:44.861749] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-03T17:18:44.861842] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-03T17:18:44.862666] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-03T17:18:44.862750] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-03T17:18:44.864339] [DEBUG] [LOCAL ] ARE: Trimmed 72649 records to 51371 (keeping 200 days of data) [2025-10-03T17:18:45.197179] [DEBUG] [LOCAL ] ARE: Primary data saved (51371 records). [2025-10-03T17:18:45.197355] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-03T17:18:45.197479] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 32.3s. Estimated remaining: 4h 53m 3s. Rate: 7.6 symbols/min [2025-10-03T17:18:45.394934] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:45.439749] [DEBUG] [LOCAL ] ARLO: Loaded 44159 existing records from primary storage. [2025-10-03T17:18:45.440103] [INFO ] [MAIN ] ARLO: Loaded 44159 existing records. [2025-10-03T17:18:45.616521] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-03T17:18:45.675894] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:45.680829] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-03T17:18:45.680943] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-03T17:18:45.681372] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-03T17:18:45.684693] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:18:45.684909] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-03T17:18:46.092749] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:46.390711] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-03T17:18:46.475440] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:18:47.195891] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-03T17:18:47.203826] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:18:47.871285] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:18:47.990697] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-03T17:18:48.775307] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:18:48.790703] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-03T17:18:49.145729] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:18:49.148301] [INFO ] [REMOTE ] ARI: Full fetch complete (62849 records). [2025-10-03T17:18:49.148475] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-03T17:18:49.573433] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-03T17:18:49.573524] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-03T17:18:49.574207] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-03T17:18:49.574275] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-03T17:18:49.575787] [DEBUG] [LOCAL ] ARI: Trimmed 62849 records to 44168 (keeping 200 days of data) [2025-10-03T17:18:49.635733] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-03T17:18:49.864422] [DEBUG] [LOCAL ] ARI: Primary data saved (44168 records). [2025-10-03T17:18:49.864582] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-03T17:18:49.864738] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARI took 32.5s. Estimated remaining: 4h 52m 5s. Rate: 7.6 symbols/min [2025-10-03T17:18:50.049518] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:50.101586] [DEBUG] [LOCAL ] ARMK: Loaded 50699 existing records from primary storage. [2025-10-03T17:18:50.101984] [INFO ] [MAIN ] ARMK: Loaded 50699 existing records. [2025-10-03T17:18:50.295639] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:50.295942] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-03T17:18:50.295991] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-03T17:18:50.296505] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-03T17:18:50.296566] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-03T17:18:50.398494] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-03T17:18:50.657586] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T17:18:50.741309] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:51.190729] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-03T17:18:51.471364] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:18:51.990662] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-03T17:18:52.068264] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:18:52.790729] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-03T17:18:52.950679] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T17:18:53.254165] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:18:53.590718] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-03T17:18:53.901795] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:18:54.390736] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-03T17:18:55.190697] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-03T17:18:55.335384] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:18:55.856399] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:18:55.990726] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-03T17:18:56.361850] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:18:56.790701] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-03T17:18:57.524095] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:18:57.526791] [INFO ] [REMOTE ] ARES: Full fetch complete (70800 records). [2025-10-03T17:18:57.526902] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-03T17:18:57.601427] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-03T17:18:57.968973] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-03T17:18:57.969090] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-03T17:18:57.969993] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-03T17:18:57.970174] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-03T17:18:57.973001] [DEBUG] [LOCAL ] ARES: Trimmed 70800 records to 50322 (keeping 200 days of data) [2025-10-03T17:18:58.228467] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:18:58.341483] [DEBUG] [LOCAL ] ARES: Primary data saved (50322 records). [2025-10-03T17:18:58.341660] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-03T17:18:58.342712] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARES took 43.9s. Estimated remaining: 4h 52m 7s. Rate: 7.6 symbols/min [2025-10-03T17:18:58.401199] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-03T17:18:58.533277] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:58.590492] [DEBUG] [LOCAL ] AROC: Loaded 49327 existing records from primary storage. [2025-10-03T17:18:58.590890] [INFO ] [MAIN ] AROC: Loaded 49327 existing records. [2025-10-03T17:18:58.796234] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:18:58.796466] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-03T17:18:58.796516] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-03T17:18:58.797437] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-03T17:18:58.797508] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-03T17:18:59.185210] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:18:59.190613] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-03T17:18:59.327934] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:18:59.738749] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:18:59.741127] [INFO ] [REMOTE ] ARIS: Full fetch complete (60359 records). [2025-10-03T17:18:59.741239] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-03T17:18:59.742069] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:18:59.742178] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:18:59.742259] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:18:59.742380] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-03T17:18:59.742480] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-03T17:18:59.742531] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-10-03T17:18:59.742577] [DEBUG] [LOCAL ] ARIS: No derivative data file found to delete. [2025-10-03T17:18:59.742693] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARIS took 34.6s. Estimated remaining: 4h 50m 19s. Rate: 7.7 symbols/min [2025-10-03T17:18:59.927416] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:18:59.990876] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-03T17:18:59.995811] [DEBUG] [LOCAL ] ARR: Loaded 52419 existing records from primary storage. [2025-10-03T17:18:59.996315] [INFO ] [MAIN ] ARR: Loaded 52419 existing records. [2025-10-03T17:19:00.200992] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:00.201278] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-03T17:19:00.201341] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-03T17:19:00.201816] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-10-03T17:19:00.201878] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-03T17:19:00.577156] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:00.790679] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-03T17:19:01.040831] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:19:01.590733] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-03T17:19:01.898367] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:19:02.390639] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-03T17:19:02.567721] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:19:03.190713] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-03T17:19:03.422389] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T17:19:03.632317] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T17:19:03.990734] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-03T17:19:04.790724] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-03T17:19:04.996002] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T17:19:05.595839] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-03T17:19:05.620240] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T17:19:06.390731] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-03T17:19:06.695282] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:19:07.043683] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:19:07.190713] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-03T17:19:07.684125] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:19:07.990723] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-03T17:19:08.790720] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-03T17:19:09.099664] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:19:09.498632] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T17:19:09.590681] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-03T17:19:10.390676] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-03T17:19:10.452727] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:19:11.180352] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:19:11.190631] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-03T17:19:11.990699] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-03T17:19:12.034109] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:19:12.790696] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-03T17:19:13.087741] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T17:19:13.590680] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-03T17:19:13.718756] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:19:14.390677] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-03T17:19:14.813893] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T17:19:14.897922] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:19:15.190719] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-03T17:19:15.990716] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-03T17:19:16.326106] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T17:19:16.790743] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-03T17:19:16.990156] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:19:17.534887] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:19:17.590919] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-03T17:19:18.390690] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-03T17:19:18.601819] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T17:19:19.042015] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:19:19.044402] [INFO ] [REMOTE ] ARLO: Full fetch complete (62888 records). [2025-10-03T17:19:19.044509] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-03T17:19:19.198158] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-03T17:19:19.461820] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-03T17:19:19.461929] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-03T17:19:19.462632] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-03T17:19:19.462731] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-03T17:19:19.464254] [DEBUG] [LOCAL ] ARLO: Trimmed 62888 records to 44465 (keeping 200 days of data) [2025-10-03T17:19:19.736328] [DEBUG] [LOCAL ] ARLO: Primary data saved (44465 records). [2025-10-03T17:19:19.736456] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-03T17:19:19.736557] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARLO took 34.5s. Estimated remaining: 4h 53m 17s. Rate: 7.6 symbols/min [2025-10-03T17:19:19.938330] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:19.974365] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T17:19:19.991713] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-03T17:19:20.033557] [DEBUG] [LOCAL ] ARW: Loaded 33339 existing records from primary storage. [2025-10-03T17:19:20.033954] [INFO ] [MAIN ] ARW: Loaded 33339 existing records. [2025-10-03T17:19:20.227711] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:20.227955] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-03T17:19:20.228065] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-03T17:19:20.228865] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-03T17:19:20.228930] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-03T17:19:20.619608] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:20.790695] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-03T17:19:21.000214] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T17:19:21.360092] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T17:19:21.590747] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-03T17:19:21.751096] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T17:19:22.390694] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-03T17:19:23.172892] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:19:23.190620] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-03T17:19:23.854755] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:19:23.990698] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-03T17:19:24.790670] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-03T17:19:24.830441] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:19:25.590725] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-03T17:19:26.008611] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:19:26.042806] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:19:26.390720] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-03T17:19:26.930780] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T17:19:27.190698] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-03T17:19:27.990723] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-03T17:19:28.421756] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:19:28.532954] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:19:28.535603] [INFO ] [REMOTE ] AROC: Full fetch complete (70890 records). [2025-10-03T17:19:28.535795] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-03T17:19:28.797544] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-03T17:19:28.987776] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-03T17:19:28.987913] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-03T17:19:28.989152] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-03T17:19:28.989387] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-03T17:19:29.012006] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T17:19:29.020539] [DEBUG] [LOCAL ] AROC: Trimmed 70890 records to 49675 (keeping 200 days of data) [2025-10-03T17:19:29.335106] [DEBUG] [LOCAL ] AROC: Primary data saved (49675 records). [2025-10-03T17:19:29.335261] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-03T17:19:29.336371] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. AROC took 31.0s. Estimated remaining: 4h 53m 34s. Rate: 7.6 symbols/min [2025-10-03T17:19:29.529403] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:29.529602] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-03T17:19:29.529664] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-03T17:19:29.529814] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-03T17:19:29.529862] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-03T17:19:29.529906] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-03T17:19:29.529940] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-03T17:19:29.599404] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-03T17:19:29.927482] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:30.390719] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-03T17:19:30.577446] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:19:30.577790] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-03T17:19:30.577912] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:19:30.578052] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-03T17:19:30.578140] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:19:30.578245] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-03T17:19:30.578346] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-03T17:19:30.578403] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-03T17:19:30.578465] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-03T17:19:30.578534] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. ARX took 1.2s. Estimated remaining: 4h 51m 46s. Rate: 7.6 symbols/min [2025-10-03T17:19:30.707957] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T17:19:30.749088] [INFO ] [REMOTE ] ARMK: Full fetch complete (72605 records). [2025-10-03T17:19:30.786369] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:30.784854] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-03T17:19:31.194141] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-03T17:19:31.221934] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:19:31.177145] [DEBUG] [LOCAL ] AS: Loaded 53472 existing records from primary storage. [2025-10-03T17:19:31.291272] [INFO ] [MAIN ] AS: Loaded 53472 existing records. [2025-10-03T17:19:31.328441] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-03T17:19:31.364676] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-03T17:19:31.377865] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-03T17:19:31.404036] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-03T17:19:31.495892] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:31.489817] [DEBUG] [LOCAL ] ARMK: Trimmed 72605 records to 51071 (keeping 200 days of data) [2025-10-03T17:19:31.496194] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-03T17:19:31.496466] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-03T17:19:31.497711] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-03T17:19:31.497781] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-03T17:19:32.033105] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-03T17:19:32.131462] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:32.237794] [DEBUG] [LOCAL ] ARMK: Primary data saved (51071 records). [2025-10-03T17:19:32.237989] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-03T17:19:32.238135] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARMK took 42.4s. Estimated remaining: 4h 50m 6s. Rate: 7.7 symbols/min [2025-10-03T17:19:32.432160] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:32.452186] [DEBUG] [LOCAL ] ASA: Loaded 14321 existing records from primary storage. [2025-10-03T17:19:32.452529] [INFO ] [MAIN ] ASA: Loaded 14321 existing records. [2025-10-03T17:19:32.657071] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:32.657320] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-03T17:19:32.657371] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-03T17:19:32.657840] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-03T17:19:32.657903] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-03T17:19:32.795932] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-03T17:19:33.041308] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:33.267367] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:19:33.590711] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-03T17:19:33.826347] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:19:34.390704] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-03T17:19:34.767220] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T17:19:35.190684] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-03T17:19:35.266930] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:19:35.270870] [INFO ] [REMOTE ] ARR: Full fetch complete (75248 records). [2025-10-03T17:19:35.271061] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-03T17:19:35.726941] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-03T17:19:35.727103] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-03T17:19:35.727951] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-03T17:19:35.728058] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-03T17:19:35.729621] [DEBUG] [LOCAL ] ARR: Trimmed 75248 records to 52803 (keeping 200 days of data) [2025-10-03T17:19:35.865202] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:19:35.993013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-03T17:19:36.113506] [DEBUG] [LOCAL ] ARR: Primary data saved (52803 records). [2025-10-03T17:19:36.113708] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-03T17:19:36.114526] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. ARR took 36.4s. Estimated remaining: 4h 48m 59s. Rate: 7.7 symbols/min [2025-10-03T17:19:36.306507] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:36.369502] [DEBUG] [LOCAL ] ASAN: Loaded 53110 existing records from primary storage. [2025-10-03T17:19:36.369891] [INFO ] [MAIN ] ASAN: Loaded 53110 existing records. [2025-10-03T17:19:36.555705] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:36.555939] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-03T17:19:36.555989] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-03T17:19:36.557187] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-03T17:19:36.557253] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-03T17:19:36.795885] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-03T17:19:37.015050] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:37.104354] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T17:19:37.440498] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T17:19:37.590695] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-03T17:19:38.390730] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-03T17:19:39.190714] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-03T17:19:39.863578] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (3.07 seconds). [2025-10-03T17:19:39.990693] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-03T17:19:40.044257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T17:19:40.790765] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-03T17:19:41.106279] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (3.52 seconds). [2025-10-03T17:19:41.188634] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:19:41.268100] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T17:19:41.354246] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T17:19:41.590688] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-03T17:19:42.390686] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-03T17:19:42.430221] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T17:19:43.190691] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-03T17:19:43.845074] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T17:19:43.990677] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-03T17:19:44.790699] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-03T17:19:44.958385] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T17:19:45.319867] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:19:45.590714] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-03T17:19:45.851444] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:19:46.390691] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-03T17:19:46.788285] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:19:46.790260] [INFO ] [REMOTE ] ARW: Full fetch complete (48015 records). [2025-10-03T17:19:46.790355] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-03T17:19:47.192447] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-03T17:19:47.209830] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-03T17:19:47.209892] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-03T17:19:47.210461] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-03T17:19:47.210509] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-03T17:19:47.211618] [DEBUG] [LOCAL ] ARW: Trimmed 48015 records to 33549 (keeping 200 days of data) [2025-10-03T17:19:47.408352] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:19:47.432356] [DEBUG] [LOCAL ] ARW: Primary data saved (33549 records). [2025-10-03T17:19:47.432514] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-03T17:19:47.432629] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARW took 27.7s. Estimated remaining: 4h 49m 43s. Rate: 7.7 symbols/min [2025-10-03T17:19:47.617055] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:19:47.666533] [DEBUG] [LOCAL ] ASB: Loaded 49883 existing records from primary storage. [2025-10-03T17:19:47.666891] [INFO ] [MAIN ] ASB: Loaded 49883 existing records. [2025-10-03T17:19:47.858170] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:19:47.858431] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-03T17:19:47.858507] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-03T17:19:47.859851] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-03T17:19:47.859920] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-03T17:19:47.995723] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-03T17:19:48.248500] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:19:48.790701] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-03T17:19:49.590742] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-03T17:19:50.036335] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-10-03T17:19:50.060257] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T17:19:50.390693] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-03T17:19:51.026234] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T17:19:51.190709] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-03T17:19:51.990713] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-03T17:19:52.091898] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-03T17:19:52.092219] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:19:52.189459] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:19:52.790730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-03T17:19:53.590698] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-03T17:19:53.729471] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T17:19:54.390621] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-03T17:19:54.441168] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:19:54.594727] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:19:55.190730] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-03T17:19:55.939214] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:19:55.990726] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-03T17:19:56.790730] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-03T17:19:57.018024] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:19:57.590702] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-03T17:19:57.745239] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:19:58.390698] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-03T17:19:58.549861] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:19:58.727410] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:19:59.190717] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-03T17:19:59.990707] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-03T17:20:00.387557] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:20:00.389027] [INFO ] [REMOTE ] ASA: Full fetch complete (19021 records). [2025-10-03T17:20:00.389150] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-03T17:20:00.803731] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-03T17:20:00.816182] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-03T17:20:00.817385] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-03T17:20:00.817824] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-03T17:20:00.817921] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-03T17:20:00.819213] [DEBUG] [LOCAL ] ASA: Trimmed 19021 records to 14433 (keeping 200 days of data) [2025-10-03T17:20:00.915621] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-10-03T17:20:00.951482] [DEBUG] [LOCAL ] ASA: Primary data saved (14433 records). [2025-10-03T17:20:00.951676] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-03T17:20:00.951785] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ASA took 28.7s. Estimated remaining: 4h 50m 58s. Rate: 7.6 symbols/min [2025-10-03T17:20:01.145069] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:01.151202] [DEBUG] [LOCAL ] ASBA: Loaded 3476 existing records from primary storage. [2025-10-03T17:20:01.151441] [INFO ] [MAIN ] ASBA: Loaded 3476 existing records. [2025-10-03T17:20:01.382331] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:01.382616] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-03T17:20:01.382732] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-03T17:20:01.383024] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-03T17:20:01.383108] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-03T17:20:01.590903] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-03T17:20:01.824580] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:01.864197] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T17:20:02.390626] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-03T17:20:02.496345] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:20:03.190734] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-03T17:20:03.630766] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T17:20:03.944749] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:20:03.990709] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-03T17:20:04.722508] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:20:04.790705] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-03T17:20:04.931998] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:20:05.590697] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-03T17:20:06.238994] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:20:06.390628] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-03T17:20:06.593384] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:20:07.190694] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-03T17:20:07.779116] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:20:07.990688] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-03T17:20:08.051536] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T17:20:08.790709] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-03T17:20:09.358849] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:20:09.590745] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-03T17:20:09.839887] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T17:20:10.390705] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-03T17:20:11.190670] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-03T17:20:11.313785] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:20:11.990707] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-03T17:20:12.033272] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:20:12.038188] [INFO ] [REMOTE ] AS: Full fetch complete (76550 records). [2025-10-03T17:20:12.038435] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-03T17:20:12.502850] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-03T17:20:12.502956] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-03T17:20:12.503851] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-03T17:20:12.503927] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-03T17:20:12.505731] [DEBUG] [LOCAL ] AS: Trimmed 76550 records to 53862 (keeping 200 days of data) [2025-10-03T17:20:12.808054] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-03T17:20:12.860596] [DEBUG] [LOCAL ] AS: Primary data saved (53862 records). [2025-10-03T17:20:12.860748] [INFO ] [MAIN ] AS: Full history saved. [2025-10-03T17:20:12.860839] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. AS took 42.3s. Estimated remaining: 4h 51m 49s. Rate: 7.6 symbols/min [2025-10-03T17:20:13.059990] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:13.098571] [DEBUG] [LOCAL ] ASC: Loaded 37698 existing records from primary storage. [2025-10-03T17:20:13.099123] [INFO ] [MAIN ] ASC: Loaded 37698 existing records. [2025-10-03T17:20:13.298132] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:13.299052] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-03T17:20:13.299147] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-03T17:20:13.320527] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-03T17:20:13.326041] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-03T17:20:13.388877] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T17:20:13.442394] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T17:20:13.595779] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-03T17:20:13.734741] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:20:13.859614] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:14.143599] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T17:20:14.390732] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-03T17:20:15.190702] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-03T17:20:15.990675] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-03T17:20:16.238624] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:20:16.790633] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-03T17:20:17.215903] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:20:17.452941] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T17:20:17.594264] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-03T17:20:17.600668] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T17:20:18.390745] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-03T17:20:19.137280] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:20:19.190711] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-03T17:20:19.995782] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-03T17:20:20.019426] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:20:20.769276] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T17:20:20.771953] [INFO ] [REMOTE ] ASB: Full fetch complete (71693 records). [2025-10-03T17:20:20.772259] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-03T17:20:20.795767] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-03T17:20:21.207563] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-03T17:20:21.207810] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-03T17:20:21.208786] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-03T17:20:21.208993] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-03T17:20:21.210606] [DEBUG] [LOCAL ] ASB: Trimmed 71693 records to 50265 (keeping 200 days of data) [2025-10-03T17:20:21.468190] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T17:20:21.529728] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:20:21.577012] [DEBUG] [LOCAL ] ASB: Primary data saved (50265 records). [2025-10-03T17:20:21.577167] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-03T17:20:21.577256] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. ASB took 34.1s. Estimated remaining: 4h 51m 53s. Rate: 7.6 symbols/min [2025-10-03T17:20:21.599939] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-03T17:20:21.786864] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:21.808475] [DEBUG] [LOCAL ] ASG: Loaded 19972 existing records from primary storage. [2025-10-03T17:20:21.808908] [INFO ] [MAIN ] ASG: Loaded 19972 existing records. [2025-10-03T17:20:22.003000] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:22.003303] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-03T17:20:22.003379] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-03T17:20:22.004095] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-03T17:20:22.004157] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-03T17:20:22.322285] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:20:22.401352] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-03T17:20:22.407186] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:22.879608] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T17:20:23.190724] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-03T17:20:23.776599] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T17:20:23.777380] [INFO ] [REMOTE ] ASBA: Full fetch complete (5241 records). [2025-10-03T17:20:23.777471] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-03T17:20:23.995864] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-03T17:20:24.179850] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-03T17:20:24.180003] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-03T17:20:24.180215] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-03T17:20:24.180280] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-03T17:20:24.180699] [DEBUG] [LOCAL ] ASBA: Trimmed 5241 records to 3492 (keeping 200 days of data) [2025-10-03T17:20:24.204274] [DEBUG] [LOCAL ] ASBA: Primary data saved (3492 records). [2025-10-03T17:20:24.204377] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-03T17:20:24.204479] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 23.3s. Estimated remaining: 4h 50m 29s. Rate: 7.6 symbols/min [2025-10-03T17:20:24.387468] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:24.413716] [DEBUG] [LOCAL ] ASGI: Loaded 22922 existing records from primary storage. [2025-10-03T17:20:24.414003] [INFO ] [MAIN ] ASGI: Loaded 22922 existing records. [2025-10-03T17:20:24.603210] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:20:24.603471] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-03T17:20:24.603521] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-03T17:20:24.604158] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-03T17:20:24.604222] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-03T17:20:24.792689] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-03T17:20:24.994271] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:25.590713] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-03T17:20:25.865164] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-03T17:20:25.868191] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-03T17:20:25.868344] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-03T17:20:26.313102] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-03T17:20:26.313454] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-03T17:20:26.314410] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-03T17:20:26.314493] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-03T17:20:26.316342] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 53500 (keeping 200 days of data) [2025-10-03T17:20:26.405914] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-03T17:20:26.580879] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T17:20:26.612963] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:20:26.732096] [DEBUG] [LOCAL ] ASAN: Primary data saved (53500 records). [2025-10-03T17:20:26.732253] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-03T17:20:26.733069] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASAN took 50.6s. Estimated remaining: 4h 49m 6s. Rate: 7.7 symbols/min [2025-10-03T17:20:26.925028] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:26.925241] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-10-03T17:20:26.925298] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-10-03T17:20:26.925419] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-03T17:20:26.925485] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-03T17:20:26.925552] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-03T17:20:26.925593] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-03T17:20:27.200408] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-03T17:20:27.341422] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:20:27.727109] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:20:27.990716] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-03T17:20:28.680304] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:20:28.790745] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-03T17:20:29.084320] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:20:29.590736] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-03T17:20:30.090834] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T17:20:30.390698] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-03T17:20:30.682904] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T17:20:31.190726] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-03T17:20:31.886834] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:20:31.990707] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-03T17:20:32.185776] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T17:20:32.790691] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-03T17:20:33.445266] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:20:33.590702] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-03T17:20:33.842429] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:20:34.390692] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-03T17:20:35.154623] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:20:35.190711] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-03T17:20:35.465434] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:20:35.990738] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-03T17:20:36.729211] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:20:36.790693] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-03T17:20:37.224232] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:20:37.590691] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-03T17:20:37.990070] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:20:38.390691] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-03T17:20:38.818189] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:20:39.190693] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-03T17:20:39.291197] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-03T17:20:39.990672] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-03T17:20:40.218510] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:20:40.790632] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-03T17:20:41.095871] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:20:41.590693] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-03T17:20:42.390690] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-03T17:20:42.504155] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:20:42.723169] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:20:43.190695] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-03T17:20:43.867217] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:20:43.990687] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-03T17:20:44.257695] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:20:44.790700] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-03T17:20:45.185270] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T17:20:45.590638] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-03T17:20:45.899637] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:20:46.390720] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-03T17:20:46.594679] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T17:20:47.190704] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-03T17:20:47.990715] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-03T17:20:48.101883] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:20:48.185068] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T17:20:48.790699] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-03T17:20:49.019491] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:20:49.590702] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-03T17:20:50.005887] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:20:50.390728] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-03T17:20:50.976101] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:20:51.190721] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-03T17:20:51.456415] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:20:51.990692] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-03T17:20:52.040697] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:20:52.042100] [INFO ] [REMOTE ] ASG: Full fetch complete (31252 records). [2025-10-03T17:20:52.042190] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-03T17:20:52.471964] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-03T17:20:52.472060] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-03T17:20:52.472591] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-03T17:20:52.472707] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-03T17:20:52.473767] [DEBUG] [LOCAL ] ASG: Trimmed 31252 records to 20131 (keeping 200 days of data) [2025-10-03T17:20:52.604010] [DEBUG] [LOCAL ] ASG: Primary data saved (20131 records). [2025-10-03T17:20:52.604158] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-03T17:20:52.604279] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASG took 31.0s. Estimated remaining: 4h 53m 12s. Rate: 7.5 symbols/min [2025-10-03T17:20:52.790726] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-03T17:20:53.231928] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:20:53.234118] [INFO ] [REMOTE ] ASC: Full fetch complete (56600 records). [2025-10-03T17:20:53.234461] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-03T17:20:53.595832] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-03T17:20:53.686095] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-03T17:20:53.686181] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-03T17:20:53.686825] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-03T17:20:53.686893] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-03T17:20:53.690266] [DEBUG] [LOCAL ] ASC: Trimmed 56600 records to 37981 (keeping 200 days of data) [2025-10-03T17:20:53.933554] [DEBUG] [LOCAL ] ASC: Primary data saved (37981 records). [2025-10-03T17:20:53.933743] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-03T17:20:53.934480] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 41.1s. Estimated remaining: 4h 51m 31s. Rate: 7.6 symbols/min [2025-10-03T17:20:54.339624] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:20:54.390739] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-03T17:20:54.724301] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:20:55.190747] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-03T17:20:55.626606] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T17:20:55.990679] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-03T17:20:56.206764] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T17:20:56.209175] [INFO ] [REMOTE ] ASGI: Full fetch complete (33645 records). [2025-10-03T17:20:56.209305] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-03T17:20:56.628297] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-03T17:20:56.628386] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-03T17:20:56.628834] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-03T17:20:56.628899] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-03T17:20:56.629850] [DEBUG] [LOCAL ] ASGI: Trimmed 33645 records to 23076 (keeping 200 days of data) [2025-10-03T17:20:56.774106] [DEBUG] [LOCAL ] ASGI: Primary data saved (23076 records). [2025-10-03T17:20:56.774237] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-03T17:20:56.774322] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASGI took 32.6s. Estimated remaining: 4h 50m 13s. Rate: 7.6 symbols/min [2025-10-03T17:20:57.307382] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:20:57.317567] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-03T17:20:58.462345] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:20:58.464855] [INFO ] [REMOTE ] ASGN: Full fetch complete (52466 records). [2025-10-03T17:20:58.464998] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-03T17:20:58.910092] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-03T17:20:58.910179] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-03T17:20:58.910837] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-03T17:20:58.910914] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-03T17:20:58.912223] [DEBUG] [LOCAL ] ASGN: Trimmed 52466 records to 36722 (keeping 200 days of data) [2025-10-03T17:20:59.138900] [DEBUG] [LOCAL ] ASGN: Primary data saved (36722 records). [2025-10-03T17:20:59.139053] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-03T17:20:59.139153] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGN took 32.4s. Estimated remaining: 4h 48m 49s. Rate: 7.7 symbols/min [2025-10-03T17:20:59.837343] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.891568] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.935229] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.937396] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:20:59.948898] [DEBUG] [LOCAL ] ASR: Loaded 9377 existing records from primary storage. [2025-10-03T17:20:59.949305] [INFO ] [MAIN ] ASR: Loaded 9377 existing records. [2025-10-03T17:21:00.078489] [DEBUG] [LOCAL ] ASIX: Loaded 22820 existing records from primary storage. [2025-10-03T17:21:00.095426] [INFO ] [MAIN ] ASIX: Loaded 22820 existing records. [2025-10-03T17:21:00.172554] [DEBUG] [LOCAL ] ASH: Loaded 38041 existing records from primary storage. [2025-10-03T17:21:00.214557] [INFO ] [MAIN ] ASH: Loaded 38041 existing records. [2025-10-03T17:21:00.358739] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:00.423519] [DEBUG] [LOCAL ] ASPN: Loaded 49942 existing records from primary storage. [2025-10-03T17:21:00.401528] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-03T17:21:00.474362] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-03T17:21:00.469878] [INFO ] [MAIN ] ASPN: Loaded 49942 existing records. [2025-10-03T17:21:00.527662] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-03T17:21:00.565220] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-03T17:21:00.583496] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:00.732899] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-03T17:21:00.764338] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-03T17:21:00.859287] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-03T17:21:00.880051] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-03T17:21:00.901515] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:01.027777] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-03T17:21:01.102713] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-03T17:21:01.200741] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:01.219608] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-03T17:21:01.219990] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-03T17:21:01.219890] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-03T17:21:01.263832] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-03T17:21:01.269146] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-03T17:21:01.302702] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-03T17:21:02.437400] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.525477] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-03T17:21:02.656058] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.738468] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-03T17:21:02.959097] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.980408] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-03T17:21:02.980137] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:02.980718] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-03T17:21:03.547740] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:21:03.550332] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-03T17:21:03.883684] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T17:21:03.887736] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-03T17:21:04.028809] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:21:04.031035] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-03T17:21:04.121612] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:21:04.129787] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-03T17:21:04.526095] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:21:04.537599] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-03T17:21:04.584397] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T17:21:04.763235] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T17:21:04.790711] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-03T17:21:05.211360] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:21:05.436796] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:21:05.590724] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-03T17:21:05.960370] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T17:21:06.390716] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-03T17:21:06.577178] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T17:21:07.190729] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-03T17:21:07.990714] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-03T17:21:08.216923] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:21:08.522312] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:21:08.716876] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:21:08.790731] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-03T17:21:09.590713] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-03T17:21:10.335737] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:21:10.390723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-03T17:21:10.656828] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:21:10.943611] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:21:11.190740] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-03T17:21:11.990735] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-03T17:21:12.324500] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:21:12.759941] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T17:21:12.790696] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-03T17:21:13.590673] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-03T17:21:13.723424] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T17:21:14.390694] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-03T17:21:15.190637] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-03T17:21:15.441202] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:21:15.488796] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:21:15.990708] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-03T17:21:16.096240] [DEBUG] [REMOTE ] ASIX: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T17:21:16.096545] [WARN ] [REMOTE ] ASIX: No data returned for month 2025-07 [2025-10-03T17:21:16.096691] [FATAL] [REMOTE ] ASIX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:21:16.096833] [FATAL] [MAIN ] ASIX: Failed to fetch primary data. [2025-10-03T17:21:16.096925] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:21:16.097022] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-03T17:21:16.097110] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-10-03T17:21:16.097152] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-10-03T17:21:16.097507] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-10-03T17:21:16.097598] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASIX took 17.0s. Estimated remaining: 4h 50m 46s. Rate: 7.6 symbols/min [2025-10-03T17:21:16.279190] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:16.279363] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-10-03T17:21:16.279403] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-10-03T17:21:16.279522] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-03T17:21:16.279566] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-03T17:21:16.279609] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-03T17:21:16.279666] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-03T17:21:16.679042] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:16.790762] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-03T17:21:16.836768] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T17:21:17.590707] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-03T17:21:18.347808] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T17:21:18.390723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-03T17:21:18.596095] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:21:19.165767] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:21:19.190617] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-03T17:21:19.990739] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-03T17:21:20.027555] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T17:21:20.790723] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-03T17:21:21.486719] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:21:21.487699] [INFO ] [REMOTE ] ASR: Full fetch complete (12475 records). [2025-10-03T17:21:21.487800] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-03T17:21:21.595882] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-03T17:21:21.707027] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:21:21.977295] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-03T17:21:21.977376] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-03T17:21:21.977675] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-03T17:21:21.977740] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-03T17:21:21.978287] [DEBUG] [LOCAL ] ASR: Trimmed 12475 records to 9420 (keeping 200 days of data) [2025-10-03T17:21:22.045340] [DEBUG] [LOCAL ] ASR: Primary data saved (9420 records). [2025-10-03T17:21:22.045541] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-03T17:21:22.045679] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASR took 22.9s. Estimated remaining: 4h 50m 12s. Rate: 7.6 symbols/min [2025-10-03T17:21:22.252739] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:22.300431] [DEBUG] [LOCAL ] ATEN: Loaded 39637 existing records from primary storage. [2025-10-03T17:21:22.300903] [INFO ] [MAIN ] ATEN: Loaded 39637 existing records. [2025-10-03T17:21:22.395860] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-03T17:21:22.507989] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:22.508233] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-03T17:21:22.508284] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-03T17:21:22.508715] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-03T17:21:22.508775] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-03T17:21:22.893872] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:23.190714] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-03T17:21:23.625287] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-03T17:21:23.821433] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:21:23.990727] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-03T17:21:24.745940] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:21:24.790686] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-03T17:21:25.590637] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-03T17:21:25.866033] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T17:21:26.255829] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:21:26.390697] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-03T17:21:27.155251] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T17:21:27.190699] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-03T17:21:27.796543] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:21:27.990694] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-03T17:21:28.790687] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-03T17:21:29.034101] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:21:29.590715] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-03T17:21:29.740398] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:21:30.119252] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:21:30.390695] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-03T17:21:30.785745] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:21:31.190702] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-03T17:21:31.746812] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T17:21:31.990708] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-03T17:21:32.790707] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-03T17:21:33.175045] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-03T17:21:33.497092] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:21:33.590725] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-03T17:21:34.072720] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:21:34.075219] [INFO ] [REMOTE ] ASH: Full fetch complete (55144 records). [2025-10-03T17:21:34.075383] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-03T17:21:34.396411] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-03T17:21:34.510705] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-03T17:21:34.510806] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-03T17:21:34.511417] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-03T17:21:34.511467] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-03T17:21:34.512778] [DEBUG] [LOCAL ] ASH: Trimmed 55144 records to 38329 (keeping 200 days of data) [2025-10-03T17:21:34.763888] [DEBUG] [LOCAL ] ASH: Primary data saved (38329 records). [2025-10-03T17:21:34.764073] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-03T17:21:34.764175] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASH took 35.6s. Estimated remaining: 4h 51m 9s. Rate: 7.6 symbols/min [2025-10-03T17:21:34.952745] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:34.987997] [DEBUG] [LOCAL ] ATGE: Loaded 31630 existing records from primary storage. [2025-10-03T17:21:34.988319] [INFO ] [MAIN ] ATGE: Loaded 31630 existing records. [2025-10-03T17:21:35.183260] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:35.183457] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-03T17:21:35.183505] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-03T17:21:35.184086] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-03T17:21:35.184146] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-03T17:21:35.195728] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-03T17:21:35.529770] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:21:35.613307] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:35.990684] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-03T17:21:36.117841] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:21:36.790698] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-03T17:21:37.110330] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T17:21:37.312430] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:21:37.590722] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-03T17:21:38.390696] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-03T17:21:38.708922] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:21:38.768903] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:21:39.190713] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-03T17:21:39.990688] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-03T17:21:40.238797] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T17:21:40.285080] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T17:21:40.790681] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-03T17:21:41.391471] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:21:41.590709] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-03T17:21:42.400185] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-03T17:21:42.425097] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:21:43.031163] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:21:43.190719] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-03T17:21:43.640019] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T17:21:43.990715] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-03T17:21:44.631270] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T17:21:44.790734] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-03T17:21:45.449196] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T17:21:45.590726] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-03T17:21:45.948236] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T17:21:46.390732] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-03T17:21:47.086286] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:21:47.190737] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-03T17:21:47.990746] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-03T17:21:48.511779] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T17:21:48.571997] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:21:48.790719] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-03T17:21:49.590695] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-03T17:21:49.663371] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:21:50.193724] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T17:21:50.196592] [INFO ] [REMOTE ] ASPN: Full fetch complete (72343 records). [2025-10-03T17:21:50.196757] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-03T17:21:50.399523] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-03T17:21:50.644724] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-03T17:21:50.644828] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-03T17:21:50.645637] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-03T17:21:50.645774] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-03T17:21:50.647347] [DEBUG] [LOCAL ] ASPN: Trimmed 72343 records to 50328 (keeping 200 days of data) [2025-10-03T17:21:50.929968] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:21:50.948453] [INFO ] [REMOTE ] ATEN: Full fetch complete (57400 records). [2025-10-03T17:21:50.949475] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-03T17:21:51.199130] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-03T17:21:51.323382] [DEBUG] [LOCAL ] ASPN: Primary data saved (50328 records). [2025-10-03T17:21:51.333881] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-03T17:21:51.346788] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASPN took 52.2s. Estimated remaining: 4h 52m 58s. Rate: 7.5 symbols/min [2025-10-03T17:21:51.522787] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-03T17:21:51.525889] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-03T17:21:51.526861] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-03T17:21:51.526954] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-03T17:21:51.602492] [DEBUG] [LOCAL ] ATEN: Trimmed 57400 records to 39883 (keeping 200 days of data) [2025-10-03T17:21:51.607428] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:51.740978] [DEBUG] [LOCAL ] ATHM: Loaded 32341 existing records from primary storage. [2025-10-03T17:21:51.742138] [INFO ] [MAIN ] ATHM: Loaded 32341 existing records. [2025-10-03T17:21:51.960809] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:51.962431] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-03T17:21:51.963113] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-03T17:21:51.966692] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-03T17:21:51.966788] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-03T17:21:52.490287] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:52.491491] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-03T17:21:52.532853] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:21:52.580576] [DEBUG] [LOCAL ] ATEN: Primary data saved (39883 records). [2025-10-03T17:21:52.580756] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-03T17:21:52.581499] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ATEN took 30.5s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-03T17:21:52.720381] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:21:52.795946] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-03T17:21:52.799138] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:52.810471] [DEBUG] [LOCAL ] ATHS: Loaded 6987 existing records from primary storage. [2025-10-03T17:21:52.810733] [INFO ] [MAIN ] ATHS: Loaded 6987 existing records. [2025-10-03T17:21:53.004480] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:53.004769] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-03T17:21:53.004868] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-03T17:21:53.005165] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-03T17:21:53.005227] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-03T17:21:53.391464] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:53.590753] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-03T17:21:54.095355] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:21:54.207889] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T17:21:54.390738] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-03T17:21:55.190666] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-03T17:21:55.542185] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:21:55.571628] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:21:55.990693] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-03T17:21:56.102059] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T17:21:56.790746] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-03T17:21:57.590701] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-03T17:21:57.674861] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:21:57.677425] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:21:57.683186] [INFO ] [REMOTE ] ATGE: Full fetch complete (46339 records). [2025-10-03T17:21:57.690104] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-03T17:21:58.137326] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-03T17:21:58.137415] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-03T17:21:58.137990] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-03T17:21:58.138083] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-03T17:21:58.139308] [DEBUG] [LOCAL ] ATGE: Trimmed 46339 records to 31813 (keeping 200 days of data) [2025-10-03T17:21:58.343037] [DEBUG] [LOCAL ] ATGE: Primary data saved (31813 records). [2025-10-03T17:21:58.343230] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-03T17:21:58.343358] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ATGE took 23.6s. Estimated remaining: 4h 50m 43s. Rate: 7.6 symbols/min [2025-10-03T17:21:58.395807] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-03T17:21:58.539496] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:21:58.592071] [DEBUG] [LOCAL ] ATI: Loaded 51863 existing records from primary storage. [2025-10-03T17:21:58.592514] [INFO ] [MAIN ] ATI: Loaded 51863 existing records. [2025-10-03T17:21:58.795236] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:21:58.795553] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-03T17:21:58.795611] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-03T17:21:58.795956] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-03T17:21:58.796015] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-03T17:21:59.118813] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T17:21:59.193912] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-03T17:21:59.239208] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:21:59.241563] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:21:59.990715] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-03T17:22:00.790729] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-03T17:22:01.134553] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T17:22:01.137616] [INFO ] [REMOTE ] ASX: Full fetch complete (76590 records). [2025-10-03T17:22:01.137778] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-03T17:22:01.601316] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-03T17:22:01.597070] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-03T17:22:01.601452] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-03T17:22:01.603339] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-03T17:22:01.603690] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-03T17:22:01.632265] [DEBUG] [LOCAL ] ASX: Trimmed 76590 records to 53615 (keeping 200 days of data) [2025-10-03T17:22:01.632124] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:22:01.997286] [DEBUG] [LOCAL ] ASX: Primary data saved (53615 records). [2025-10-03T17:22:01.997443] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-03T17:22:01.997542] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ASX took 45.9s. Estimated remaining: 4h 49m 39s. Rate: 7.6 symbols/min [2025-10-03T17:22:02.195856] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:02.242873] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:22:02.289425] [DEBUG] [LOCAL ] ATKR: Loaded 35963 existing records from primary storage. [2025-10-03T17:22:02.289765] [INFO ] [MAIN ] ATKR: Loaded 35963 existing records. [2025-10-03T17:22:02.402307] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-03T17:22:02.424620] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:22:02.499673] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:02.499957] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-03T17:22:02.500019] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-03T17:22:02.500825] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-03T17:22:02.500887] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-03T17:22:02.886132] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:03.190725] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-03T17:22:03.990688] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-03T17:22:04.175395] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:22:04.579164] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:22:04.790736] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-03T17:22:04.825269] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T17:22:05.590747] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-03T17:22:06.131429] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:22:06.390714] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-03T17:22:07.078486] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:22:07.190723] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-03T17:22:07.913856] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:22:07.990690] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-03T17:22:08.790661] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-03T17:22:08.823685] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:22:09.261300] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T17:22:09.590730] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-03T17:22:09.814429] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T17:22:10.390721] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-03T17:22:11.031682] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:22:11.190723] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-03T17:22:11.588865] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:22:11.990727] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-03T17:22:12.790720] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-03T17:22:12.850740] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T17:22:13.151750] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:22:13.590705] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-03T17:22:14.237840] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:22:14.281955] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:22:14.390755] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-03T17:22:15.190739] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-03T17:22:15.727247] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T17:22:15.990696] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-03T17:22:16.358372] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:22:16.790691] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-03T17:22:16.890016] [DEBUG] [REMOTE ] ATI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-03T17:22:16.890324] [WARN ] [REMOTE ] ATI: No data returned for month 2025-06 [2025-10-03T17:22:16.890413] [FATAL] [REMOTE ] ATI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:22:16.890557] [FATAL] [MAIN ] ATI: Failed to fetch primary data. [2025-10-03T17:22:16.890625] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:22:16.890724] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-03T17:22:16.890790] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-10-03T17:22:16.890835] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-10-03T17:22:16.891073] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-10-03T17:22:16.891158] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATI took 18.5s. Estimated remaining: 4h 51m 3s. Rate: 7.6 symbols/min [2025-10-03T17:22:17.084171] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:17.124891] [DEBUG] [LOCAL ] ATMU: Loaded 39581 existing records from primary storage. [2025-10-03T17:22:17.125202] [INFO ] [MAIN ] ATMU: Loaded 39581 existing records. [2025-10-03T17:22:17.343522] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:17.355213] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-03T17:22:17.355330] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-03T17:22:17.357277] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-03T17:22:17.357186] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T17:22:17.357501] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-03T17:22:17.595771] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-03T17:22:17.760707] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:18.080527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T17:22:18.390705] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-03T17:22:19.190691] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-03T17:22:19.619946] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:22:19.918429] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T17:22:19.990691] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-03T17:22:20.790696] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-03T17:22:21.347554] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T17:22:21.590721] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-03T17:22:21.920028] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T17:22:22.337032] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:22:22.390707] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-03T17:22:23.190776] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-03T17:22:23.835107] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:22:23.970236] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T17:22:23.990725] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-03T17:22:24.615104] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:22:24.790718] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-03T17:22:25.590730] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-03T17:22:26.200045] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:22:26.203304] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:22:26.203488] [INFO ] [REMOTE ] ATHS: Full fetch complete (9913 records). [2025-10-03T17:22:26.211518] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-03T17:22:26.406065] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-03T17:22:26.688407] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-03T17:22:26.688520] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-03T17:22:26.688906] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-03T17:22:26.688975] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-03T17:22:26.690138] [DEBUG] [LOCAL ] ATHS: Trimmed 9913 records to 7008 (keeping 200 days of data) [2025-10-03T17:22:26.738750] [DEBUG] [LOCAL ] ATHS: Primary data saved (7008 records). [2025-10-03T17:22:26.738971] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-03T17:22:26.739116] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHS took 34.2s. Estimated remaining: 4h 51m 20s. Rate: 7.6 symbols/min [2025-10-03T17:22:26.927562] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:26.981212] [DEBUG] [LOCAL ] ATO: Loaded 42177 existing records from primary storage. [2025-10-03T17:22:26.981687] [INFO ] [MAIN ] ATO: Loaded 42177 existing records. [2025-10-03T17:22:27.171484] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:27.171828] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-03T17:22:27.171885] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-03T17:22:27.172983] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-03T17:22:27.173048] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-03T17:22:27.195941] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-03T17:22:27.591091] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:27.771577] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:22:27.990714] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-03T17:22:28.620327] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:22:28.766145] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T17:22:28.768363] [INFO ] [REMOTE ] ATHM: Full fetch complete (50938 records). [2025-10-03T17:22:28.768479] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-03T17:22:28.795962] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-03T17:22:29.173928] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-03T17:22:29.174058] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-03T17:22:29.175128] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-03T17:22:29.175203] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-03T17:22:29.176722] [DEBUG] [LOCAL ] ATHM: Trimmed 50938 records to 32487 (keeping 200 days of data) [2025-10-03T17:22:29.370660] [DEBUG] [LOCAL ] ATHM: Primary data saved (32487 records). [2025-10-03T17:22:29.370862] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-03T17:22:29.370980] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATHM took 38.0s. Estimated remaining: 4h 50m 4s. Rate: 7.6 symbols/min [2025-10-03T17:22:29.560508] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:29.595133] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-03T17:22:29.596006] [DEBUG] [LOCAL ] ATR: Loaded 30648 existing records from primary storage. [2025-10-03T17:22:29.597351] [INFO ] [MAIN ] ATR: Loaded 30648 existing records. [2025-10-03T17:22:29.800881] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:29.801102] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-03T17:22:29.801151] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-03T17:22:29.802074] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-03T17:22:29.802136] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-03T17:22:30.200172] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:30.224448] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:22:30.390711] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-03T17:22:31.190706] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-03T17:22:31.297170] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T17:22:31.732182] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:22:31.990693] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-03T17:22:32.790688] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-03T17:22:32.835317] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:22:33.275999] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T17:22:33.590696] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-03T17:22:34.183966] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:22:34.390687] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-03T17:22:35.190691] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-03T17:22:35.230367] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T17:22:35.316160] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:22:35.990690] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-03T17:22:36.746530] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T17:22:36.790711] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-03T17:22:36.895872] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:22:37.590713] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-03T17:22:38.113418] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:22:38.390690] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-03T17:22:38.829073] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:22:39.190721] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-03T17:22:39.639495] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T17:22:39.990729] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-03T17:22:40.485566] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T17:22:40.790701] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-03T17:22:41.590811] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-03T17:22:41.638445] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:22:42.295598] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:22:42.390715] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-03T17:22:42.874096] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T17:22:42.876371] [INFO ] [REMOTE ] ATKR: Full fetch complete (53781 records). [2025-10-03T17:22:42.876465] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-03T17:22:43.195767] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-03T17:22:43.311429] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-03T17:22:43.311519] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-03T17:22:43.312104] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-03T17:22:43.312169] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-03T17:22:43.313367] [DEBUG] [LOCAL ] ATKR: Trimmed 53781 records to 36223 (keeping 200 days of data) [2025-10-03T17:22:43.540818] [DEBUG] [LOCAL ] ATKR: Primary data saved (36223 records). [2025-10-03T17:22:43.540974] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-03T17:22:43.542223] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATKR took 41.5s. Estimated remaining: 4h 51m 16s. Rate: 7.5 symbols/min [2025-10-03T17:22:43.729951] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:43.751878] [DEBUG] [LOCAL ] ATS: Loaded 17921 existing records from primary storage. [2025-10-03T17:22:43.752141] [INFO ] [MAIN ] ATS: Loaded 17921 existing records. [2025-10-03T17:22:43.954034] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:43.954266] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-03T17:22:43.954316] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-03T17:22:43.954807] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-03T17:22:43.954868] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-03T17:22:44.005199] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-03T17:22:44.369527] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:44.504397] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T17:22:44.790710] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-03T17:22:45.074626] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T17:22:45.590720] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-03T17:22:45.875668] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:22:45.927815] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:22:46.390732] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-03T17:22:47.190663] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-03T17:22:47.313397] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:22:47.379094] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T17:22:47.990700] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-03T17:22:48.401209] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:22:48.791180] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-03T17:22:49.269841] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:22:49.590730] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-03T17:22:50.390707] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-03T17:22:50.448079] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T17:22:50.521402] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:22:51.190907] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-03T17:22:51.633795] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:22:51.636669] [INFO ] [REMOTE ] ATMU: Full fetch complete (56834 records). [2025-10-03T17:22:51.636870] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-03T17:22:51.999029] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-03T17:22:52.060950] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-03T17:22:52.061038] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-03T17:22:52.061636] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-03T17:22:52.061732] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-03T17:22:52.064152] [DEBUG] [LOCAL ] ATMU: Trimmed 56834 records to 39950 (keeping 200 days of data) [2025-10-03T17:22:52.326978] [DEBUG] [LOCAL ] ATMU: Primary data saved (39950 records). [2025-10-03T17:22:52.327160] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-03T17:22:52.327307] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 35.4s. Estimated remaining: 4h 51m 19s. Rate: 7.5 symbols/min [2025-10-03T17:22:52.511524] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:22:52.557265] [DEBUG] [LOCAL ] ATUS: Loaded 49646 existing records from primary storage. [2025-10-03T17:22:52.557622] [INFO ] [MAIN ] ATUS: Loaded 49646 existing records. [2025-10-03T17:22:52.751165] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:22:52.751421] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-03T17:22:52.751474] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-03T17:22:52.752359] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-03T17:22:52.752426] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-03T17:22:52.797360] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-03T17:22:53.132081] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:22:53.590749] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-03T17:23:07.214052] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (14.42 seconds). [2025-10-03T17:23:07.223512] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-03T17:23:07.693456] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (15.69 seconds). [2025-10-03T17:23:07.700374] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-03T17:23:08.572209] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:23:08.581831] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-03T17:23:08.796718] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:23:08.802871] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-03T17:23:09.635499] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (18.44 seconds). [2025-10-03T17:23:09.643506] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-03T17:23:09.765271] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:23:09.770019] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-03T17:23:10.273298] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:23:10.282777] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-03T17:23:10.746751] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T17:23:10.751322] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-03T17:23:11.153579] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (17.56 seconds). [2025-10-03T17:23:11.164027] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-03T17:23:11.530467] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:23:11.535882] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-03T17:23:11.608544] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:23:11.610936] [INFO ] [REMOTE ] ATO: Full fetch complete (60510 records). [2025-10-03T17:23:11.611034] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-03T17:23:12.067597] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-03T17:23:12.067721] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-03T17:23:12.068476] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-03T17:23:12.068543] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-03T17:23:12.069967] [DEBUG] [LOCAL ] ATO: Trimmed 60510 records to 42462 (keeping 200 days of data) [2025-10-03T17:23:12.365274] [DEBUG] [LOCAL ] ATO: Primary data saved (42462 records). [2025-10-03T17:23:12.365452] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-03T17:23:12.366250] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATO took 45.6s. Estimated remaining: 4h 53m 44s. Rate: 7.5 symbols/min [2025-10-03T17:23:12.559092] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:12.572125] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T17:23:12.577922] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-03T17:23:12.663930] [DEBUG] [LOCAL ] AU: Loaded 53383 existing records from primary storage. [2025-10-03T17:23:12.667706] [INFO ] [MAIN ] AU: Loaded 53383 existing records. [2025-10-03T17:23:12.668610] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T17:23:12.755771] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-03T17:23:12.882297] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:12.882516] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-03T17:23:12.882566] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-03T17:23:12.883760] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-03T17:23:12.883823] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-03T17:23:13.315840] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:13.316553] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-03T17:23:13.327320] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:23:13.350361] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-03T17:23:13.354241] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (3.71 seconds). [2025-10-03T17:23:13.363560] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-03T17:23:14.090779] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T17:23:14.102874] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-03T17:23:14.254682] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:23:14.258347] [INFO ] [REMOTE ] ATS: Full fetch complete (25684 records). [2025-10-03T17:23:14.258441] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-03T17:23:14.558154] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:23:14.620954] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-03T17:23:14.734580] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-03T17:23:14.734700] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-03T17:23:14.735109] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-03T17:23:14.735166] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-03T17:23:14.736057] [DEBUG] [LOCAL ] ATS: Trimmed 25684 records to 18034 (keeping 200 days of data) [2025-10-03T17:23:14.844369] [DEBUG] [LOCAL ] ATS: Primary data saved (18034 records). [2025-10-03T17:23:14.844520] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-03T17:23:14.844615] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATS took 31.3s. Estimated remaining: 4h 52m 26s. Rate: 7.5 symbols/min [2025-10-03T17:23:15.086096] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:15.135629] [DEBUG] [LOCAL ] AUB: Loaded 46648 existing records from primary storage. [2025-10-03T17:23:15.136008] [INFO ] [MAIN ] AUB: Loaded 46648 existing records. [2025-10-03T17:23:15.338014] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:15.338574] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-03T17:23:15.338766] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-03T17:23:15.340137] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-03T17:23:15.340204] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-03T17:23:15.620813] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-10-03T17:23:15.684509] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-03T17:23:15.747385] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:23:15.780775] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:23:15.773230] [INFO ] [REMOTE ] ATR: Full fetch complete (43436 records). [2025-10-03T17:23:15.781021] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-03T17:23:15.830305] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:15.832133] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-03T17:23:15.831229] [FATAL] [VALIDATOR ] ATR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:23:15.832461] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-03T17:23:15.832636] [FATAL] [MAIN ] ATR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:23:15.834205] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:23:15.834284] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-03T17:23:15.834428] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-10-03T17:23:15.834523] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-10-03T17:23:15.834874] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-10-03T17:23:15.835025] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATR took 46.5s. Estimated remaining: 4h 50m 51s. Rate: 7.5 symbols/min [2025-10-03T17:23:16.020878] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:16.027399] [DEBUG] [LOCAL ] AUNA: Loaded 4958 existing records from primary storage. [2025-10-03T17:23:16.027566] [INFO ] [MAIN ] AUNA: Loaded 4958 existing records. [2025-10-03T17:23:16.218550] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:16.218831] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-03T17:23:16.218882] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-03T17:23:16.219192] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-03T17:23:16.219251] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-03T17:23:16.604061] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:16.604413] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-03T17:23:17.309938] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:23:17.312039] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-03T17:23:17.519590] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:23:17.532047] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-03T17:23:17.572205] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:23:17.581044] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-03T17:23:17.620133] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T17:23:17.633181] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-03T17:23:18.139789] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:23:18.142393] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-03T17:23:18.733940] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:23:18.736117] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-03T17:23:19.211753] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T17:23:19.213993] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-03T17:23:19.241180] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:23:19.251426] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-03T17:23:19.484102] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T17:23:19.496511] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-03T17:23:19.582070] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-03T17:23:19.593030] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-03T17:23:19.866139] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:23:19.869720] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-03T17:23:20.452275] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T17:23:20.454232] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-03T17:23:20.646468] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:23:20.790750] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-03T17:23:21.217019] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:23:21.247047] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:23:21.590708] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-03T17:23:21.739322] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T17:23:22.218059] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T17:23:22.390712] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-03T17:23:22.481381] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T17:23:23.190694] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-03T17:23:23.990732] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-03T17:23:24.582975] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-03T17:23:24.790692] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-03T17:23:25.138607] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T17:23:25.590710] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-03T17:23:25.754916] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T17:23:26.390698] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-03T17:23:26.451365] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T17:23:26.857955] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T17:23:27.190707] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-03T17:23:27.997911] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-03T17:23:28.020760] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:23:28.790633] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-03T17:23:28.850137] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T17:23:29.058970] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:23:29.590883] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-03T17:23:29.901258] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:23:30.083720] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T17:23:30.084719] [INFO ] [REMOTE ] AUNA: Full fetch complete (7751 records). [2025-10-03T17:23:30.084795] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-03T17:23:30.395785] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-03T17:23:30.512795] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-03T17:23:30.512874] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-03T17:23:30.513082] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-03T17:23:30.513123] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-03T17:23:30.513569] [DEBUG] [LOCAL ] AUNA: Trimmed 7751 records to 5004 (keeping 200 days of data) [2025-10-03T17:23:30.543076] [DEBUG] [LOCAL ] AUNA: Primary data saved (5004 records). [2025-10-03T17:23:30.543200] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-03T17:23:30.543286] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. AUNA took 14.7s. Estimated remaining: 4h 52m 7s. Rate: 7.5 symbols/min [2025-10-03T17:23:30.740288] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:30.791728] [DEBUG] [LOCAL ] AVA: Loaded 39686 existing records from primary storage. [2025-10-03T17:23:30.792178] [INFO ] [MAIN ] AVA: Loaded 39686 existing records. [2025-10-03T17:23:30.998148] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:30.998928] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-03T17:23:30.998988] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-03T17:23:31.000456] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-03T17:23:31.000520] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-03T17:23:31.194795] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-03T17:23:31.394189] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:31.858960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T17:23:31.861739] [INFO ] [REMOTE ] ATUS: Full fetch complete (71016 records). [2025-10-03T17:23:31.861859] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-03T17:23:31.995727] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-03T17:23:32.298264] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-03T17:23:32.298356] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-03T17:23:32.299128] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-03T17:23:32.299200] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-03T17:23:32.300840] [DEBUG] [LOCAL ] ATUS: Trimmed 71016 records to 49993 (keeping 200 days of data) [2025-10-03T17:23:32.606133] [DEBUG] [LOCAL ] ATUS: Primary data saved (49993 records). [2025-10-03T17:23:32.606283] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-03T17:23:32.606442] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. ATUS took 40.3s. Estimated remaining: 4h 50m 46s. Rate: 7.5 symbols/min [2025-10-03T17:23:32.793617] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-03T17:23:32.794951] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:32.807296] [DEBUG] [LOCAL ] AVAL: Loaded 8795 existing records from primary storage. [2025-10-03T17:23:32.807511] [INFO ] [MAIN ] AVAL: Loaded 8795 existing records. [2025-10-03T17:23:33.007473] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:33.007968] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-03T17:23:33.008253] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-03T17:23:33.008522] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-03T17:23:33.008585] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-03T17:23:33.434411] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:33.505050] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-03T17:23:33.503327] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:23:33.590700] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-03T17:23:34.390689] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-03T17:23:34.664348] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:23:35.190629] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-03T17:23:35.215169] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:23:35.621359] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T17:23:35.990721] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-03T17:23:36.790634] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-03T17:23:36.829744] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:23:37.439591] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:23:37.590706] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-03T17:23:37.617051] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:23:38.390710] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-03T17:23:39.031202] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T17:23:39.190680] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-03T17:23:39.317579] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:23:39.990710] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-03T17:23:40.790634] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-03T17:23:41.320273] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:23:41.590703] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-03T17:23:41.663266] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:23:42.385239] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:23:42.394535] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-03T17:23:43.190736] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-03T17:23:43.282883] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T17:23:43.554061] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T17:23:43.556931] [INFO ] [REMOTE ] AU: Full fetch complete (76283 records). [2025-10-03T17:23:43.557110] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-03T17:23:43.985478] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-03T17:23:43.985596] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-03T17:23:43.986408] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-03T17:23:43.986477] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-03T17:23:43.988072] [DEBUG] [LOCAL ] AU: Trimmed 76283 records to 53773 (keeping 200 days of data) [2025-10-03T17:23:44.042696] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-03T17:23:44.335822] [DEBUG] [LOCAL ] AU: Primary data saved (53773 records). [2025-10-03T17:23:44.335978] [INFO ] [MAIN ] AU: Full history saved. [2025-10-03T17:23:44.337085] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AU took 32.0s. Estimated remaining: 4h 51m 24s. Rate: 7.5 symbols/min [2025-10-03T17:23:44.527914] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:44.574148] [DEBUG] [LOCAL ] AVB: Loaded 42269 existing records from primary storage. [2025-10-03T17:23:44.574470] [INFO ] [MAIN ] AVB: Loaded 42269 existing records. [2025-10-03T17:23:44.783469] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:23:44.783962] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-03T17:23:44.784091] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-03T17:23:44.784791] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-03T17:23:44.785054] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-03T17:23:44.830291] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-03T17:23:44.918236] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:23:45.230625] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:45.590795] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-03T17:23:45.677984] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:23:45.789205] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:23:46.390696] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-03T17:23:47.188323] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:23:47.197010] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-03T17:23:47.766408] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:23:47.905252] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T17:23:47.990783] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-03T17:23:48.644695] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T17:23:48.790705] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-03T17:23:49.590737] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-03T17:23:50.269893] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:23:50.390736] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-03T17:23:50.676068] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T17:23:51.190748] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-03T17:23:51.207949] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:23:51.990759] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-03T17:23:52.709916] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T17:23:52.739294] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T17:23:52.790700] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-03T17:23:53.590741] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-03T17:23:54.331499] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:23:54.390628] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-03T17:23:55.135899] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:23:55.190676] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-03T17:23:55.946591] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:23:55.990693] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-03T17:23:56.350186] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:23:56.352814] [INFO ] [REMOTE ] AUB: Full fetch complete (65777 records). [2025-10-03T17:23:56.352949] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-03T17:23:56.798604] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-03T17:23:56.846997] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-03T17:23:56.847167] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-03T17:23:56.848250] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-03T17:23:56.848329] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-03T17:23:56.850752] [DEBUG] [LOCAL ] AUB: Trimmed 65777 records to 46979 (keeping 200 days of data) [2025-10-03T17:23:57.222332] [DEBUG] [LOCAL ] AUB: Primary data saved (46979 records). [2025-10-03T17:23:57.222534] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-03T17:23:57.223797] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUB took 42.4s. Estimated remaining: 4h 52m 16s. Rate: 7.5 symbols/min [2025-10-03T17:23:57.500162] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:57.500572] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-03T17:23:57.500676] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-03T17:23:57.500866] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-03T17:23:57.501080] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-03T17:23:57.501218] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-03T17:23:57.501298] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-03T17:23:57.643914] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-03T17:23:57.702841] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:23:57.761190] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T17:23:58.117952] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:23:58.390735] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-03T17:23:59.045451] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:23:59.046822] [INFO ] [REMOTE ] AVAL: Full fetch complete (14751 records). [2025-10-03T17:23:59.046899] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-03T17:23:59.195822] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-03T17:23:59.492466] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-03T17:23:59.492678] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-03T17:23:59.493054] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-03T17:23:59.493183] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-03T17:23:59.494369] [DEBUG] [LOCAL ] AVAL: Trimmed 14751 records to 8914 (keeping 200 days of data) [2025-10-03T17:23:59.574046] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:23:59.595603] [DEBUG] [LOCAL ] AVAL: Primary data saved (8914 records). [2025-10-03T17:23:59.595789] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-03T17:23:59.595902] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AVAL took 27.0s. Estimated remaining: 4h 50m 60s. Rate: 7.5 symbols/min [2025-10-03T17:23:59.794236] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:23:59.820557] [DEBUG] [LOCAL ] AVD: Loaded 22716 existing records from primary storage. [2025-10-03T17:23:59.820870] [INFO ] [MAIN ] AVD: Loaded 22716 existing records. [2025-10-03T17:24:00.002712] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-03T17:24:00.026384] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:00.027988] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-03T17:24:00.028078] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-03T17:24:00.028912] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-03T17:24:00.029045] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-03T17:24:00.330289] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:24:00.365906] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-03T17:24:00.380117] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:24:00.391147] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-03T17:24:00.406705] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:24:00.406869] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-03T17:24:00.436908] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-03T17:24:00.448958] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-03T17:24:00.472830] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:00.473410] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-03T17:24:00.473744] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVBC took 3.2s. Estimated remaining: 4h 49m 26s. Rate: 7.6 symbols/min [2025-10-03T17:24:00.686873] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:00.693045] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:24:00.696155] [INFO ] [REMOTE ] AVA: Full fetch complete (55794 records). [2025-10-03T17:24:00.696274] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-03T17:24:00.795788] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-03T17:24:00.889245] [DEBUG] [LOCAL ] AVK: Loaded 18153 existing records from primary storage. [2025-10-03T17:24:00.927367] [INFO ] [MAIN ] AVK: Loaded 18153 existing records. [2025-10-03T17:24:01.346519] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-03T17:24:01.343402] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:01.346787] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-03T17:24:01.346871] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-03T17:24:01.347913] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-03T17:24:01.348001] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-03T17:24:01.346925] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-03T17:24:01.348485] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-03T17:24:01.348852] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-03T17:24:01.458624] [DEBUG] [LOCAL ] AVA: Trimmed 55794 records to 39939 (keeping 200 days of data) [2025-10-03T17:24:01.599681] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-03T17:24:01.919852] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:02.072337] [DEBUG] [LOCAL ] AVA: Primary data saved (39939 records). [2025-10-03T17:24:02.072613] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-03T17:24:02.072792] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVA took 31.5s. Estimated remaining: 4h 48m 2s. Rate: 7.6 symbols/min [2025-10-03T17:24:02.189407] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T17:24:02.282520] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:02.322041] [DEBUG] [LOCAL ] AVNS: Loaded 33967 existing records from primary storage. [2025-10-03T17:24:02.322350] [INFO ] [MAIN ] AVNS: Loaded 33967 existing records. [2025-10-03T17:24:02.395800] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-03T17:24:02.524501] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:02.524783] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-03T17:24:02.524837] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-03T17:24:02.525249] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-03T17:24:02.525339] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-03T17:24:02.972443] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:03.180409] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T17:24:03.190976] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-03T17:24:03.426617] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T17:24:03.990697] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-03T17:24:04.572275] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:24:04.790714] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-03T17:24:05.079462] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:24:05.466746] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T17:24:05.590734] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-03T17:24:06.390721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-03T17:24:06.924105] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T17:24:07.190707] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-03T17:24:07.807725] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:24:07.990722] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-03T17:24:08.163253] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:24:08.790714] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-03T17:24:09.357578] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:24:09.590740] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-03T17:24:09.828663] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:24:10.390721] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-03T17:24:10.725436] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T17:24:11.190685] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-03T17:24:11.504987] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:24:11.990723] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-03T17:24:12.790676] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-03T17:24:12.817864] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:24:13.246266] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:24:13.590723] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-03T17:24:13.945075] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:24:14.390741] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-03T17:24:14.789335] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:24:15.190699] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-03T17:24:15.991876] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-03T17:24:15.999145] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:24:16.605531] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:24:16.657601] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:24:16.790706] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-03T17:24:17.590730] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-03T17:24:17.837324] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:24:18.390687] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-03T17:24:19.055414] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:24:19.190694] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-03T17:24:19.990709] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-03T17:24:20.055626] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:24:20.505621] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:24:20.790690] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-03T17:24:20.969298] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:24:21.590709] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-03T17:24:22.390676] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-03T17:24:22.732611] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T17:24:22.861728] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:24:23.190693] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-03T17:24:23.605026] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T17:24:23.990688] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-03T17:24:24.789788] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T17:24:24.799711] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-03T17:24:24.848544] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:24:25.590717] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-03T17:24:25.995201] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:24:26.390706] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-03T17:24:26.917835] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:24:26.920616] [INFO ] [REMOTE ] AVB: Full fetch complete (58701 records). [2025-10-03T17:24:26.920753] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-03T17:24:27.196109] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-03T17:24:27.359143] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-03T17:24:27.359455] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-03T17:24:27.360680] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-03T17:24:27.360770] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-03T17:24:27.378001] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:24:27.384572] [DEBUG] [LOCAL ] AVB: Trimmed 58701 records to 42525 (keeping 200 days of data) [2025-10-03T17:24:27.671485] [DEBUG] [LOCAL ] AVB: Primary data saved (42525 records). [2025-10-03T17:24:27.671620] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-03T17:24:27.672374] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVB took 43.3s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-10-03T17:24:27.874331] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:27.923352] [DEBUG] [LOCAL ] AVNT: Loaded 39453 existing records from primary storage. [2025-10-03T17:24:27.923736] [INFO ] [MAIN ] AVNT: Loaded 39453 existing records. [2025-10-03T17:24:27.995815] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-03T17:24:28.129713] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:28.129950] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-03T17:24:28.129999] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-03T17:24:28.130428] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-03T17:24:28.130487] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-03T17:24:28.479169] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:24:28.543254] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:28.790752] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-03T17:24:29.590701] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-03T17:24:29.946397] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T17:24:30.001070] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:24:30.390736] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-03T17:24:31.190681] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-03T17:24:31.258561] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:24:31.460138] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T17:24:31.854965] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:24:31.857177] [INFO ] [REMOTE ] AVK: Full fetch complete (26847 records). [2025-10-03T17:24:31.857473] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-03T17:24:31.995895] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-03T17:24:32.312196] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-03T17:24:32.312328] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-03T17:24:32.312781] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-03T17:24:32.312846] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-03T17:24:32.314458] [DEBUG] [LOCAL ] AVK: Trimmed 26847 records to 18373 (keeping 200 days of data) [2025-10-03T17:24:32.439911] [DEBUG] [LOCAL ] AVK: Primary data saved (18373 records). [2025-10-03T17:24:32.440078] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-03T17:24:32.440184] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVK took 32.0s. Estimated remaining: 4h 50m 39s. Rate: 7.5 symbols/min [2025-10-03T17:24:32.640528] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:32.702819] [DEBUG] [LOCAL ] AVTR: Loaded 53952 existing records from primary storage. [2025-10-03T17:24:32.703182] [INFO ] [MAIN ] AVTR: Loaded 53952 existing records. [2025-10-03T17:24:32.798234] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-03T17:24:32.834925] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T17:24:32.880818] [INFO ] [REMOTE ] AVD: Full fetch complete (33598 records). [2025-10-03T17:24:32.893338] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-03T17:24:32.949244] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:33.006467] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-03T17:24:33.026081] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-03T17:24:33.050596] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-03T17:24:33.053857] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-03T17:24:33.591585] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-03T17:24:33.802012] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-03T17:24:33.825931] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:33.826020] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-03T17:24:33.826674] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-03T17:24:33.826759] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-03T17:24:33.828014] [DEBUG] [LOCAL ] AVD: Trimmed 33598 records to 22804 (keeping 200 days of data) [2025-10-03T17:24:33.966412] [DEBUG] [LOCAL ] AVD: Primary data saved (22804 records). [2025-10-03T17:24:33.966567] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-03T17:24:33.966686] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVD took 34.4s. Estimated remaining: 4h 49m 15s. Rate: 7.6 symbols/min [2025-10-03T17:24:34.113332] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T17:24:34.143865] [INFO ] [REMOTE ] AVNS: Full fetch complete (48364 records). [2025-10-03T17:24:34.157204] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-03T17:24:34.181510] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:34.405479] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-03T17:24:34.518864] [DEBUG] [LOCAL ] AVY: Loaded 37777 existing records from primary storage. [2025-10-03T17:24:34.533133] [INFO ] [MAIN ] AVY: Loaded 37777 existing records. [2025-10-03T17:24:34.880546] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:34.880961] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-03T17:24:34.881220] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-03T17:24:34.881410] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-03T17:24:34.881758] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-03T17:24:34.882793] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-03T17:24:34.882981] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-03T17:24:34.883352] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-03T17:24:34.883454] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-03T17:24:34.965442] [DEBUG] [LOCAL ] AVNS: Trimmed 48364 records to 34232 (keeping 200 days of data) [2025-10-03T17:24:35.379378] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T17:24:35.468915] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-03T17:24:35.522290] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:35.569016] [DEBUG] [LOCAL ] AVNS: Primary data saved (34232 records). [2025-10-03T17:24:35.569160] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-03T17:24:35.569251] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVNS took 33.5s. Estimated remaining: 4h 47m 53s. Rate: 7.6 symbols/min [2025-10-03T17:24:35.767605] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:35.796977] [DEBUG] [LOCAL ] AWF: Loaded 24560 existing records from primary storage. [2025-10-03T17:24:35.797279] [INFO ] [MAIN ] AWF: Loaded 24560 existing records. [2025-10-03T17:24:35.991674] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-03T17:24:36.008482] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:24:36.010137] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-03T17:24:36.010195] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-03T17:24:36.010506] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-03T17:24:36.010566] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-03T17:24:36.435915] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:36.470501] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-03T17:24:36.540407] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:24:36.790684] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-03T17:24:37.211807] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:24:37.590716] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-03T17:24:38.189515] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:24:38.390692] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-03T17:24:38.991750] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:24:39.190734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-03T17:24:39.871495] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:24:39.990731] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-03T17:24:40.669595] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:24:40.790679] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-03T17:24:41.596932] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-03T17:24:41.617236] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T17:24:42.402320] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-03T17:24:42.408261] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:24:42.745766] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:24:43.190725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-03T17:24:43.658317] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:24:43.990726] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-03T17:24:44.621225] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:24:44.790745] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-03T17:24:45.590723] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-03T17:24:45.734005] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T17:24:45.764222] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:24:46.390706] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-03T17:24:47.181501] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:24:47.191390] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-03T17:24:47.365748] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T17:24:47.990731] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-03T17:24:48.790673] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-03T17:24:49.129737] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:24:49.330667] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:24:49.590737] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-03T17:24:50.257290] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:24:50.390744] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-03T17:24:50.929031] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:24:51.190741] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-03T17:24:51.696194] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:24:51.990703] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-03T17:24:52.576849] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T17:24:52.790862] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-03T17:24:53.590727] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-03T17:24:53.750234] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T17:24:53.785098] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T17:24:54.390739] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-03T17:24:55.017597] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:24:55.190721] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-03T17:24:55.940669] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:24:55.978666] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:24:55.990604] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-03T17:24:56.790693] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-03T17:24:57.087411] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T17:24:57.590725] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-03T17:24:58.053390] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:24:58.058089] [INFO ] [REMOTE ] AVNT: Full fetch complete (56497 records). [2025-10-03T17:24:58.058288] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-03T17:24:58.395874] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-03T17:24:58.520882] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-03T17:24:58.520983] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-03T17:24:58.521713] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-03T17:24:58.521785] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-03T17:24:58.523243] [DEBUG] [LOCAL ] AVNT: Trimmed 56497 records to 39711 (keeping 200 days of data) [2025-10-03T17:24:58.783003] [DEBUG] [LOCAL ] AVNT: Primary data saved (39711 records). [2025-10-03T17:24:58.783163] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-03T17:24:58.783988] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVNT took 31.1s. Estimated remaining: 4h 50m 43s. Rate: 7.5 symbols/min [2025-10-03T17:24:58.973933] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:24:58.974323] [DEBUG] [LOCAL ] AWI: No existing data file found in primary storage. [2025-10-03T17:24:58.974451] [WARN ] [MAIN ] AWI: No existing data found, performing full refresh instead. [2025-10-03T17:24:58.974741] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-03T17:24:58.974852] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-03T17:24:58.974959] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-03T17:24:58.975024] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-03T17:24:59.121067] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:24:59.192878] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-03T17:24:59.426312] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:24:59.884131] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T17:24:59.990741] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-03T17:25:00.790695] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-03T17:25:00.916713] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T17:25:01.253560] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:25:01.590921] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-03T17:25:02.270632] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T17:25:02.390721] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-03T17:25:03.138093] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:25:03.190708] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-03T17:25:03.617073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:25:03.990700] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-03T17:25:04.689442] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:25:04.790690] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-03T17:25:05.590690] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-03T17:25:05.798990] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T17:25:06.244314] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:25:06.390685] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-03T17:25:06.566428] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:25:06.568198] [INFO ] [REMOTE ] AWF: Full fetch complete (36190 records). [2025-10-03T17:25:06.568323] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-03T17:25:07.001464] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-03T17:25:07.001582] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-03T17:25:07.002182] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-03T17:25:07.002246] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-03T17:25:07.003410] [DEBUG] [LOCAL ] AWF: Trimmed 36190 records to 24788 (keeping 200 days of data) [2025-10-03T17:25:07.166121] [DEBUG] [LOCAL ] AWF: Primary data saved (24788 records). [2025-10-03T17:25:07.166269] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-03T17:25:07.166365] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AWF took 31.6s. Estimated remaining: 4h 50m 40s. Rate: 7.5 symbols/min [2025-10-03T17:25:07.201529] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-03T17:25:07.366457] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:07.418227] [DEBUG] [LOCAL ] AWK: Loaded 49037 existing records from primary storage. [2025-10-03T17:25:07.418637] [INFO ] [MAIN ] AWK: Loaded 49037 existing records. [2025-10-03T17:25:07.564530] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T17:25:07.668605] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:07.668887] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-03T17:25:07.668944] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-03T17:25:07.669469] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-03T17:25:07.669539] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-03T17:25:07.997227] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-03T17:25:08.088603] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:08.462227] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:25:08.464496] [INFO ] [REMOTE ] AVY: Full fetch complete (56356 records). [2025-10-03T17:25:08.464634] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-03T17:25:08.798210] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-03T17:25:08.906231] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-03T17:25:08.906328] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-03T17:25:08.907055] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-03T17:25:08.907147] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-03T17:25:08.908512] [DEBUG] [LOCAL ] AVY: Trimmed 56356 records to 38061 (keeping 200 days of data) [2025-10-03T17:25:09.169357] [DEBUG] [LOCAL ] AVY: Primary data saved (38061 records). [2025-10-03T17:25:09.169593] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-03T17:25:09.169747] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AVY took 35.2s. Estimated remaining: 4h 49m 23s. Rate: 7.5 symbols/min [2025-10-03T17:25:09.365987] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:09.389949] [DEBUG] [LOCAL ] AWP: Loaded 21611 existing records from primary storage. [2025-10-03T17:25:09.390231] [INFO ] [MAIN ] AWP: Loaded 21611 existing records. [2025-10-03T17:25:09.606276] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:09.606474] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-03T17:25:09.608483] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-03T17:25:09.608552] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-03T17:25:09.608905] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-03T17:25:09.608968] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-03T17:25:10.065813] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:10.111242] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T17:25:10.119048] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T17:25:10.390685] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-03T17:25:11.136241] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:25:11.190689] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-03T17:25:11.990683] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-03T17:25:12.236488] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:25:12.255102] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:25:12.257818] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-10-03T17:25:12.258112] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-03T17:25:12.701762] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-03T17:25:12.701863] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-03T17:25:12.702733] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-03T17:25:12.702804] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-03T17:25:12.704484] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 54342 (keeping 200 days of data) [2025-10-03T17:25:12.795951] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-03T17:25:13.071947] [DEBUG] [LOCAL ] AVTR: Primary data saved (54342 records). [2025-10-03T17:25:13.072568] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-03T17:25:13.073994] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AVTR took 40.6s. Estimated remaining: 4h 48m 28s. Rate: 7.6 symbols/min [2025-10-03T17:25:13.272082] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:13.297252] [DEBUG] [LOCAL ] AWR: Loaded 22776 existing records from primary storage. [2025-10-03T17:25:13.297532] [INFO ] [MAIN ] AWR: Loaded 22776 existing records. [2025-10-03T17:25:13.490395] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:13.490782] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-03T17:25:13.490855] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-03T17:25:13.491175] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-03T17:25:13.491234] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-03T17:25:13.602821] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-03T17:25:13.904483] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:13.919595] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T17:25:13.951080] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T17:25:14.390688] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-03T17:25:14.942573] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:25:15.190693] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-03T17:25:15.842208] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:25:15.990708] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-03T17:25:16.619508] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:25:16.790703] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-03T17:25:17.590698] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-03T17:25:17.822107] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:25:17.874888] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:25:18.390668] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-03T17:25:18.712777] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T17:25:19.190698] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-03T17:25:19.990685] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-03T17:25:20.130706] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:25:20.341823] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T17:25:20.790633] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-03T17:25:21.167059] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T17:25:21.590680] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-03T17:25:21.876350] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T17:25:22.390675] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-03T17:25:22.557978] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:25:23.190717] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-03T17:25:23.544098] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T17:25:23.990732] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-03T17:25:24.443362] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T17:25:24.790676] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-03T17:25:25.026710] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:25:25.509264] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:25:25.590625] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-03T17:25:26.390671] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-03T17:25:26.710545] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T17:25:27.190729] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-03T17:25:27.990635] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-03T17:25:28.262847] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:25:28.291018] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:25:28.790740] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-03T17:25:29.037999] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:25:29.590717] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-03T17:25:29.624924] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T17:25:30.390720] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-03T17:25:30.926467] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:25:31.190725] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-03T17:25:31.851034] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:25:31.990691] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-03T17:25:32.298166] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T17:25:32.790753] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-03T17:25:33.566521] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:25:33.590678] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-03T17:25:33.770509] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T17:25:34.390729] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-03T17:25:35.190778] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-03T17:25:35.219835] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:25:35.249440] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:25:35.990622] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-03T17:25:36.321716] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T17:25:36.790776] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-03T17:25:36.851762] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:25:36.854066] [INFO ] [REMOTE ] AWI: Full fetch complete (35608 records). [2025-10-03T17:25:36.854189] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-03T17:25:37.283335] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-03T17:25:37.283443] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-03T17:25:37.284019] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-03T17:25:37.284087] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-03T17:25:37.286531] [DEBUG] [LOCAL ] AWI: Trimmed 35608 records to 25738 (keeping 200 days of data) [2025-10-03T17:25:37.478626] [DEBUG] [LOCAL ] AWI: Primary data saved (25738 records). [2025-10-03T17:25:37.478816] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-03T17:25:37.478942] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AWI took 38.7s. Estimated remaining: 4h 51m 28s. Rate: 7.5 symbols/min [2025-10-03T17:25:37.595890] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-03T17:25:37.681968] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:37.713016] [DEBUG] [LOCAL ] AX: Loaded 28542 existing records from primary storage. [2025-10-03T17:25:37.713322] [INFO ] [MAIN ] AX: Loaded 28542 existing records. [2025-10-03T17:25:37.932755] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:25:37.939883] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:37.946041] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-03T17:25:37.946557] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-03T17:25:37.946971] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-03T17:25:37.947035] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-03T17:25:38.334816] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:38.390736] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-03T17:25:39.192260] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-03T17:25:39.195550] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:25:39.282791] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:25:39.990693] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-03T17:25:40.528432] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T17:25:40.790638] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-03T17:25:41.100020] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:25:41.590742] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-03T17:25:42.154103] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:25:42.390778] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-03T17:25:42.548591] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:25:42.550860] [INFO ] [REMOTE ] AWR: Full fetch complete (32203 records). [2025-10-03T17:25:42.551014] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-03T17:25:43.094475] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-03T17:25:43.094594] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-03T17:25:43.095111] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-03T17:25:43.095179] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-03T17:25:43.096260] [DEBUG] [LOCAL ] AWR: Trimmed 32203 records to 22954 (keeping 200 days of data) [2025-10-03T17:25:43.196307] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-03T17:25:43.256156] [DEBUG] [LOCAL ] AWR: Primary data saved (22954 records). [2025-10-03T17:25:43.256306] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-03T17:25:43.256397] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWR took 30.2s. Estimated remaining: 4h 50m 55s. Rate: 7.5 symbols/min [2025-10-03T17:25:43.442066] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:43.496689] [DEBUG] [LOCAL ] AXL: Loaded 50866 existing records from primary storage. [2025-10-03T17:25:43.497034] [INFO ] [MAIN ] AXL: Loaded 50866 existing records. [2025-10-03T17:25:43.706449] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:43.707352] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-03T17:25:43.708740] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-03T17:25:43.708571] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:25:43.716197] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-03T17:25:43.716301] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-03T17:25:43.995885] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-03T17:25:44.100206] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:44.740552] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:25:44.790747] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-03T17:25:45.537017] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T17:25:45.590719] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-03T17:25:46.390696] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-03T17:25:46.545376] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:25:46.629339] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T17:25:47.190736] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-03T17:25:47.470068] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:25:47.472198] [INFO ] [REMOTE ] AWK: Full fetch complete (70325 records). [2025-10-03T17:25:47.472333] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-03T17:25:47.473424] [FATAL] [VALIDATOR ] AWK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:25:47.473531] [FATAL] [MAIN ] AWK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:25:47.473584] [WARN ] [MAIN ] AWK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:25:47.473718] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-03T17:25:47.473807] [DEBUG] [LOCAL ] AWK: No primary data file found to delete. [2025-10-03T17:25:47.473875] [INFO ] [LOCAL ] AWK: Starting deletion of derivative data. [2025-10-03T17:25:47.474293] [DEBUG] [LOCAL ] AWK: Deleted derivative data file. [2025-10-03T17:25:47.474414] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWK took 40.3s. Estimated remaining: 4h 50m 4s. Rate: 7.5 symbols/min [2025-10-03T17:25:47.670738] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:47.737248] [DEBUG] [LOCAL ] AXP: Loaded 53579 existing records from primary storage. [2025-10-03T17:25:47.737713] [INFO ] [MAIN ] AXP: Loaded 53579 existing records. [2025-10-03T17:25:47.937956] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:25:47.938212] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-03T17:25:47.938265] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-03T17:25:47.938916] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-03T17:25:47.938978] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-03T17:25:47.999828] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-03T17:25:48.264461] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:25:48.287286] [INFO ] [REMOTE ] AWP: Full fetch complete (32245 records). [2025-10-03T17:25:48.313568] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-03T17:25:48.354535] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:48.786186] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-03T17:25:48.786308] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-03T17:25:48.786802] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-03T17:25:48.786868] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-03T17:25:48.787790] [DEBUG] [LOCAL ] AWP: Trimmed 32245 records to 21755 (keeping 200 days of data) [2025-10-03T17:25:48.790693] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-03T17:25:48.926580] [DEBUG] [LOCAL ] AWP: Primary data saved (21755 records). [2025-10-03T17:25:48.926747] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-03T17:25:48.926873] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWP took 39.8s. Estimated remaining: 4h 48m 43s. Rate: 7.5 symbols/min [2025-10-03T17:25:49.124277] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:25:49.124476] [DEBUG] [LOCAL ] AXR: No existing data file found in primary storage. [2025-10-03T17:25:49.124516] [WARN ] [MAIN ] AXR: No existing data found, performing full refresh instead. [2025-10-03T17:25:49.124633] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-03T17:25:49.124715] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-03T17:25:49.124767] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-03T17:25:49.124831] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-03T17:25:49.578216] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:25:49.590638] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-03T17:25:49.668946] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:25:50.390633] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-03T17:25:50.712143] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T17:25:50.915510] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T17:25:51.190730] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-03T17:25:51.948106] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T17:25:51.990719] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-03T17:25:52.790686] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-03T17:25:53.111511] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:25:53.284084] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-03T17:25:53.551936] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T17:25:53.590745] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-03T17:25:54.255495] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:25:54.390724] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-03T17:25:55.190707] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-03T17:25:55.990695] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-03T17:25:56.366969] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:25:56.465824] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-03T17:25:56.790694] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-03T17:25:57.468217] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:25:57.590685] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-03T17:25:58.400674] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-03T17:25:58.407155] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:25:58.964912] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T17:25:59.141038] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:25:59.190690] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-03T17:25:59.990701] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-03T17:26:00.790708] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-03T17:26:01.310592] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:26:01.308573] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-03T17:26:01.590722] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-03T17:26:01.670992] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:26:02.390705] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-03T17:26:02.939971] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:26:02.958816] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T17:26:03.190697] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-03T17:26:03.813814] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T17:26:03.990709] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-03T17:26:04.790736] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-03T17:26:05.590741] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-03T17:26:06.193227] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T17:26:06.390710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-03T17:26:06.435942] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T17:26:06.481980] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T17:26:07.190701] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-03T17:26:07.598319] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T17:26:07.781916] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T17:26:07.990704] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-03T17:26:08.790710] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-03T17:26:09.319193] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:26:09.590709] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-03T17:26:09.825830] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:26:09.827769] [INFO ] [REMOTE ] AX: Full fetch complete (42676 records). [2025-10-03T17:26:09.827876] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-03T17:26:10.255436] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-03T17:26:10.255524] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-03T17:26:10.256064] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-03T17:26:10.256129] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-03T17:26:10.257191] [DEBUG] [LOCAL ] AX: Trimmed 42676 records to 28727 (keeping 200 days of data) [2025-10-03T17:26:10.391163] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-03T17:26:10.457554] [DEBUG] [LOCAL ] AX: Primary data saved (28727 records). [2025-10-03T17:26:10.457749] [INFO ] [MAIN ] AX: Full history saved. [2025-10-03T17:26:10.457854] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AX took 33.0s. Estimated remaining: 4h 51m 6s. Rate: 7.5 symbols/min [2025-10-03T17:26:10.647603] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:10.693856] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-03T17:26:10.694186] [INFO ] [MAIN ] AXS: Loaded 38703 existing records. [2025-10-03T17:26:10.884951] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:10.886973] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-03T17:26:10.887030] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-03T17:26:10.887553] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-03T17:26:10.887624] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-03T17:26:10.999699] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:26:11.195078] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-03T17:26:11.224546] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:26:11.342121] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:11.990694] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-03T17:26:12.790699] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-03T17:26:13.054008] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T17:26:13.138628] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-03T17:26:13.590733] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-03T17:26:13.865449] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:26:14.390692] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-03T17:26:14.904511] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T17:26:14.905322] [INFO ] [REMOTE ] AXR: Full fetch complete (4803 records). [2025-10-03T17:26:14.905399] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-03T17:26:15.197449] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-03T17:26:15.337074] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-03T17:26:15.337152] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-03T17:26:15.337304] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-03T17:26:15.337345] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-03T17:26:15.337747] [DEBUG] [LOCAL ] AXR: Trimmed 4803 records to 3061 (keeping 200 days of data) [2025-10-03T17:26:15.356287] [DEBUG] [LOCAL ] AXR: Primary data saved (3061 records). [2025-10-03T17:26:15.356380] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-03T17:26:15.356450] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 26.4s. Estimated remaining: 4h 50m 23s. Rate: 7.5 symbols/min [2025-10-03T17:26:15.547069] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:15.609336] [DEBUG] [LOCAL ] AXTA: Loaded 52453 existing records from primary storage. [2025-10-03T17:26:15.610033] [INFO ] [MAIN ] AXTA: Loaded 52453 existing records. [2025-10-03T17:26:15.827441] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:15.827950] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-03T17:26:15.828130] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-03T17:26:15.842124] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-03T17:26:15.850897] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-03T17:26:15.930022] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T17:26:15.992742] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-03T17:26:16.275210] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:16.790696] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-03T17:26:17.031008] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-03T17:26:17.033950] [INFO ] [REMOTE ] AXL: Full fetch complete (72702 records). [2025-10-03T17:26:17.034165] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-03T17:26:17.482665] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-03T17:26:17.482859] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-03T17:26:17.483991] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-03T17:26:17.484062] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-03T17:26:17.485535] [DEBUG] [LOCAL ] AXL: Trimmed 72702 records to 51239 (keeping 200 days of data) [2025-10-03T17:26:17.590673] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-03T17:26:17.738135] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:26:17.826213] [DEBUG] [LOCAL ] AXL: Primary data saved (51239 records). [2025-10-03T17:26:17.826371] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-03T17:26:17.827347] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXL took 34.6s. Estimated remaining: 4h 49m 14s. Rate: 7.5 symbols/min [2025-10-03T17:26:18.390628] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-03T17:26:18.578303] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T17:26:19.190735] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-03T17:26:19.294299] [DEBUG] [REMOTE ] AXTA: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T17:26:19.294599] [WARN ] [REMOTE ] AXTA: No data returned for month 2025-01 [2025-10-03T17:26:19.294724] [FATAL] [REMOTE ] AXTA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:26:19.294807] [FATAL] [MAIN ] AXTA: Failed to fetch primary data. [2025-10-03T17:26:19.294870] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:26:19.294943] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-03T17:26:19.295008] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-10-03T17:26:19.295046] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-10-03T17:26:19.295440] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-10-03T17:26:19.295527] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AXTA took 3.9s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:26:19.562933] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T17:26:19.927578] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T17:26:19.990702] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-03T17:26:20.790703] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-03T17:26:21.071575] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T17:26:21.590779] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-03T17:26:22.940684] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-03T17:26:22.953699] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-03T17:26:22.985453] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:26:23.190747] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-03T17:26:24.326793] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T17:26:24.335947] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-03T17:26:24.959624] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T17:26:24.962463] [INFO ] [REMOTE ] AXP: Full fetch complete (76928 records). [2025-10-03T17:26:24.962628] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-03T17:26:25.397836] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-03T17:26:25.397990] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-03T17:26:25.398887] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-03T17:26:25.399012] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-03T17:26:25.414289] [DEBUG] [LOCAL ] AXP: Trimmed 76928 records to 53964 (keeping 200 days of data) [2025-10-03T17:26:25.428103] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:26:25.501974] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-03T17:26:25.792264] [DEBUG] [LOCAL ] AXP: Primary data saved (53964 records). [2025-10-03T17:26:25.792403] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-03T17:26:25.792508] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXP took 38.3s. Estimated remaining: 4h 47m 31s. Rate: 7.6 symbols/min [2025-10-03T17:26:27.026251] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T17:26:27.035268] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-03T17:26:28.588524] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:26:28.598329] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-03T17:26:30.127137] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T17:26:30.136458] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-03T17:26:31.651941] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T17:26:31.661825] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-03T17:26:32.909100] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:26:32.911825] [INFO ] [REMOTE ] AXS: Full fetch complete (55730 records). [2025-10-03T17:26:32.911939] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-03T17:26:33.323183] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-03T17:26:33.323262] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-03T17:26:33.323853] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-03T17:26:33.323917] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-03T17:26:33.325098] [DEBUG] [LOCAL ] AXS: Trimmed 55730 records to 38977 (keeping 200 days of data) [2025-10-03T17:26:33.576907] [DEBUG] [LOCAL ] AXS: Primary data saved (38977 records). [2025-10-03T17:26:33.577071] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-03T17:26:33.577781] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXS took 23.1s. Estimated remaining: 4h 47m 21s. Rate: 7.6 symbols/min [2025-10-03T17:26:34.254678] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.362542] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.386559] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.387146] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-03T17:26:34.366590] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:34.387448] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-03T17:26:34.388629] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-03T17:26:34.388716] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-03T17:26:34.388768] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-03T17:26:34.388803] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-03T17:26:34.487929] [DEBUG] [LOCAL ] AZO: Loaded 11370 existing records from primary storage. [2025-10-03T17:26:34.533391] [INFO ] [MAIN ] AZO: Loaded 11370 existing records. [2025-10-03T17:26:34.602568] [DEBUG] [LOCAL ] AZZ: Loaded 22158 existing records from primary storage. [2025-10-03T17:26:34.671382] [DEBUG] [LOCAL ] AYI: Loaded 25458 existing records from primary storage. [2025-10-03T17:26:34.708307] [INFO ] [MAIN ] AYI: Loaded 25458 existing records. [2025-10-03T17:26:34.692576] [INFO ] [MAIN ] AZZ: Loaded 22158 existing records. [2025-10-03T17:26:35.189172] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.262678] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.315784] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-03T17:26:35.463937] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:35.469169] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-03T17:26:35.470107] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-03T17:26:35.470198] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-03T17:26:35.473607] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.531149] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:35.547336] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.583848] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-03T17:26:35.552730] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-03T17:26:35.589258] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-03T17:26:35.616280] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-03T17:26:35.616210] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-03T17:26:35.626841] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-03T17:26:35.626982] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-03T17:26:36.452003] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.468866] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-03T17:26:36.752007] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.769056] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-03T17:26:36.798279] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:36.798951] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-03T17:26:36.826087] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T17:26:36.834280] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-03T17:26:37.451636] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T17:26:37.455305] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-03T17:26:38.035392] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:26:38.040469] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-03T17:26:38.117847] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:26:38.119396] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T17:26:38.125015] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-03T17:26:38.133427] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-03T17:26:38.267175] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:26:38.270043] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-03T17:26:38.320994] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:26:38.321377] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-03T17:26:38.321473] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:26:38.321558] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-03T17:26:38.321609] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:26:38.321724] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-03T17:26:38.321802] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-03T17:26:38.321841] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-03T17:26:38.321897] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-03T17:26:38.321980] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. B took 4.7s. Estimated remaining: 4h 46m 38s. Rate: 7.6 symbols/min [2025-10-03T17:26:38.512159] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:38.576511] [DEBUG] [LOCAL ] BA: Loaded 54180 existing records from primary storage. [2025-10-03T17:26:38.576929] [INFO ] [MAIN ] BA: Loaded 54180 existing records. [2025-10-03T17:26:38.778150] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:38.778444] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-03T17:26:38.778680] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-03T17:26:38.778957] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-03T17:26:38.779028] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-03T17:26:38.903361] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T17:26:38.916684] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-03T17:26:39.197472] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:39.203582] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-03T17:26:39.216730] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:26:39.224173] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-03T17:26:39.247114] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:26:39.254727] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-03T17:26:39.852112] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:26:39.990748] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-03T17:26:40.360935] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T17:26:40.445857] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:26:40.790720] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-03T17:26:40.844954] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T17:26:41.558335] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:26:41.590638] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-03T17:26:41.667689] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T17:26:42.390691] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-03T17:26:43.190699] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-03T17:26:43.675686] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:26:43.948717] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-10-03T17:26:43.990623] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-03T17:26:44.196181] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:26:44.790695] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-03T17:26:45.590739] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-03T17:26:45.780413] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:26:46.390631] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-03T17:26:46.439856] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-03T17:26:46.617813] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:26:47.190711] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-03T17:26:47.990692] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-03T17:26:48.228826] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:26:48.325981] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T17:26:48.790724] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-03T17:26:49.338501] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T17:26:49.590686] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-03T17:26:50.390723] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-03T17:26:50.493483] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-03T17:26:50.722362] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:26:51.190728] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-03T17:26:51.596675] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:26:51.990733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-03T17:26:52.132168] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T17:26:52.790721] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-03T17:26:53.019632] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T17:26:53.485739] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T17:26:53.486802] [INFO ] [REMOTE ] AZO: Full fetch complete (16154 records). [2025-10-03T17:26:53.486876] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-03T17:26:53.595803] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-03T17:26:53.926473] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-03T17:26:53.926552] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-03T17:26:53.926851] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-03T17:26:53.926912] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-03T17:26:53.927494] [DEBUG] [LOCAL ] AZO: Trimmed 16154 records to 11424 (keeping 200 days of data) [2025-10-03T17:26:54.007149] [DEBUG] [LOCAL ] AZO: Primary data saved (11424 records). [2025-10-03T17:26:54.007289] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-03T17:26:54.007374] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AZO took 20.4s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:26:54.201671] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:26:54.261095] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-10-03T17:26:54.261435] [INFO ] [MAIN ] BABA: Loaded 54210 existing records. [2025-10-03T17:26:54.395769] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-03T17:26:54.473546] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:26:54.473850] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-03T17:26:54.473926] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-03T17:26:54.474247] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-03T17:26:54.474308] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-03T17:26:54.881688] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:26:55.190735] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-03T17:26:55.785325] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T17:26:55.990707] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-03T17:26:56.279212] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-10-03T17:26:56.790694] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-03T17:26:57.012565] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:26:57.590725] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-03T17:26:57.702738] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-10-03T17:26:58.390631] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-03T17:26:58.460210] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:26:59.117205] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T17:26:59.190750] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-03T17:26:59.990673] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-03T17:27:00.195570] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:27:00.790678] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-03T17:27:01.184717] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.79 seconds). [2025-10-03T17:27:01.590732] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-03T17:27:01.723768] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:27:01.725285] [INFO ] [REMOTE ] AZZ: Full fetch complete (30787 records). [2025-10-03T17:27:01.725367] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-03T17:27:01.726235] [FATAL] [VALIDATOR ] AZZ: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:01.726328] [FATAL] [MAIN ] AZZ: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:01.726396] [WARN ] [MAIN ] AZZ: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:01.726486] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-03T17:27:01.726569] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-10-03T17:27:01.726620] [INFO ] [LOCAL ] AZZ: Starting deletion of derivative data. [2025-10-03T17:27:01.727292] [DEBUG] [LOCAL ] AZZ: Deleted derivative data file. [2025-10-03T17:27:01.727421] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AZZ took 28.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-03T17:27:01.940173] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:01.993668] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-10-03T17:27:01.994023] [INFO ] [MAIN ] BAC: Loaded 54198 existing records. [2025-10-03T17:27:02.185815] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:02.186082] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-03T17:27:02.186134] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-03T17:27:02.186423] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-03T17:27:02.186486] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-03T17:27:02.395995] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-03T17:27:02.592143] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:02.625608] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-10-03T17:27:02.826313] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T17:27:03.190691] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-03T17:27:03.990700] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-03T17:27:04.790745] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-03T17:27:05.057912] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:27:05.115213] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-03T17:27:05.235203] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T17:27:05.590681] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-03T17:27:06.390691] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-03T17:27:07.190743] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-03T17:27:07.435751] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-03T17:27:07.990672] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-03T17:27:08.010225] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-03T17:27:08.302145] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:27:08.494856] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T17:27:08.790687] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-03T17:27:09.590692] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-03T17:27:10.391985] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-03T17:27:10.390679] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-03T17:27:11.198417] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-03T17:27:11.220756] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T17:27:11.473563] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:27:11.475317] [INFO ] [REMOTE ] AYI: Full fetch complete (36964 records). [2025-10-03T17:27:11.475402] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-03T17:27:11.476144] [FATAL] [VALIDATOR ] AYI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:11.476233] [FATAL] [MAIN ] AYI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:11.476279] [WARN ] [MAIN ] AYI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:11.476319] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-03T17:27:11.476377] [DEBUG] [LOCAL ] AYI: No primary data file found to delete. [2025-10-03T17:27:11.476423] [INFO ] [LOCAL ] AYI: Starting deletion of derivative data. [2025-10-03T17:27:11.476862] [DEBUG] [LOCAL ] AYI: Deleted derivative data file. [2025-10-03T17:27:11.476982] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AYI took 37.9s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:27:11.685777] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:11.752018] [DEBUG] [LOCAL ] BAH: Loaded 52055 existing records from primary storage. [2025-10-03T17:27:11.752405] [INFO ] [MAIN ] BAH: Loaded 52055 existing records. [2025-10-03T17:27:11.962242] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:11.962601] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-03T17:27:11.962688] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-03T17:27:11.963024] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-03T17:27:11.963093] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-03T17:27:11.996010] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-03T17:27:12.387521] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:12.421516] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-03T17:27:12.790687] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-03T17:27:13.487671] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-03T17:27:13.590679] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-03T17:27:14.390632] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-03T17:27:14.783858] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-03T17:27:14.898993] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T17:27:14.901314] [INFO ] [REMOTE ] BA: Full fetch complete (77534 records). [2025-10-03T17:27:14.901428] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-03T17:27:14.902309] [FATAL] [VALIDATOR ] BA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:27:14.902424] [FATAL] [MAIN ] BA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:27:14.902470] [WARN ] [MAIN ] BA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:27:14.902542] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-03T17:27:14.902624] [DEBUG] [LOCAL ] BA: No primary data file found to delete. [2025-10-03T17:27:14.902713] [INFO ] [LOCAL ] BA: Starting deletion of derivative data. [2025-10-03T17:27:14.903027] [DEBUG] [LOCAL ] BA: Deleted derivative data file. [2025-10-03T17:27:14.903581] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. BA took 36.6s. Estimated remaining: 4h 46m 58s. Rate: 7.5 symbols/min [2025-10-03T17:27:15.089682] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:15.134543] [DEBUG] [LOCAL ] BAK: Loaded 39471 existing records from primary storage. [2025-10-03T17:27:15.134908] [INFO ] [MAIN ] BAK: Loaded 39471 existing records. [2025-10-03T17:27:15.204522] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-03T17:27:15.329732] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:15.329985] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-03T17:27:15.330057] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-03T17:27:15.330376] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-03T17:27:15.330439] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-03T17:27:15.714708] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:15.990635] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-03T17:27:16.068446] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T17:27:16.125156] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-03T17:27:16.790705] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-03T17:27:17.590723] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-03T17:27:17.700007] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-10-03T17:27:17.867220] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:27:18.390690] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-03T17:27:19.190670] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-03T17:27:19.275799] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:27:19.387151] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T17:27:19.512834] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:27:19.990728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-03T17:27:20.790732] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-03T17:27:21.349516] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T17:27:21.590728] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-03T17:27:22.201010] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-10-03T17:27:22.390722] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-03T17:27:22.453626] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T17:27:23.058720] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T17:27:23.190730] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-03T17:27:23.990741] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-03T17:27:24.790633] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-03T17:27:24.865517] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:27:25.115772] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-10-03T17:27:25.415078] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:27:25.590725] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-03T17:27:26.390731] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-03T17:27:27.024562] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:27:27.109848] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T17:27:27.190700] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-03T17:27:27.990681] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-03T17:27:28.276712] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:27:28.542117] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:27:28.790688] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-03T17:27:29.590706] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-03T17:27:30.390706] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-03T17:27:30.469186] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:27:30.783935] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-10-03T17:27:31.195757] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-03T17:27:31.216617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:27:31.990711] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-03T17:27:32.664595] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-03T17:27:32.790718] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-03T17:27:33.583251] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T17:27:33.591775] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-03T17:27:33.878346] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.68 seconds). [2025-10-03T17:27:33.881294] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-03T17:27:33.881481] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-03T17:27:34.342564] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-03T17:27:34.342682] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-03T17:27:34.343463] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-03T17:27:34.343510] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-03T17:27:34.345156] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54600 (keeping 200 days of data) [2025-10-03T17:27:34.406529] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-03T17:27:34.618800] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:27:34.749669] [DEBUG] [LOCAL ] BABA: Primary data saved (54600 records). [2025-10-03T17:27:34.749867] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-03T17:27:34.749978] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BABA took 40.7s. Estimated remaining: 4h 48m 55s. Rate: 7.5 symbols/min [2025-10-03T17:27:34.935441] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:34.987410] [DEBUG] [LOCAL ] BALL: Loaded 52177 existing records from primary storage. [2025-10-03T17:27:34.987787] [INFO ] [MAIN ] BALL: Loaded 52177 existing records. [2025-10-03T17:27:35.192236] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-03T17:27:35.196521] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:35.197877] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-03T17:27:35.197932] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-03T17:27:35.198316] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-03T17:27:35.198376] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-03T17:27:35.612301] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:35.887351] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:27:35.990635] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-03T17:27:36.464349] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-10-03T17:27:36.790744] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-03T17:27:37.130413] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:27:37.523203] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:27:37.590724] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-03T17:27:37.957374] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T17:27:37.962954] [INFO ] [REMOTE ] BAK: Full fetch complete (57149 records). [2025-10-03T17:27:37.963184] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-03T17:27:38.395797] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-03T17:27:38.473763] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-03T17:27:38.473846] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-03T17:27:38.474506] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-03T17:27:38.474552] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-03T17:27:38.476147] [DEBUG] [LOCAL ] BAK: Trimmed 57149 records to 39773 (keeping 200 days of data) [2025-10-03T17:27:38.713871] [DEBUG] [LOCAL ] BAK: Primary data saved (39773 records). [2025-10-03T17:27:38.714629] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-03T17:27:38.715559] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAK took 23.8s. Estimated remaining: 4h 48m 5s. Rate: 7.5 symbols/min [2025-10-03T17:27:38.911117] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:38.911285] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-03T17:27:38.911324] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-03T17:27:38.911438] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-03T17:27:38.911481] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-03T17:27:38.911525] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-03T17:27:38.911560] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-03T17:27:39.200570] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-03T17:27:39.311235] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:39.377462] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T17:27:39.990698] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-03T17:27:40.200404] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T17:27:40.790755] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-03T17:27:41.359336] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:27:41.590754] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-03T17:27:41.671625] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T17:27:42.048483] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:27:42.390668] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-03T17:27:42.765610] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T17:27:43.190699] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-03T17:27:43.990724] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-03T17:27:44.730727] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-03T17:27:44.790725] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-03T17:27:44.909098] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T17:27:45.566272] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T17:27:45.570020] [INFO ] [REMOTE ] BAH: Full fetch complete (74841 records). [2025-10-03T17:27:45.570260] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-03T17:27:45.596070] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-03T17:27:46.125146] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-03T17:27:46.125250] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-03T17:27:46.126065] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-03T17:27:46.126136] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-03T17:27:46.127821] [DEBUG] [LOCAL ] BAH: Trimmed 74841 records to 52444 (keeping 200 days of data) [2025-10-03T17:27:46.391035] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-03T17:27:46.475888] [DEBUG] [LOCAL ] BAH: Primary data saved (52444 records). [2025-10-03T17:27:46.476041] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-03T17:27:46.478630] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BAH took 35.0s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-10-03T17:27:46.680042] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:46.737785] [DEBUG] [LOCAL ] BAM: Loaded 52385 existing records from primary storage. [2025-10-03T17:27:46.738230] [INFO ] [MAIN ] BAM: Loaded 52385 existing records. [2025-10-03T17:27:46.943328] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:46.943807] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-03T17:27:46.943929] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-03T17:27:46.944225] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-03T17:27:46.944290] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-03T17:27:47.071110] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-03T17:27:47.096048] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-03T17:27:47.140722] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-03T17:27:47.180688] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T17:27:47.297695] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-03T17:27:47.567927] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:47.862603] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-03T17:27:47.862725] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-03T17:27:47.863550] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-03T17:27:47.863598] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-03T17:27:47.865300] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54588 (keeping 200 days of data) [2025-10-03T17:27:47.985271] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T17:27:47.990607] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-03T17:27:48.231459] [DEBUG] [LOCAL ] BAC: Primary data saved (54588 records). [2025-10-03T17:27:48.231613] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-03T17:27:48.231729] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BAC took 46.5s. Estimated remaining: 4h 46m 42s. Rate: 7.5 symbols/min [2025-10-03T17:27:48.423574] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:27:48.461627] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:27:48.480329] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:27:48.525031] [DEBUG] [LOCAL ] BANC: Loaded 51623 existing records from primary storage. [2025-10-03T17:27:48.525423] [INFO ] [MAIN ] BANC: Loaded 51623 existing records. [2025-10-03T17:27:48.719950] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:27:48.720215] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-03T17:27:48.720306] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-03T17:27:48.720540] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-03T17:27:48.720600] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-03T17:27:48.795797] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-03T17:27:49.108717] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:27:49.441778] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:27:49.590632] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-03T17:27:50.390704] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-03T17:27:51.190706] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-03T17:27:51.304867] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:27:51.990717] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-03T17:27:52.429917] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T17:27:52.790698] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-03T17:27:52.894319] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T17:27:53.438235] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T17:27:53.590695] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-03T17:27:54.390735] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-03T17:27:54.464126] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:27:55.190708] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-03T17:27:55.418860] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T17:27:55.990686] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-03T17:27:56.055910] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:27:56.500369] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T17:27:56.790722] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-03T17:27:57.542902] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T17:27:57.590727] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-03T17:27:58.390698] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-03T17:27:58.514552] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T17:27:59.190632] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-03T17:27:59.463296] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:27:59.736027] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:27:59.990700] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-03T17:28:00.139805] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:28:00.790757] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-03T17:28:01.590676] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-03T17:28:01.684530] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:28:02.390633] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-03T17:28:02.894953] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T17:28:03.185512] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-03T17:28:03.190600] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-03T17:28:03.396895] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:28:03.990708] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-03T17:28:04.047320] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:28:04.790700] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-03T17:28:05.325319] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T17:28:05.590740] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-03T17:28:05.663344] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:28:06.390694] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-03T17:28:07.190692] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-03T17:28:07.427900] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:28:07.934795] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:28:07.990665] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-03T17:28:08.790683] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-03T17:28:08.988336] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:28:09.519017] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:28:09.560154] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:28:09.590637] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-03T17:28:10.390685] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-03T17:28:11.190694] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-03T17:28:11.384539] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:28:11.976300] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T17:28:11.977482] [INFO ] [REMOTE ] BALY: Full fetch complete (16836 records). [2025-10-03T17:28:11.977562] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-03T17:28:11.995745] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-03T17:28:12.160546] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T17:28:12.236243] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T17:28:12.236606] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:28:12.236701] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:28:12.236776] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-03T17:28:12.236846] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-03T17:28:12.236885] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-03T17:28:12.236958] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-03T17:28:12.237049] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BALY took 33.5s. Estimated remaining: 4h 49m 19s. Rate: 7.5 symbols/min [2025-10-03T17:28:12.421527] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:12.462945] [DEBUG] [LOCAL ] BAP: Loaded 26325 existing records from primary storage. [2025-10-03T17:28:12.463237] [INFO ] [MAIN ] BAP: Loaded 26325 existing records. [2025-10-03T17:28:12.653888] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:12.654122] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-03T17:28:12.654173] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-03T17:28:12.654417] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-03T17:28:12.654475] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-03T17:28:12.798866] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-03T17:28:13.032441] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:13.590668] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-03T17:28:13.746046] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T17:28:13.748955] [INFO ] [REMOTE ] BAM: Full fetch complete (74396 records). [2025-10-03T17:28:13.749094] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-03T17:28:14.235243] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-03T17:28:14.235356] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-03T17:28:14.236205] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-03T17:28:14.236272] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-03T17:28:14.237821] [DEBUG] [LOCAL ] BAM: Trimmed 74396 records to 52767 (keeping 200 days of data) [2025-10-03T17:28:14.423617] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-03T17:28:14.489036] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:28:14.493519] [INFO ] [REMOTE ] BALL: Full fetch complete (75365 records). [2025-10-03T17:28:14.494145] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-03T17:28:15.057708] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-03T17:28:15.058476] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-03T17:28:15.060116] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-03T17:28:15.060530] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-03T17:28:15.067554] [DEBUG] [LOCAL ] BALL: Trimmed 75365 records to 52561 (keeping 200 days of data) [2025-10-03T17:28:15.182261] [DEBUG] [LOCAL ] BAM: Primary data saved (52767 records). [2025-10-03T17:28:15.212444] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-03T17:28:15.216758] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T17:28:15.215009] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BAM took 28.7s. Estimated remaining: 4h 48m 19s. Rate: 7.5 symbols/min [2025-10-03T17:28:15.231259] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-03T17:28:15.547604] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:15.664256] [DEBUG] [LOCAL ] BARK: Loaded 38304 existing records from primary storage. [2025-10-03T17:28:15.667843] [INFO ] [MAIN ] BARK: Loaded 38304 existing records. [2025-10-03T17:28:15.802426] [DEBUG] [LOCAL ] BALL: Primary data saved (52561 records). [2025-10-03T17:28:15.818580] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-03T17:28:15.822442] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BALL took 41.1s. Estimated remaining: 4h 46m 56s. Rate: 7.5 symbols/min [2025-10-03T17:28:16.018838] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:16.033664] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-03T17:28:16.038976] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-03T17:28:16.044355] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-03T17:28:16.049572] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-03T17:28:16.163695] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:16.224672] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-10-03T17:28:16.256696] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-10-03T17:28:16.313823] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-03T17:28:16.325391] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-03T17:28:16.402722] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-03T17:28:16.426791] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-03T17:28:16.549433] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:28:16.667063] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-03T17:28:16.729527] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:16.742063] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:28:16.797469] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-03T17:28:17.018776] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:17.590621] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-03T17:28:17.988631] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:28:18.390942] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-03T17:28:18.390867] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:28:19.190722] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-03T17:28:19.369173] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:28:19.604457] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:28:19.990700] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-03T17:28:20.448661] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T17:28:20.790735] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-03T17:28:21.464736] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:28:21.590720] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-03T17:28:22.390639] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-03T17:28:22.546865] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T17:28:22.587333] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T17:28:23.190721] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-03T17:28:23.990711] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-03T17:28:24.061802] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:28:24.683375] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T17:28:24.790697] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-03T17:28:25.590668] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-03T17:28:25.834758] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T17:28:26.159208] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:28:26.390718] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-03T17:28:26.679714] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:28:27.190689] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-03T17:28:27.990717] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-03T17:28:28.201904] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T17:28:28.531536] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:28:28.790722] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-03T17:28:29.590719] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-03T17:28:29.619247] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:28:29.621978] [INFO ] [REMOTE ] BANC: Full fetch complete (74291 records). [2025-10-03T17:28:29.622088] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-03T17:28:30.062798] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-03T17:28:30.062975] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-03T17:28:30.078934] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-03T17:28:30.079674] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-03T17:28:30.080517] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:28:30.088453] [DEBUG] [LOCAL ] BANC: Trimmed 74291 records to 52011 (keeping 200 days of data) [2025-10-03T17:28:30.397160] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-03T17:28:30.422214] [DEBUG] [LOCAL ] BANC: Primary data saved (52011 records). [2025-10-03T17:28:30.422353] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-03T17:28:30.422439] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BANC took 42.2s. Estimated remaining: 4h 47m 55s. Rate: 7.5 symbols/min [2025-10-03T17:28:30.607457] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:30.659681] [DEBUG] [LOCAL ] BB: Loaded 53320 existing records from primary storage. [2025-10-03T17:28:30.660035] [INFO ] [MAIN ] BB: Loaded 53320 existing records. [2025-10-03T17:28:30.857815] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:30.858463] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-03T17:28:30.858579] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-03T17:28:30.858965] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-03T17:28:30.859035] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-03T17:28:31.161914] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T17:28:31.197159] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-03T17:28:31.293184] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:31.596350] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:28:31.990691] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-03T17:28:32.790682] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-03T17:28:33.048973] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:28:33.191162] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:28:33.590747] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-03T17:28:34.390755] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-03T17:28:34.456142] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:28:34.712385] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T17:28:35.190734] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-03T17:28:35.990718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-03T17:28:36.552837] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-03T17:28:36.713789] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:28:36.790724] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-03T17:28:37.005961] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T17:28:37.007810] [INFO ] [REMOTE ] BAP: Full fetch complete (37690 records). [2025-10-03T17:28:37.007957] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-03T17:28:37.610751] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-03T17:28:37.614257] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-03T17:28:37.615634] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-03T17:28:37.616689] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-03T17:28:37.616853] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-03T17:28:37.618727] [DEBUG] [LOCAL ] BAP: Trimmed 37690 records to 26537 (keeping 200 days of data) [2025-10-03T17:28:37.866639] [DEBUG] [LOCAL ] BAP: Primary data saved (26537 records). [2025-10-03T17:28:37.866867] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-03T17:28:37.866988] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 25.6s. Estimated remaining: 4h 47m 41s. Rate: 7.5 symbols/min [2025-10-03T17:28:38.145259] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:38.224581] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-10-03T17:28:38.225412] [INFO ] [MAIN ] BBAI: Loaded 54210 existing records. [2025-10-03T17:28:38.392300] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-03T17:28:38.487831] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:38.488347] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-03T17:28:38.488443] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-03T17:28:38.488898] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-03T17:28:38.488964] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-03T17:28:38.659416] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:28:38.946679] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:39.190687] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-03T17:28:39.409966] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:28:39.607202] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:28:39.990703] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-03T17:28:40.790760] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-03T17:28:41.590718] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-03T17:28:41.838519] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-10-03T17:28:41.892617] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T17:28:42.032697] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:28:42.390722] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-03T17:28:42.970110] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:28:43.190734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-03T17:28:43.990635] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-03T17:28:44.328172] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:28:44.790713] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-03T17:28:45.186177] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T17:28:45.590734] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-03T17:28:45.994868] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:28:46.390631] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-03T17:28:46.717782] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T17:28:46.742190] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T17:28:46.744336] [INFO ] [REMOTE ] BARK: Full fetch complete (56252 records). [2025-10-03T17:28:46.744455] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-03T17:28:47.151669] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-03T17:28:47.151785] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-03T17:28:47.152384] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-03T17:28:47.152428] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-03T17:28:47.153759] [DEBUG] [LOCAL ] BARK: Trimmed 56252 records to 38579 (keeping 200 days of data) [2025-10-03T17:28:47.201541] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-03T17:28:47.383882] [DEBUG] [LOCAL ] BARK: Primary data saved (38579 records). [2025-10-03T17:28:47.384035] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-03T17:28:47.384887] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BARK took 32.2s. Estimated remaining: 4h 47m 48s. Rate: 7.5 symbols/min [2025-10-03T17:28:47.565790] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:47.616296] [DEBUG] [LOCAL ] BBAR: Loaded 41882 existing records from primary storage. [2025-10-03T17:28:47.616711] [INFO ] [MAIN ] BBAR: Loaded 41882 existing records. [2025-10-03T17:28:47.811718] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:47.812007] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-03T17:28:47.812064] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-03T17:28:47.812364] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-03T17:28:47.812425] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-03T17:28:48.008865] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-03T17:28:48.200517] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:48.344434] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T17:28:48.540098] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T17:28:48.790726] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-03T17:28:49.590734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-03T17:28:50.392530] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T17:28:50.390669] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-03T17:28:50.501543] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:28:51.190695] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-03T17:28:51.285335] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:28:51.917332] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T17:28:51.923588] [INFO ] [REMOTE ] BAX: Full fetch complete (77442 records). [2025-10-03T17:28:51.923800] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-03T17:28:51.995812] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-03T17:28:52.355441] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-03T17:28:52.355535] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-03T17:28:52.356487] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-03T17:28:52.356560] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-03T17:28:52.358270] [DEBUG] [LOCAL ] BAX: Trimmed 77442 records to 54272 (keeping 200 days of data) [2025-10-03T17:28:52.707164] [DEBUG] [LOCAL ] BAX: Primary data saved (54272 records). [2025-10-03T17:28:52.707329] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-03T17:28:52.707442] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BAX took 36.9s. Estimated remaining: 4h 47m 14s. Rate: 7.5 symbols/min [2025-10-03T17:28:52.806028] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-03T17:28:52.896807] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:28:52.947956] [DEBUG] [LOCAL ] BBD: Loaded 53587 existing records from primary storage. [2025-10-03T17:28:52.948328] [INFO ] [MAIN ] BBD: Loaded 53587 existing records. [2025-10-03T17:28:53.133165] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:28:53.133441] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-03T17:28:53.133489] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-03T17:28:53.135285] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-03T17:28:53.135347] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-03T17:28:53.517201] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:28:53.590629] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-03T17:28:53.776939] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-03T17:28:54.042228] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T17:28:54.390700] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-03T17:28:54.533779] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:28:55.190687] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-03T17:28:55.586269] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:28:55.990690] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-03T17:28:56.223380] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:28:56.583586] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:28:56.790704] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-03T17:28:57.590698] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-03T17:28:58.390705] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-03T17:28:58.539090] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-03T17:28:58.623622] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:28:58.983008] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:28:59.190739] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-03T17:28:59.662499] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T17:28:59.990698] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-03T17:29:00.790706] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-03T17:29:01.096738] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T17:29:01.590636] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-03T17:29:01.910598] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:29:02.390679] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-03T17:29:02.429233] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:29:03.190731] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-03T17:29:03.650697] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-03T17:29:03.653635] [INFO ] [REMOTE ] BB: Full fetch complete (76998 records). [2025-10-03T17:29:03.653820] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-03T17:29:03.998682] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-03T17:29:04.140225] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-03T17:29:04.140417] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-03T17:29:04.141355] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-03T17:29:04.141482] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-03T17:29:04.143851] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:29:04.155558] [DEBUG] [LOCAL ] BB: Trimmed 76998 records to 53710 (keeping 200 days of data) [2025-10-03T17:29:04.485089] [DEBUG] [LOCAL ] BB: Primary data saved (53710 records). [2025-10-03T17:29:04.485260] [INFO ] [MAIN ] BB: Full history saved. [2025-10-03T17:29:04.485385] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BB took 34.1s. Estimated remaining: 4h 47m 43s. Rate: 7.5 symbols/min [2025-10-03T17:29:04.673004] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:04.673172] [DEBUG] [LOCAL ] BBDC: No existing data file found in primary storage. [2025-10-03T17:29:04.673210] [WARN ] [MAIN ] BBDC: No existing data found, performing full refresh instead. [2025-10-03T17:29:04.673333] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-03T17:29:04.673377] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-03T17:29:04.673420] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-03T17:29:04.673454] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-03T17:29:04.795780] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-03T17:29:05.074256] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:05.590726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-03T17:29:05.932303] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:29:06.391725] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-03T17:29:06.410033] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (3.22 seconds). [2025-10-03T17:29:06.448441] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:29:07.131301] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:29:07.190688] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-03T17:29:07.990633] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-03T17:29:08.107349] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T17:29:08.729943] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:29:08.790684] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-03T17:29:09.029015] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:29:09.590683] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-03T17:29:10.344857] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:29:10.390638] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-03T17:29:10.485967] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:29:11.190686] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-03T17:29:11.990730] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-03T17:29:12.614229] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T17:29:12.723970] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-10-03T17:29:12.790705] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-03T17:29:13.375562] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:29:13.590722] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-03T17:29:14.285167] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T17:29:14.390709] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-03T17:29:15.190776] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-03T17:29:15.990667] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-03T17:29:16.095968] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:29:16.514876] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.92 seconds). [2025-10-03T17:29:16.719577] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:29:16.790726] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-03T17:29:17.049879] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T17:29:17.590729] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-03T17:29:18.390681] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-03T17:29:18.701847] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T17:29:18.770234] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T17:29:18.772860] [INFO ] [REMOTE ] BBAR: Full fetch complete (61020 records). [2025-10-03T17:29:18.773011] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-03T17:29:19.194872] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-03T17:29:19.195738] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-03T17:29:19.196774] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-03T17:29:19.197711] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-03T17:29:19.197958] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-03T17:29:19.200182] [DEBUG] [LOCAL ] BBAR: Trimmed 61020 records to 42223 (keeping 200 days of data) [2025-10-03T17:29:19.481815] [DEBUG] [LOCAL ] BBAR: Primary data saved (42223 records). [2025-10-03T17:29:19.481963] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-03T17:29:19.482068] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BBAR took 32.1s. Estimated remaining: 4h 48m 44s. Rate: 7.5 symbols/min [2025-10-03T17:29:19.712253] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:19.712513] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-03T17:29:19.712722] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-03T17:29:19.712966] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-03T17:29:19.713170] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-03T17:29:19.713352] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-03T17:29:19.713410] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-03T17:29:19.869095] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:29:19.996440] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-03T17:29:20.172139] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:20.790709] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-03T17:29:20.998236] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T17:29:21.264613] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:29:21.590629] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-03T17:29:21.669957] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T17:29:22.390708] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-03T17:29:23.190722] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-03T17:29:23.683820] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T17:29:23.889446] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T17:29:23.990722] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-03T17:29:24.702848] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T17:29:24.704846] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T17:29:24.790726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-03T17:29:25.590700] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-03T17:29:26.121034] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:29:26.390728] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-03T17:29:27.190741] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-03T17:29:27.675852] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:29:27.678348] [INFO ] [REMOTE ] BBDC: Full fetch complete (48637 records). [2025-10-03T17:29:27.678506] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-03T17:29:27.817799] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T17:29:27.995837] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-03T17:29:28.189845] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-03T17:29:28.189957] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-03T17:29:28.190815] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-03T17:29:28.190940] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-03T17:29:28.192560] [DEBUG] [LOCAL ] BBDC: Trimmed 48637 records to 33442 (keeping 200 days of data) [2025-10-03T17:29:28.317238] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-10-03T17:29:28.447505] [DEBUG] [LOCAL ] BBDC: Primary data saved (33442 records). [2025-10-03T17:29:28.447754] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-03T17:29:28.447850] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBDC took 24.0s. Estimated remaining: 4h 48m 45s. Rate: 7.4 symbols/min [2025-10-03T17:29:28.633403] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:28.654407] [DEBUG] [LOCAL ] BBN: Loaded 18177 existing records from primary storage. [2025-10-03T17:29:28.654740] [INFO ] [MAIN ] BBN: Loaded 18177 existing records. [2025-10-03T17:29:28.804299] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-03T17:29:28.852355] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:28.852612] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-03T17:29:28.852698] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-03T17:29:28.853623] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-03T17:29:28.853712] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-03T17:29:29.243825] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:29.377473] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:29:29.590682] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-03T17:29:29.660052] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T17:29:29.663852] [INFO ] [REMOTE ] BBD: Full fetch complete (77113 records). [2025-10-03T17:29:29.664045] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-03T17:29:30.176702] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-03T17:29:30.176842] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-03T17:29:30.178387] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-03T17:29:30.178485] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-03T17:29:30.180738] [DEBUG] [LOCAL ] BBD: Trimmed 77113 records to 53976 (keeping 200 days of data) [2025-10-03T17:29:30.323937] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-03T17:29:30.445383] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-03T17:29:30.665632] [DEBUG] [LOCAL ] BBD: Primary data saved (53976 records). [2025-10-03T17:29:30.665852] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-03T17:29:30.665959] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBD took 38.0s. Estimated remaining: 4h 47m 40s. Rate: 7.5 symbols/min [2025-10-03T17:29:30.904370] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:30.904556] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-03T17:29:30.904599] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-03T17:29:30.904750] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-03T17:29:30.904798] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-03T17:29:30.904871] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-03T17:29:30.904920] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-03T17:29:31.200340] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-03T17:29:31.333571] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:31.854716] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T17:29:31.980504] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:29:31.990618] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-03T17:29:32.614117] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:29:32.790726] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-03T17:29:33.590727] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-03T17:29:34.390753] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-03T17:29:34.937613] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T17:29:35.042862] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T17:29:35.190729] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-03T17:29:35.303394] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-03T17:29:35.306418] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-03T17:29:35.306535] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-03T17:29:35.501513] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:29:35.559631] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-03T17:29:35.596337] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:29:35.609402] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-03T17:29:35.638918] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:29:35.639104] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-03T17:29:35.639566] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-03T17:29:35.650291] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-03T17:29:35.671203] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-03T17:29:35.693998] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBT took 5.0s. Estimated remaining: 4h 47m 3s. Rate: 7.5 symbols/min [2025-10-03T17:29:35.782492] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-03T17:29:35.829053] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-03T17:29:35.842418] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-03T17:29:35.849405] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-03T17:29:35.944909] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-03T17:29:35.948603] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:35.949318] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-10-03T17:29:35.949414] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-10-03T17:29:35.949605] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-03T17:29:35.949993] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-03T17:29:35.950147] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-03T17:29:35.950214] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-03T17:29:36.031399] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-03T17:29:36.475587] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:36.699185] [DEBUG] [LOCAL ] BBAI: Primary data saved (54600 records). [2025-10-03T17:29:36.699345] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-03T17:29:36.699916] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBAI took 58.8s. Estimated remaining: 4h 45m 47s. Rate: 7.5 symbols/min [2025-10-03T17:29:36.795829] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-03T17:29:36.895031] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:36.895310] [DEBUG] [LOCAL ] BBUC: No existing data file found in primary storage. [2025-10-03T17:29:36.895366] [WARN ] [MAIN ] BBUC: No existing data found, performing full refresh instead. [2025-10-03T17:29:36.895480] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-03T17:29:36.895524] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-03T17:29:36.895567] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-03T17:29:36.895601] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-03T17:29:37.231210] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T17:29:37.330869] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:37.546679] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:29:37.590710] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-03T17:29:38.147227] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T17:29:38.390747] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-03T17:29:39.190683] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-03T17:29:39.449878] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:29:39.990680] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-03T17:29:40.057265] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:29:40.790745] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-03T17:29:41.041742] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:29:41.397900] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T17:29:41.590730] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-03T17:29:42.214822] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:29:42.390721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-03T17:29:42.938187] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T17:29:43.190741] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-03T17:29:43.990702] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-03T17:29:44.173469] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T17:29:44.519884] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:29:44.790730] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-03T17:29:45.590636] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-03T17:29:45.972594] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T17:29:46.146422] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:29:46.390720] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-03T17:29:47.192235] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-03T17:29:47.194051] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:29:47.990675] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-03T17:29:48.131272] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:29:48.515561] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T17:29:48.516499] [INFO ] [REMOTE ] BBDO: Full fetch complete (7653 records). [2025-10-03T17:29:48.516603] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-03T17:29:48.795758] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-03T17:29:48.918436] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-03T17:29:48.918525] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-03T17:29:48.918760] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-03T17:29:48.918825] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-03T17:29:48.919327] [DEBUG] [LOCAL ] BBDO: Trimmed 7653 records to 5032 (keeping 200 days of data) [2025-10-03T17:29:48.953808] [DEBUG] [LOCAL ] BBDO: Primary data saved (5032 records). [2025-10-03T17:29:48.953973] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-03T17:29:48.954062] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBDO took 29.5s. Estimated remaining: 4h 46m 20s. Rate: 7.5 symbols/min [2025-10-03T17:29:49.162303] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:49.221376] [DEBUG] [LOCAL ] BBVA: Loaded 49642 existing records from primary storage. [2025-10-03T17:29:49.221780] [INFO ] [MAIN ] BBVA: Loaded 49642 existing records. [2025-10-03T17:29:49.416940] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:49.417166] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-03T17:29:49.417216] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-03T17:29:49.417897] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-03T17:29:49.417963] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-03T17:29:49.601385] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-03T17:29:49.814760] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:49.842512] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:29:50.390679] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-03T17:29:50.755120] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T17:29:50.880094] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:29:51.190683] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-03T17:29:51.623477] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T17:29:51.990697] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-03T17:29:52.790673] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-03T17:29:53.101237] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:29:53.494915] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T17:29:53.590703] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-03T17:29:54.390721] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-03T17:29:55.012558] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T17:29:55.190674] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-03T17:29:55.364616] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:29:55.990697] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-03T17:29:56.005792] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T17:29:56.720491] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:29:56.790725] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-03T17:29:57.590723] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-03T17:29:57.901301] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T17:29:58.259766] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T17:29:58.260902] [INFO ] [REMOTE ] BBU: Full fetch complete (6767 records). [2025-10-03T17:29:58.260975] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-03T17:29:58.395866] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-03T17:29:58.695508] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-03T17:29:58.695589] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-03T17:29:58.695838] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-03T17:29:58.695916] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-03T17:29:58.696508] [DEBUG] [LOCAL ] BBU: Trimmed 6767 records to 4913 (keeping 200 days of data) [2025-10-03T17:29:58.729211] [DEBUG] [LOCAL ] BBU: Primary data saved (4913 records). [2025-10-03T17:29:58.729345] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-03T17:29:58.729426] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBU took 23.0s. Estimated remaining: 4h 46m 29s. Rate: 7.5 symbols/min [2025-10-03T17:29:58.928167] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:29:58.956199] [DEBUG] [LOCAL ] BBW: Loaded 26905 existing records from primary storage. [2025-10-03T17:29:58.956472] [INFO ] [MAIN ] BBW: Loaded 26905 existing records. [2025-10-03T17:29:59.158103] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:29:59.158323] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-03T17:29:59.158373] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-03T17:29:59.158620] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-03T17:29:59.158703] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-03T17:29:59.195751] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-03T17:29:59.550395] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:29:59.588685] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:29:59.990680] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-03T17:30:00.790688] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-03T17:30:00.964983] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:30:01.293424] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:30:01.590731] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-03T17:30:02.390705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-03T17:30:02.964333] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-03T17:30:02.965900] [INFO ] [REMOTE ] BBN: Full fetch complete (26356 records). [2025-10-03T17:30:02.965980] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-03T17:30:02.966468] [FATAL] [VALIDATOR ] BBN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:02.966560] [FATAL] [MAIN ] BBN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:02.966628] [WARN ] [MAIN ] BBN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:02.966721] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-03T17:30:02.966804] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-03T17:30:02.966876] [INFO ] [LOCAL ] BBN: Starting deletion of derivative data. [2025-10-03T17:30:02.967301] [DEBUG] [LOCAL ] BBN: Deleted derivative data file. [2025-10-03T17:30:02.967441] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBN took 34.5s. Estimated remaining: 4h 45m 45s. Rate: 7.5 symbols/min [2025-10-03T17:30:03.164837] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:03.199225] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-03T17:30:03.225861] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-10-03T17:30:03.226234] [INFO ] [MAIN ] BBWI: Loaded 53970 existing records. [2025-10-03T17:30:03.426224] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:03.426547] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-03T17:30:03.426749] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-03T17:30:03.436854] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-03T17:30:03.454180] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-03T17:30:03.461619] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:30:03.884230] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:03.900628] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:30:03.990605] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-03T17:30:04.074118] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:30:04.790692] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-03T17:30:05.200321] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:30:05.590697] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-03T17:30:05.648485] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T17:30:06.390731] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-03T17:30:06.654191] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T17:30:07.190708] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-03T17:30:07.990618] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-03T17:30:08.197158] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T17:30:08.571528] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T17:30:08.790718] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-03T17:30:09.590692] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-03T17:30:10.011025] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:30:10.343372] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:30:10.390695] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-03T17:30:10.494497] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T17:30:11.190709] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-03T17:30:11.830290] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T17:30:11.990751] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-03T17:30:12.790636] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-03T17:30:13.112081] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:30:13.236889] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-03T17:30:13.362099] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T17:30:13.590688] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-03T17:30:14.390730] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-03T17:30:14.595897] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:30:14.597294] [INFO ] [REMOTE ] BBUC: Full fetch complete (18245 records). [2025-10-03T17:30:14.597370] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-03T17:30:15.000134] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-03T17:30:15.000229] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-03T17:30:15.000563] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-03T17:30:15.000610] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-03T17:30:15.001322] [DEBUG] [LOCAL ] BBUC: Trimmed 18245 records to 13645 (keeping 200 days of data) [2025-10-03T17:30:15.106492] [DEBUG] [LOCAL ] BBUC: Primary data saved (13645 records). [2025-10-03T17:30:15.106676] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-03T17:30:15.106848] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBUC took 38.4s. Estimated remaining: 4h 46m 16s. Rate: 7.5 symbols/min [2025-10-03T17:30:15.195818] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-03T17:30:15.298164] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:15.366258] [DEBUG] [LOCAL ] BBY: Loaded 53854 existing records from primary storage. [2025-10-03T17:30:15.366601] [INFO ] [MAIN ] BBY: Loaded 53854 existing records. [2025-10-03T17:30:15.561450] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:15.561743] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-03T17:30:15.561823] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-03T17:30:15.562173] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-03T17:30:15.562234] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-03T17:30:15.953413] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:15.990676] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-03T17:30:16.118834] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:30:16.790729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-03T17:30:17.314250] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:30:17.590677] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-03T17:30:17.689613] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:30:18.390718] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-03T17:30:18.477740] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T17:30:19.001707] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:30:19.190735] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-03T17:30:19.990715] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-03T17:30:20.413690] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:30:20.790721] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-03T17:30:20.941503] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T17:30:21.438532] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:30:21.590739] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-03T17:30:22.281471] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T17:30:22.390729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-03T17:30:22.821187] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:30:22.823322] [INFO ] [REMOTE ] BBW: Full fetch complete (39012 records). [2025-10-03T17:30:22.823467] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-03T17:30:22.824115] [FATAL] [VALIDATOR ] BBW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:22.824206] [FATAL] [MAIN ] BBW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:22.824253] [WARN ] [MAIN ] BBW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:22.824302] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-03T17:30:22.824363] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-10-03T17:30:22.824403] [INFO ] [LOCAL ] BBW: Starting deletion of derivative data. [2025-10-03T17:30:22.824773] [DEBUG] [LOCAL ] BBW: Deleted derivative data file. [2025-10-03T17:30:22.824886] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBW took 24.1s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-03T17:30:23.022858] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:23.076408] [DEBUG] [LOCAL ] BC: Loaded 44455 existing records from primary storage. [2025-10-03T17:30:23.076800] [INFO ] [MAIN ] BC: Loaded 44455 existing records. [2025-10-03T17:30:23.195747] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-03T17:30:23.281069] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:23.281374] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-03T17:30:23.281463] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-03T17:30:23.281962] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-03T17:30:23.282023] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-03T17:30:23.712323] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:23.990673] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-03T17:30:24.252825] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T17:30:24.790718] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-03T17:30:24.871362] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:30:25.590748] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-03T17:30:25.723153] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T17:30:26.381323] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:30:26.393123] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-03T17:30:26.920309] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T17:30:27.190726] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-03T17:30:27.990683] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-03T17:30:28.028678] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T17:30:28.790771] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-03T17:30:29.179198] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:30:29.295973] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T17:30:29.590746] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-03T17:30:30.390759] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-03T17:30:30.734310] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:30:31.195869] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-03T17:30:31.216439] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:30:31.678795] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T17:30:31.680797] [INFO ] [REMOTE ] BBVA: Full fetch complete (71253 records). [2025-10-03T17:30:31.680919] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-03T17:30:31.681932] [FATAL] [VALIDATOR ] BBVA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:30:31.682032] [FATAL] [MAIN ] BBVA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:30:31.682080] [WARN ] [MAIN ] BBVA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:30:31.682153] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-03T17:30:31.682247] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-03T17:30:31.682305] [INFO ] [LOCAL ] BBVA: Starting deletion of derivative data. [2025-10-03T17:30:31.682594] [DEBUG] [LOCAL ] BBVA: Deleted derivative data file. [2025-10-03T17:30:31.683811] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBVA took 42.7s. Estimated remaining: 4h 46m 5s. Rate: 7.5 symbols/min [2025-10-03T17:30:31.869151] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:31.869384] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-10-03T17:30:31.869442] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-10-03T17:30:31.869561] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-03T17:30:31.869696] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-03T17:30:31.869769] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-03T17:30:31.869807] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-03T17:30:31.996806] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-03T17:30:32.326585] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:32.790755] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-03T17:30:32.793279] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:30:33.590632] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-03T17:30:34.025980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T17:30:34.390719] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-03T17:30:34.505206] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:30:35.190727] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-03T17:30:35.270840] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T17:30:35.910846] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T17:30:35.990696] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-03T17:30:36.790671] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-03T17:30:37.125099] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T17:30:37.595956] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-03T17:30:37.611516] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:30:37.907169] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:30:38.390732] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-03T17:30:39.012024] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:30:39.190737] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-03T17:30:39.890420] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T17:30:39.990761] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-03T17:30:40.627772] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T17:30:40.790727] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-03T17:30:41.590771] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-03T17:30:41.819578] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T17:30:42.113535] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:30:42.390699] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-03T17:30:43.190636] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-03T17:30:43.497940] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T17:30:43.802351] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:30:43.990695] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-03T17:30:44.584037] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T17:30:44.588172] [INFO ] [REMOTE ] BBY: Full fetch complete (77237 records). [2025-10-03T17:30:44.588410] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-03T17:30:44.794157] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-03T17:30:45.034814] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-03T17:30:45.034910] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-03T17:30:45.035851] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-03T17:30:45.035934] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-03T17:30:45.037856] [DEBUG] [LOCAL ] BBY: Trimmed 77237 records to 54237 (keeping 200 days of data) [2025-10-03T17:30:45.394024] [DEBUG] [LOCAL ] BBY: Primary data saved (54237 records). [2025-10-03T17:30:45.394309] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-03T17:30:45.395856] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBY took 30.3s. Estimated remaining: 4h 46m 51s. Rate: 7.5 symbols/min [2025-10-03T17:30:45.580549] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:45.590695] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-03T17:30:45.618077] [DEBUG] [LOCAL ] BCC: Loaded 28408 existing records from primary storage. [2025-10-03T17:30:45.618440] [INFO ] [MAIN ] BCC: Loaded 28408 existing records. [2025-10-03T17:30:45.836416] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:45.836937] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-03T17:30:45.837108] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-03T17:30:45.837494] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-03T17:30:45.837562] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-03T17:30:46.199827] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-03T17:30:46.312537] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:46.390715] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-03T17:30:46.440056] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T17:30:47.190706] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-03T17:30:47.262054] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:30:47.990770] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-03T17:30:47.991157] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:30:47.995062] [INFO ] [REMOTE ] BBWI: Full fetch complete (77433 records). [2025-10-03T17:30:47.995219] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-03T17:30:48.446345] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-03T17:30:48.446439] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-03T17:30:48.447420] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-03T17:30:48.465469] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-03T17:30:48.470105] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:30:48.479301] [DEBUG] [LOCAL ] BBWI: Trimmed 77433 records to 54360 (keeping 200 days of data) [2025-10-03T17:30:48.807813] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-03T17:30:48.836028] [DEBUG] [LOCAL ] BBWI: Primary data saved (54360 records). [2025-10-03T17:30:48.836195] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-03T17:30:48.836316] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BBWI took 45.9s. Estimated remaining: 4h 45m 60s. Rate: 7.5 symbols/min [2025-10-03T17:30:49.021549] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:30:49.076823] [DEBUG] [LOCAL ] BCE: Loaded 52641 existing records from primary storage. [2025-10-03T17:30:49.077240] [INFO ] [MAIN ] BCE: Loaded 52641 existing records. [2025-10-03T17:30:49.280205] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:30:49.280567] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-03T17:30:49.280633] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-03T17:30:49.280939] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-03T17:30:49.280998] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-03T17:30:49.592915] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-03T17:30:49.695398] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:30:49.728418] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:30:50.329033] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T17:30:50.390705] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-03T17:30:50.913423] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T17:30:51.190714] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-03T17:30:51.990735] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-03T17:30:52.210812] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:30:52.790709] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-03T17:30:52.820262] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T17:30:52.856078] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:30:53.590684] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-03T17:30:54.390724] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-03T17:30:54.775560] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:30:55.092801] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T17:30:55.190698] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-03T17:30:55.839300] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:30:55.990702] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-03T17:30:56.529713] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T17:30:56.790695] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-03T17:30:57.190732] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T17:30:57.590698] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-03T17:30:58.345188] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:30:58.390721] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-03T17:30:58.533478] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T17:30:59.190689] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-03T17:30:59.652019] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:30:59.990687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-03T17:31:00.395681] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T17:31:00.790696] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-03T17:31:01.590717] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-03T17:31:01.715781] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:31:02.390693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-03T17:31:02.493530] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:31:02.850229] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:31:03.190733] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-03T17:31:03.990731] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-03T17:31:04.521959] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:31:04.790686] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-03T17:31:04.844422] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-10-03T17:31:05.324493] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:31:05.326633] [INFO ] [REMOTE ] BCAT: Full fetch complete (50123 records). [2025-10-03T17:31:05.326770] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-03T17:31:05.599764] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-03T17:31:05.826114] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-03T17:31:05.826207] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-03T17:31:05.826913] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-03T17:31:05.826979] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-03T17:31:05.828180] [DEBUG] [LOCAL ] BCAT: Trimmed 50123 records to 34696 (keeping 200 days of data) [2025-10-03T17:31:06.056823] [DEBUG] [LOCAL ] BCAT: Primary data saved (34696 records). [2025-10-03T17:31:06.056973] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-03T17:31:06.057058] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BCAT took 34.4s. Estimated remaining: 4h 47m 17s. Rate: 7.4 symbols/min [2025-10-03T17:31:06.257823] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:06.279098] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T17:31:06.315005] [DEBUG] [LOCAL ] BCH: Loaded 29843 existing records from primary storage. [2025-10-03T17:31:06.315450] [INFO ] [MAIN ] BCH: Loaded 29843 existing records. [2025-10-03T17:31:06.401739] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-03T17:31:06.524053] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:06.524297] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-03T17:31:06.524349] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-03T17:31:06.524705] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-03T17:31:06.524784] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-03T17:31:06.930144] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:06.943534] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:31:06.945763] [INFO ] [REMOTE ] BC: Full fetch complete (63785 records). [2025-10-03T17:31:06.945894] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-03T17:31:07.198015] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-03T17:31:07.401829] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-03T17:31:07.401915] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-03T17:31:07.402624] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-03T17:31:07.402709] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-03T17:31:07.404216] [DEBUG] [LOCAL ] BC: Trimmed 63785 records to 44767 (keeping 200 days of data) [2025-10-03T17:31:07.703015] [DEBUG] [LOCAL ] BC: Primary data saved (44767 records). [2025-10-03T17:31:07.703153] [INFO ] [MAIN ] BC: Full history saved. [2025-10-03T17:31:07.703266] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BC took 44.9s. Estimated remaining: 4h 46m 10s. Rate: 7.5 symbols/min [2025-10-03T17:31:07.898951] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:07.931182] [DEBUG] [LOCAL ] BCO: Loaded 26183 existing records from primary storage. [2025-10-03T17:31:07.931462] [INFO ] [MAIN ] BCO: Loaded 26183 existing records. [2025-10-03T17:31:07.995803] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-03T17:31:08.145921] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:08.146402] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-03T17:31:08.146535] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-03T17:31:08.146997] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-03T17:31:08.147126] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-03T17:31:08.363247] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:31:08.645502] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:08.647544] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T17:31:08.790720] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-03T17:31:09.442071] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:31:09.590718] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-03T17:31:10.390707] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-03T17:31:10.535679] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:31:10.674512] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:31:11.190687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-03T17:31:11.483276] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:31:11.485285] [INFO ] [REMOTE ] BCC: Full fetch complete (40790 records). [2025-10-03T17:31:11.485391] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-03T17:31:11.915505] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-03T17:31:11.915600] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-03T17:31:11.916202] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-03T17:31:11.916291] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-03T17:31:11.917776] [DEBUG] [LOCAL ] BCC: Trimmed 40790 records to 28698 (keeping 200 days of data) [2025-10-03T17:31:11.996904] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-03T17:31:12.116693] [DEBUG] [LOCAL ] BCC: Primary data saved (28698 records). [2025-10-03T17:31:12.116838] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-03T17:31:12.116927] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BCC took 26.7s. Estimated remaining: 4h 45m 29s. Rate: 7.5 symbols/min [2025-10-03T17:31:12.306784] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:12.367522] [DEBUG] [LOCAL ] BCS: Loaded 53841 existing records from primary storage. [2025-10-03T17:31:12.367928] [INFO ] [MAIN ] BCS: Loaded 53841 existing records. [2025-10-03T17:31:12.555855] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:12.556070] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-03T17:31:12.556120] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-03T17:31:12.556570] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-03T17:31:12.556630] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-03T17:31:12.801022] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-03T17:31:12.975806] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:13.007980] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:31:13.208378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:31:13.590689] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-03T17:31:14.133072] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:31:14.390693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-03T17:31:15.190722] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-03T17:31:15.655237] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T17:31:15.713221] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T17:31:15.990916] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-03T17:31:16.029986] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T17:31:16.790735] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-03T17:31:17.590673] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-03T17:31:17.825858] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:31:18.390736] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-03T17:31:18.613134] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:31:18.769858] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T17:31:19.190680] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-03T17:31:19.538135] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:31:19.990724] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-03T17:31:20.532785] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T17:31:20.790711] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-03T17:31:21.590719] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-03T17:31:21.729831] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T17:31:22.390726] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-03T17:31:22.829084] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T17:31:22.934531] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T17:31:23.190693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-03T17:31:23.615828] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:31:23.990686] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-03T17:31:24.790697] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-03T17:31:24.861090] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T17:31:24.863975] [INFO ] [REMOTE ] BCE: Full fetch complete (75992 records). [2025-10-03T17:31:24.864145] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-03T17:31:25.298832] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-03T17:31:25.298987] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-03T17:31:25.299890] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-03T17:31:25.299978] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-03T17:31:25.301781] [DEBUG] [LOCAL ] BCE: Trimmed 75992 records to 52991 (keeping 200 days of data) [2025-10-03T17:31:25.436182] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:31:25.617964] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-03T17:31:25.666584] [DEBUG] [LOCAL ] BCE: Primary data saved (52991 records). [2025-10-03T17:31:25.666762] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-03T17:31:25.666857] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCE took 36.8s. Estimated remaining: 4h 46m 11s. Rate: 7.5 symbols/min [2025-10-03T17:31:25.880267] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:25.909721] [DEBUG] [LOCAL ] BCSF: Loaded 27982 existing records from primary storage. [2025-10-03T17:31:25.910000] [INFO ] [MAIN ] BCSF: Loaded 27982 existing records. [2025-10-03T17:31:26.106721] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:26.106979] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-03T17:31:26.107037] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-03T17:31:26.107515] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-03T17:31:26.107576] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-03T17:31:26.395862] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-03T17:31:26.490709] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:26.861603] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-03T17:31:27.013188] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T17:31:27.190727] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-03T17:31:27.990721] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-03T17:31:28.051202] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T17:31:28.374856] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T17:31:28.790717] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-03T17:31:29.395900] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T17:31:29.590719] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-03T17:31:30.390628] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-03T17:31:30.697231] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:31:30.957330] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T17:31:31.190721] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-03T17:31:31.703490] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:31:31.990745] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-03T17:31:32.171278] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:31:32.175625] [INFO ] [REMOTE ] BCH: Full fetch complete (40935 records). [2025-10-03T17:31:32.175848] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-03T17:31:32.705532] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-03T17:31:32.705712] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-03T17:31:32.706629] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-03T17:31:32.706749] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-03T17:31:32.708480] [DEBUG] [LOCAL ] BCH: Trimmed 40935 records to 30138 (keeping 200 days of data) [2025-10-03T17:31:32.814537] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-03T17:31:32.922830] [DEBUG] [LOCAL ] BCH: Primary data saved (30138 records). [2025-10-03T17:31:32.922995] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-03T17:31:32.923091] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCH took 26.9s. Estimated remaining: 4h 45m 56s. Rate: 7.5 symbols/min [2025-10-03T17:31:33.141437] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:31:33.146250] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:33.175471] [DEBUG] [LOCAL ] BCX: Loaded 21876 existing records from primary storage. [2025-10-03T17:31:33.175803] [INFO ] [MAIN ] BCX: Loaded 21876 existing records. [2025-10-03T17:31:33.381602] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:31:33.381902] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-03T17:31:33.381961] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-03T17:31:33.382228] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-03T17:31:33.382289] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-03T17:31:33.596292] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-03T17:31:33.809048] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:34.390706] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-03T17:31:34.733389] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:31:35.182882] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:31:35.190609] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-03T17:31:35.874210] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T17:31:35.990715] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-03T17:31:36.530751] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:31:36.790704] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-03T17:31:37.389267] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:31:37.590716] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-03T17:31:37.934818] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:31:38.390708] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-03T17:31:38.851585] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T17:31:39.190755] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-03T17:31:39.588975] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:31:39.855603] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T17:31:39.991035] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-03T17:31:40.790744] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-03T17:31:41.205507] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T17:31:41.590711] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-03T17:31:41.863031] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:31:42.390731] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-03T17:31:43.190776] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-03T17:31:43.561001] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T17:31:43.591904] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:31:43.990709] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-03T17:31:44.397349] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:31:44.790691] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-03T17:31:45.590725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-03T17:31:45.824062] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:31:46.195843] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:31:46.390734] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-03T17:31:46.882230] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T17:31:47.190670] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-03T17:31:47.531715] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T17:31:47.990694] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-03T17:31:48.790668] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-03T17:31:48.869126] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:31:48.871067] [INFO ] [REMOTE ] BCSF: Full fetch complete (38569 records). [2025-10-03T17:31:48.871158] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-03T17:31:49.304166] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-03T17:31:49.304308] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-03T17:31:49.305023] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-03T17:31:49.305262] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-03T17:31:49.338281] [DEBUG] [LOCAL ] BCSF: Trimmed 38569 records to 28192 (keeping 200 days of data) [2025-10-03T17:31:49.340717] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T17:31:49.536686] [DEBUG] [LOCAL ] BCSF: Primary data saved (28192 records). [2025-10-03T17:31:49.536832] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-03T17:31:49.536980] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCSF took 23.9s. Estimated remaining: 4h 47m 6s. Rate: 7.4 symbols/min [2025-10-03T17:31:49.596382] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-03T17:31:49.737576] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:31:49.737861] [DEBUG] [LOCAL ] BDC: No existing data file found in primary storage. [2025-10-03T17:31:49.737921] [WARN ] [MAIN ] BDC: No existing data found, performing full refresh instead. [2025-10-03T17:31:49.738035] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-03T17:31:49.738115] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-03T17:31:49.738177] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-03T17:31:49.738226] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-03T17:31:50.089004] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T17:31:50.160480] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:31:50.390697] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-03T17:31:51.190693] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-03T17:31:51.395927] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:31:51.560979] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T17:31:51.990620] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-03T17:31:52.159263] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T17:31:52.160875] [INFO ] [REMOTE ] BCO: Full fetch complete (36634 records). [2025-10-03T17:31:52.160978] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-03T17:31:52.596962] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-03T17:31:52.597071] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-03T17:31:52.597622] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-03T17:31:52.597713] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-03T17:31:52.598681] [DEBUG] [LOCAL ] BCO: Trimmed 36634 records to 26271 (keeping 200 days of data) [2025-10-03T17:31:52.760023] [DEBUG] [LOCAL ] BCO: Primary data saved (26271 records). [2025-10-03T17:31:52.760156] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-03T17:31:52.760246] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCO took 45.1s. Estimated remaining: 4h 46m 14s. Rate: 7.5 symbols/min [2025-10-03T17:31:52.790626] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-03T17:31:53.173335] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T17:31:53.590710] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-03T17:31:53.770685] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T17:31:54.390717] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-03T17:31:54.686076] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:31:55.190700] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-03T17:31:55.990626] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-03T17:31:56.286398] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T17:31:56.330217] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:31:56.790696] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-03T17:31:57.161339] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:31:57.590683] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-03T17:31:58.390681] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-03T17:31:58.534604] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:31:58.537514] [INFO ] [REMOTE ] BCS: Full fetch complete (77328 records). [2025-10-03T17:31:58.537630] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-03T17:31:58.908543] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:31:59.016008] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-03T17:31:59.016104] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-03T17:31:59.017737] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-03T17:31:59.017816] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-03T17:31:59.019985] [DEBUG] [LOCAL ] BCS: Trimmed 77328 records to 54229 (keeping 200 days of data) [2025-10-03T17:31:59.223849] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-03T17:31:59.388430] [DEBUG] [LOCAL ] BCS: Primary data saved (54229 records). [2025-10-03T17:31:59.388592] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-03T17:31:59.389376] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCS took 47.3s. Estimated remaining: 4h 45m 53s. Rate: 7.5 symbols/min [2025-10-03T17:31:59.793433] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:31:59.990714] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-03T17:32:00.280517] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:32:00.790723] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-03T17:32:01.401766] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:32:01.474356] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T17:32:01.590745] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-03T17:32:02.390711] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-03T17:32:02.626447] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:32:02.628170] [INFO ] [REMOTE ] BCX: Full fetch complete (34089 records). [2025-10-03T17:32:02.628251] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-03T17:32:03.057754] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-03T17:32:03.057892] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-03T17:32:03.058514] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-03T17:32:03.058592] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-03T17:32:03.059890] [DEBUG] [LOCAL ] BCX: Trimmed 34089 records to 22000 (keeping 200 days of data) [2025-10-03T17:32:03.213349] [DEBUG] [LOCAL ] BCX: Primary data saved (22000 records). [2025-10-03T17:32:03.213505] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-03T17:32:03.213608] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BCX took 30.3s. Estimated remaining: 4h 45m 7s. Rate: 7.5 symbols/min [2025-10-03T17:32:03.565149] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:32:03.570768] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-03T17:32:04.693286] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:32:04.700022] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-03T17:32:05.962060] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:32:05.969128] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-03T17:32:07.055326] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:32:07.061973] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-03T17:32:08.054811] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:32:08.056512] [INFO ] [REMOTE ] BDC: Full fetch complete (35937 records). [2025-10-03T17:32:08.056597] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-03T17:32:08.479110] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-03T17:32:08.479201] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-03T17:32:08.479758] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-03T17:32:08.479848] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-03T17:32:08.480980] [DEBUG] [LOCAL ] BDC: Trimmed 35937 records to 24963 (keeping 200 days of data) [2025-10-03T17:32:08.650262] [DEBUG] [LOCAL ] BDC: Primary data saved (24963 records). [2025-10-03T17:32:08.650402] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-03T17:32:08.650479] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BDC took 19.1s. Estimated remaining: 4h 44m 36s. Rate: 7.5 symbols/min [2025-10-03T17:32:09.320620] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.309972] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.377384] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.451904] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:09.490979] [DEBUG] [LOCAL ] BDJ: Loaded 29159 existing records from primary storage. [2025-10-03T17:32:09.491472] [INFO ] [MAIN ] BDJ: Loaded 29159 existing records. [2025-10-03T17:32:09.611934] [DEBUG] [LOCAL ] BDN: Loaded 47839 existing records from primary storage. [2025-10-03T17:32:09.630156] [INFO ] [MAIN ] BDN: Loaded 47839 existing records. [2025-10-03T17:32:09.784140] [DEBUG] [LOCAL ] BDX: Loaded 52730 existing records from primary storage. [2025-10-03T17:32:09.904859] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:09.874634] [INFO ] [MAIN ] BDX: Loaded 52730 existing records. [2025-10-03T17:32:09.911691] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-03T17:32:09.917070] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-03T17:32:09.906046] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-10-03T17:32:09.968516] [INFO ] [MAIN ] BE: Loaded 54043 existing records. [2025-10-03T17:32:10.045905] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-03T17:32:10.082189] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.114660] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-03T17:32:10.180813] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.254603] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-03T17:32:10.304847] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-03T17:32:10.461901] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.483919] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-03T17:32:10.521872] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.525417] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:10.530728] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-03T17:32:10.551258] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-03T17:32:10.577542] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-03T17:32:10.604870] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-03T17:32:10.610075] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-03T17:32:10.616348] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-03T17:32:10.636397] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-03T17:32:11.537232] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:11.650730] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-03T17:32:11.823070] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:11.882634] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-03T17:32:12.009857] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:12.033295] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-03T17:32:12.032925] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:12.033562] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-03T17:32:12.840021] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T17:32:12.847087] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-03T17:32:13.928637] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T17:32:13.939919] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-03T17:32:14.028140] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T17:32:14.041286] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-03T17:32:14.102663] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T17:32:14.121547] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-03T17:32:14.149975] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T17:32:14.163857] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-03T17:32:15.359280] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T17:32:15.369907] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-03T17:32:15.428046] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T17:32:15.439278] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-03T17:32:15.634988] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T17:32:15.645911] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-03T17:32:16.279197] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T17:32:16.291137] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-03T17:32:16.701945] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T17:32:16.790695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-03T17:32:17.088577] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:32:17.126718] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T17:32:17.590729] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-03T17:32:17.893170] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T17:32:18.196026] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T17:32:18.390721] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-03T17:32:19.190622] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-03T17:32:19.233492] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:32:19.990737] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-03T17:32:20.036989] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T17:32:20.691742] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T17:32:20.790734] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-03T17:32:21.590672] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-03T17:32:21.878939] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:32:22.040421] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:32:22.390718] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-03T17:32:23.190726] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-03T17:32:23.551757] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:32:23.990740] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-03T17:32:24.303246] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-03T17:32:24.790726] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-03T17:32:25.283628] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T17:32:25.590725] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-03T17:32:25.812815] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T17:32:26.352215] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:32:26.390664] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-03T17:32:27.190691] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-03T17:32:27.551523] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:32:27.990700] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-03T17:32:28.060430] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T17:32:28.760844] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:32:28.790677] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-03T17:32:28.829616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T17:32:29.590746] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-03T17:32:30.390639] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-03T17:32:30.505579] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:32:31.190684] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-03T17:32:31.604411] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T17:32:31.990731] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-03T17:32:32.400778] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T17:32:32.790736] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-03T17:32:32.880533] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T17:32:33.590701] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-03T17:32:34.390739] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-03T17:32:34.471140] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-03T17:32:34.528057] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:32:35.190705] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-03T17:32:35.662108] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:32:35.713292] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-03T17:32:35.715935] [INFO ] [REMOTE ] BDN: Full fetch complete (69263 records). [2025-10-03T17:32:35.716078] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-03T17:32:35.995891] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-03T17:32:36.162465] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-03T17:32:36.162571] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-03T17:32:36.163364] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-03T17:32:36.163435] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-03T17:32:36.165250] [DEBUG] [LOCAL ] BDN: Trimmed 69263 records to 48182 (keeping 200 days of data) [2025-10-03T17:32:36.458984] [DEBUG] [LOCAL ] BDN: Primary data saved (48182 records). [2025-10-03T17:32:36.459158] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-03T17:32:36.459351] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDN took 27.8s. Estimated remaining: 4h 47m 23s. Rate: 7.4 symbols/min [2025-10-03T17:32:36.655411] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:36.655730] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-03T17:32:36.655836] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-03T17:32:36.656128] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-03T17:32:36.656275] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-03T17:32:36.656462] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-03T17:32:36.656519] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-03T17:32:36.791487] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-03T17:32:37.040623] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T17:32:37.114377] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:37.590703] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-03T17:32:38.135917] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T17:32:38.303380] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T17:32:38.390737] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-03T17:32:38.552699] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-03T17:32:38.673201] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-03T17:32:39.190689] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-03T17:32:39.584936] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T17:32:39.990708] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-03T17:32:40.421399] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T17:32:40.790716] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-03T17:32:41.590729] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-03T17:32:42.347800] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T17:32:42.350955] [INFO ] [REMOTE ] BDX: Full fetch complete (75709 records). [2025-10-03T17:32:42.351093] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-03T17:32:42.399999] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-03T17:32:42.782954] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-03T17:32:42.783047] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-03T17:32:42.783833] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-03T17:32:42.783900] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-03T17:32:42.785549] [DEBUG] [LOCAL ] BDX: Trimmed 75709 records to 53085 (keeping 200 days of data) [2025-10-03T17:32:42.894169] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T17:32:43.166688] [DEBUG] [LOCAL ] BDX: Primary data saved (53085 records). [2025-10-03T17:32:43.166844] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-03T17:32:43.166934] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDX took 34.5s. Estimated remaining: 4h 47m 3s. Rate: 7.4 symbols/min [2025-10-03T17:32:43.200621] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-03T17:32:43.367961] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:43.422350] [DEBUG] [LOCAL ] BEKE: Loaded 53629 existing records from primary storage. [2025-10-03T17:32:43.422707] [INFO ] [MAIN ] BEKE: Loaded 53629 existing records. [2025-10-03T17:32:43.620116] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:43.621167] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-03T17:32:43.621228] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-03T17:32:43.621495] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-03T17:32:43.621556] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-03T17:32:43.806860] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T17:32:43.990685] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-03T17:32:44.088999] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:44.123340] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T17:32:44.790717] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-03T17:32:45.325102] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T17:32:45.590687] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-03T17:32:45.931872] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-03T17:32:46.390662] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-03T17:32:46.626918] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:32:47.190695] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-03T17:32:47.419746] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-03T17:32:47.990695] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-03T17:32:48.682857] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-03T17:32:48.685764] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-03T17:32:48.685896] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-03T17:32:48.796168] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-03T17:32:48.997378] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:32:49.022604] [INFO ] [REMOTE ] BDJ: Full fetch complete (42926 records). [2025-10-03T17:32:49.038337] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-03T17:32:49.233438] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-03T17:32:49.239133] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-03T17:32:49.250274] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-03T17:32:49.281748] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-03T17:32:49.371104] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54433 (keeping 200 days of data) [2025-10-03T17:32:49.593736] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-03T17:32:49.652967] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-03T17:32:49.656031] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-03T17:32:49.666450] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-03T17:32:49.667681] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-03T17:32:49.686061] [DEBUG] [LOCAL ] BDJ: Trimmed 42926 records to 29333 (keeping 200 days of data) [2025-10-03T17:32:49.988903] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-03T17:32:50.008440] [DEBUG] [LOCAL ] BE: Primary data saved (54433 records). [2025-10-03T17:32:50.009553] [INFO ] [MAIN ] BE: Full history saved. [2025-10-03T17:32:50.010001] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BE took 41.4s. Estimated remaining: 4h 46m 44s. Rate: 7.4 symbols/min [2025-10-03T17:32:50.207807] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:50.329795] [DEBUG] [LOCAL ] BDJ: Primary data saved (29333 records). [2025-10-03T17:32:50.329949] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-03T17:32:50.330097] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BDJ took 41.7s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-03T17:32:50.328293] [DEBUG] [LOCAL ] BEN: Loaded 53426 existing records from primary storage. [2025-10-03T17:32:50.335775] [INFO ] [MAIN ] BEN: Loaded 53426 existing records. [2025-10-03T17:32:50.404708] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-03T17:32:50.695242] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:50.728954] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:50.729928] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-03T17:32:50.730446] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-03T17:32:50.731195] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-03T17:32:50.731327] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-03T17:32:50.835095] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-03T17:32:50.914229] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T17:32:51.053869] [DEBUG] [LOCAL ] BEP: Loaded 38963 existing records from primary storage. [2025-10-03T17:32:51.099022] [INFO ] [MAIN ] BEP: Loaded 38963 existing records. [2025-10-03T17:32:51.206986] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-03T17:32:51.370101] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:51.432147] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:51.432426] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-03T17:32:51.432553] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-03T17:32:51.432823] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-03T17:32:51.432884] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-03T17:32:51.841708] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:51.990735] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-03T17:32:52.790711] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-03T17:32:53.146856] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:32:53.147848] [INFO ] [REMOTE ] BEDU: Full fetch complete (1404 records). [2025-10-03T17:32:53.147951] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-03T17:32:53.362957] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-03T17:32:53.363926] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:32:53.364039] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:32:53.364255] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-03T17:32:53.364601] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-03T17:32:53.393662] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-03T17:32:53.396833] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-03T17:32:53.397824] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 16.9s. Estimated remaining: 4h 44m 37s. Rate: 7.5 symbols/min [2025-10-03T17:32:53.399100] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-10-03T17:32:53.603129] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:32:53.599025] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-03T17:32:53.636734] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T17:32:53.689047] [DEBUG] [LOCAL ] BEPC: Loaded 46818 existing records from primary storage. [2025-10-03T17:32:53.689377] [INFO ] [MAIN ] BEPC: Loaded 46818 existing records. [2025-10-03T17:32:53.882079] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:32:53.882295] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-03T17:32:53.882345] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-03T17:32:53.882631] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-03T17:32:53.882726] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-03T17:32:54.273716] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:32:54.390711] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-03T17:32:55.190734] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-03T17:32:55.664127] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T17:32:55.921783] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T17:32:55.990821] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-03T17:32:56.487259] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:32:56.790710] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-03T17:32:57.590698] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-03T17:32:57.747227] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T17:32:58.390665] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-03T17:32:58.715046] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:32:58.803376] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:32:59.190713] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-03T17:32:59.990631] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-03T17:33:00.099877] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:33:00.771364] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T17:33:00.790638] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-03T17:33:01.233691] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T17:33:01.590702] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-03T17:33:02.390727] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-03T17:33:03.190733] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-03T17:33:03.480368] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T17:33:03.969843] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (3.18 seconds). [2025-10-03T17:33:03.990621] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-03T17:33:04.066336] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T17:33:04.790703] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-03T17:33:04.990932] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T17:33:05.590697] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-03T17:33:05.959421] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T17:33:06.243903] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:33:06.390739] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-03T17:33:07.190712] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-03T17:33:07.456706] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:33:07.990675] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-03T17:33:08.046178] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T17:33:08.736551] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:33:08.790713] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-03T17:33:09.590769] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-03T17:33:10.234297] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:33:10.390697] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-03T17:33:11.190696] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-03T17:33:11.469106] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T17:33:11.507388] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:33:11.990723] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-03T17:33:12.790677] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-03T17:33:13.059253] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T17:33:13.565429] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:33:13.590681] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-03T17:33:14.390683] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-03T17:33:14.485850] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:33:15.019337] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (7.03 seconds). [2025-10-03T17:33:15.064114] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:33:15.190722] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-03T17:33:15.775121] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:33:15.778283] [INFO ] [REMOTE ] BEKE: Full fetch complete (77192 records). [2025-10-03T17:33:15.778442] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-03T17:33:15.999345] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-03T17:33:16.237260] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-03T17:33:16.237347] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-03T17:33:16.238395] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-03T17:33:16.238482] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-03T17:33:16.240542] [DEBUG] [LOCAL ] BEKE: Trimmed 77192 records to 54017 (keeping 200 days of data) [2025-10-03T17:33:16.596818] [DEBUG] [LOCAL ] BEKE: Primary data saved (54017 records). [2025-10-03T17:33:16.596969] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-03T17:33:16.599028] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEKE took 33.4s. Estimated remaining: 4h 46m 40s. Rate: 7.4 symbols/min [2025-10-03T17:33:16.793863] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:16.791889] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-03T17:33:16.795102] [DEBUG] [LOCAL ] BEPH: No existing data file found in primary storage. [2025-10-03T17:33:16.795291] [WARN ] [MAIN ] BEPH: No existing data found, performing full refresh instead. [2025-10-03T17:33:16.795488] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-03T17:33:16.795705] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-03T17:33:16.795787] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-03T17:33:16.795849] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-03T17:33:17.243961] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:17.300161] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T17:33:17.388025] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:33:17.590751] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-03T17:33:18.105019] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T17:33:18.362945] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:33:18.390724] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-03T17:33:19.190694] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-03T17:33:19.990730] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-03T17:33:20.047538] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:33:20.563545] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:33:20.790728] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-03T17:33:20.955139] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:33:20.957548] [INFO ] [REMOTE ] BEP: Full fetch complete (58421 records). [2025-10-03T17:33:20.957690] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-03T17:33:21.293697] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T17:33:21.390131] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-03T17:33:21.390222] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-03T17:33:21.390942] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-03T17:33:21.391014] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-03T17:33:21.392391] [DEBUG] [LOCAL ] BEP: Trimmed 58421 records to 39305 (keeping 200 days of data) [2025-10-03T17:33:21.603201] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-03T17:33:21.642470] [DEBUG] [LOCAL ] BEP: Primary data saved (39305 records). [2025-10-03T17:33:21.642630] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-03T17:33:21.642772] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 31.3s. Estimated remaining: 4h 46m 5s. Rate: 7.4 symbols/min [2025-10-03T17:33:21.828814] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:21.835059] [DEBUG] [LOCAL ] BEPI: Loaded 3556 existing records from primary storage. [2025-10-03T17:33:21.835237] [INFO ] [MAIN ] BEPI: Loaded 3556 existing records. [2025-10-03T17:33:22.035248] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:22.035490] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-03T17:33:22.035539] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-03T17:33:22.035787] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-03T17:33:22.035863] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-03T17:33:22.393433] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-03T17:33:22.421818] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:22.672484] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:33:23.190692] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-03T17:33:23.942504] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:33:23.990729] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-03T17:33:24.790685] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-03T17:33:25.203767] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T17:33:25.502956] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T17:33:25.590725] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-03T17:33:25.802333] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:33:26.367289] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:33:26.390742] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-03T17:33:27.190737] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-03T17:33:27.990726] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-03T17:33:28.460533] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T17:33:28.743404] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T17:33:28.790634] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-03T17:33:29.263144] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T17:33:29.590716] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-03T17:33:29.884703] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-03T17:33:30.390713] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-03T17:33:30.899756] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T17:33:31.190723] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-03T17:33:31.561336] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (5.17 seconds). [2025-10-03T17:33:31.564177] [INFO ] [REMOTE ] BEN: Full fetch complete (76892 records). [2025-10-03T17:33:31.564348] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-03T17:33:32.005069] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-03T17:33:32.001174] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-03T17:33:32.006019] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-03T17:33:32.006857] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-03T17:33:32.006923] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-03T17:33:32.008530] [DEBUG] [LOCAL ] BEN: Trimmed 76892 records to 53814 (keeping 200 days of data) [2025-10-03T17:33:32.362589] [DEBUG] [LOCAL ] BEN: Primary data saved (53814 records). [2025-10-03T17:33:32.362763] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-03T17:33:32.362875] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEN took 42.4s. Estimated remaining: 4h 46m 20s. Rate: 7.4 symbols/min [2025-10-03T17:33:32.549048] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:32.555132] [DEBUG] [LOCAL ] BEPJ: Loaded 3156 existing records from primary storage. [2025-10-03T17:33:32.555340] [INFO ] [MAIN ] BEPJ: Loaded 3156 existing records. [2025-10-03T17:33:32.769413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:33:32.792592] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:32.792729] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-03T17:33:32.794583] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-03T17:33:32.794833] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-03T17:33:32.795074] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-03T17:33:32.795678] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-03T17:33:33.181296] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:33.440889] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T17:33:33.590707] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-03T17:33:34.390742] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-03T17:33:34.918731] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T17:33:34.921456] [INFO ] [REMOTE ] BEPC: Full fetch complete (68534 records). [2025-10-03T17:33:34.921685] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-03T17:33:35.056790] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T17:33:35.200994] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-03T17:33:35.394239] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-03T17:33:35.394318] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-03T17:33:35.395037] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-03T17:33:35.395103] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-03T17:33:35.396451] [DEBUG] [LOCAL ] BEPC: Trimmed 68534 records to 47157 (keeping 200 days of data) [2025-10-03T17:33:35.691254] [DEBUG] [LOCAL ] BEPC: Primary data saved (47157 records). [2025-10-03T17:33:35.691454] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-03T17:33:35.692295] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BEPC took 42.3s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-10-03T17:33:35.890579] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:35.931053] [DEBUG] [LOCAL ] BFAM: Loaded 33413 existing records from primary storage. [2025-10-03T17:33:35.931385] [INFO ] [MAIN ] BFAM: Loaded 33413 existing records. [2025-10-03T17:33:35.998965] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-03T17:33:36.126744] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:36.127002] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-03T17:33:36.127054] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-03T17:33:36.127308] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-03T17:33:36.127368] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-03T17:33:36.571630] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:36.752966] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:33:36.790683] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-03T17:33:37.266876] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T17:33:37.570096] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (5.57 seconds). [2025-10-03T17:33:37.590622] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-03T17:33:37.894225] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-03T17:33:38.390690] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-03T17:33:38.990041] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T17:33:39.190688] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-03T17:33:39.811968] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T17:33:39.990689] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-03T17:33:40.555060] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (5.35 seconds). [2025-10-03T17:33:40.651089] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:33:40.651923] [INFO ] [REMOTE ] BEPI: Full fetch complete (4946 records). [2025-10-03T17:33:40.651997] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-03T17:33:40.795771] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-03T17:33:41.066012] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-03T17:33:41.066109] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-03T17:33:41.066275] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-03T17:33:41.066319] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-03T17:33:41.066956] [DEBUG] [LOCAL ] BEPI: Trimmed 4946 records to 3576 (keeping 200 days of data) [2025-10-03T17:33:41.090445] [DEBUG] [LOCAL ] BEPI: Primary data saved (3576 records). [2025-10-03T17:33:41.090608] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-03T17:33:41.090758] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPI took 19.4s. Estimated remaining: 4h 45m 0s. Rate: 7.4 symbols/min [2025-10-03T17:33:41.258519] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T17:33:41.296524] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:41.342726] [DEBUG] [LOCAL ] BFH: Loaded 41897 existing records from primary storage. [2025-10-03T17:33:41.343052] [INFO ] [MAIN ] BFH: Loaded 41897 existing records. [2025-10-03T17:33:41.549518] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:41.549941] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-03T17:33:41.550002] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-03T17:33:41.550279] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-03T17:33:41.550348] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-03T17:33:41.595875] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-03T17:33:41.937471] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:42.390690] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-03T17:33:43.189622] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:33:43.197165] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-03T17:33:43.286082] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:33:43.824559] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T17:33:43.990693] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-03T17:33:44.499763] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T17:33:44.790707] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-03T17:33:45.382882] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T17:33:45.590697] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-03T17:33:46.390693] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-03T17:33:46.541337] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T17:33:46.542331] [INFO ] [REMOTE ] BEPH: Full fetch complete (7744 records). [2025-10-03T17:33:46.542402] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-03T17:33:46.880129] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T17:33:46.967951] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-03T17:33:46.968039] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-03T17:33:46.968283] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-03T17:33:46.968345] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-03T17:33:46.968842] [DEBUG] [LOCAL ] BEPH: Trimmed 7744 records to 5430 (keeping 200 days of data) [2025-10-03T17:33:47.014129] [DEBUG] [LOCAL ] BEPH: Primary data saved (5430 records). [2025-10-03T17:33:47.014281] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-03T17:33:47.014381] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPH took 30.4s. Estimated remaining: 4h 44m 34s. Rate: 7.4 symbols/min [2025-10-03T17:33:47.198282] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-03T17:33:47.203519] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:33:47.222676] [DEBUG] [LOCAL ] BFK: Loaded 13980 existing records from primary storage. [2025-10-03T17:33:47.222947] [INFO ] [MAIN ] BFK: Loaded 13980 existing records. [2025-10-03T17:33:47.417799] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:33:47.418159] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-03T17:33:47.418221] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-03T17:33:47.418488] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-03T17:33:47.418553] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-03T17:33:47.857584] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:33:47.990718] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-03T17:33:48.192548] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:33:48.790692] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-03T17:33:49.594787] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-03T17:33:49.599723] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:33:49.857724] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T17:33:50.054004] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T17:33:50.390676] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-03T17:33:51.190725] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-03T17:33:51.990711] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-03T17:33:52.790699] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-03T17:33:54.000376] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-03T17:33:54.009909] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-03T17:33:54.674277] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-03T17:33:54.677463] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-03T17:33:55.604838] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-10-03T17:33:55.611909] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-03T17:33:55.717816] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:33:55.767623] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (5.38 seconds). [2025-10-03T17:33:55.893019] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:33:55.990726] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-03T17:33:56.790709] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-03T17:33:57.373735] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T17:33:57.398991] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T17:33:57.590720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-03T17:33:58.390701] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-03T17:33:58.509017] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T17:33:58.540025] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-03T17:33:58.717380] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T17:33:59.190730] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-03T17:33:59.990691] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-03T17:34:00.622332] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T17:34:00.790716] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-03T17:34:01.028479] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:34:01.590698] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-03T17:34:02.002351] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T17:34:02.003198] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4494 records). [2025-10-03T17:34:02.003273] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-03T17:34:02.400861] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-03T17:34:02.400604] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-03T17:34:02.401945] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-03T17:34:02.402112] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-03T17:34:02.402155] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-03T17:34:02.402574] [DEBUG] [LOCAL ] BEPJ: Trimmed 4494 records to 3166 (keeping 200 days of data) [2025-10-03T17:34:02.423327] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3166 records). [2025-10-03T17:34:02.423434] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-03T17:34:02.423531] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPJ took 30.1s. Estimated remaining: 4h 45m 28s. Rate: 7.4 symbols/min [2025-10-03T17:34:02.603147] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:02.657003] [DEBUG] [LOCAL ] BFLY: Loaded 52160 existing records from primary storage. [2025-10-03T17:34:02.657348] [INFO ] [MAIN ] BFLY: Loaded 52160 existing records. [2025-10-03T17:34:02.855517] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:02.855760] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-03T17:34:02.855839] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-03T17:34:02.856531] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-03T17:34:02.856595] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-03T17:34:03.213904] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-03T17:34:03.235325] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:03.244307] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T17:34:03.990619] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-03T17:34:04.191035] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T17:34:04.498373] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:34:04.790685] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-03T17:34:04.892886] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T17:34:05.590734] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-03T17:34:06.295174] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:34:06.390743] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-03T17:34:07.190743] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-03T17:34:07.941874] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-03T17:34:07.990706] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-03T17:34:08.112494] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:34:08.600747] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T17:34:08.790751] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-03T17:34:08.920860] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:34:09.590720] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-03T17:34:10.390702] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-03T17:34:10.450710] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T17:34:11.190759] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-03T17:34:11.775867] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T17:34:11.825902] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-03T17:34:11.990701] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-03T17:34:12.459020] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:34:12.790715] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-03T17:34:13.590694] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-03T17:34:14.090947] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-03T17:34:14.390732] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-03T17:34:14.880575] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T17:34:15.190731] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-03T17:34:15.990715] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-03T17:34:16.237859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-03T17:34:16.624500] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-03T17:34:16.790724] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-03T17:34:17.025163] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T17:34:17.439752] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:34:17.440900] [INFO ] [REMOTE ] BFK: Full fetch complete (19219 records). [2025-10-03T17:34:17.440976] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-03T17:34:17.441682] [FATAL] [VALIDATOR ] BFK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:34:17.441907] [FATAL] [MAIN ] BFK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:34:17.441996] [WARN ] [MAIN ] BFK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:34:17.442092] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-03T17:34:17.442223] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-03T17:34:17.442297] [INFO ] [LOCAL ] BFK: Starting deletion of derivative data. [2025-10-03T17:34:17.442915] [DEBUG] [LOCAL ] BFK: Deleted derivative data file. [2025-10-03T17:34:17.443067] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BFK took 30.4s. Estimated remaining: 4h 46m 18s. Rate: 7.4 symbols/min [2025-10-03T17:34:17.594313] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-03T17:34:17.672575] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:17.702827] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:34:17.717251] [DEBUG] [LOCAL ] BFS: Loaded 9213 existing records from primary storage. [2025-10-03T17:34:17.717542] [INFO ] [MAIN ] BFS: Loaded 9213 existing records. [2025-10-03T17:34:17.908521] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:17.908799] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-03T17:34:17.908869] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-03T17:34:17.909142] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-03T17:34:17.909200] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-03T17:34:18.290847] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:18.390694] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-03T17:34:19.190713] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-03T17:34:19.262542] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:34:19.598187] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:34:19.990685] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-03T17:34:20.795076] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-03T17:34:20.796188] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:34:21.011827] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:34:21.590729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-03T17:34:22.384193] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:34:22.390601] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-03T17:34:22.545391] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:34:23.190721] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-03T17:34:23.238156] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-03T17:34:23.990729] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-03T17:34:24.253524] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:34:24.554558] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:34:24.790695] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-03T17:34:25.590725] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-03T17:34:26.390759] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-03T17:34:26.430555] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:34:26.434035] [INFO ] [REMOTE ] BFH: Full fetch complete (59737 records). [2025-10-03T17:34:26.434433] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-03T17:34:26.642196] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:34:27.098414] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-03T17:34:27.098590] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-03T17:34:27.099708] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-03T17:34:27.099798] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-03T17:34:27.101720] [DEBUG] [LOCAL ] BFH: Trimmed 59737 records to 42221 (keeping 200 days of data) [2025-10-03T17:34:27.198216] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-03T17:34:27.440543] [DEBUG] [LOCAL ] BFH: Primary data saved (42221 records). [2025-10-03T17:34:27.440745] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-03T17:34:27.440888] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFH took 46.3s. Estimated remaining: 4h 46m 25s. Rate: 7.4 symbols/min [2025-10-03T17:34:27.644218] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:27.659537] [DEBUG] [LOCAL ] BFZ: Loaded 12227 existing records from primary storage. [2025-10-03T17:34:27.659889] [INFO ] [MAIN ] BFZ: Loaded 12227 existing records. [2025-10-03T17:34:27.868828] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:27.869090] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-03T17:34:27.869150] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-03T17:34:27.869518] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-03T17:34:27.869579] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-03T17:34:27.995983] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-03T17:34:28.058043] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T17:34:28.301988] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:28.333438] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:34:28.790722] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-03T17:34:29.590670] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-03T17:34:29.741139] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T17:34:29.832334] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-03T17:34:29.834373] [INFO ] [REMOTE ] BFAM: Full fetch complete (47006 records). [2025-10-03T17:34:29.834494] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-03T17:34:30.283775] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-03T17:34:30.283872] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-03T17:34:30.284488] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-03T17:34:30.284557] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-03T17:34:30.285838] [DEBUG] [LOCAL ] BFAM: Trimmed 47006 records to 33682 (keeping 200 days of data) [2025-10-03T17:34:30.391276] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-03T17:34:30.503437] [DEBUG] [LOCAL ] BFAM: Primary data saved (33682 records). [2025-10-03T17:34:30.503630] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-03T17:34:30.504838] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFAM took 54.8s. Estimated remaining: 4h 45m 35s. Rate: 7.4 symbols/min [2025-10-03T17:34:30.696843] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:30.752359] [DEBUG] [LOCAL ] BG: Loaded 50788 existing records from primary storage. [2025-10-03T17:34:30.752736] [INFO ] [MAIN ] BG: Loaded 50788 existing records. [2025-10-03T17:34:30.964126] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:30.964411] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-03T17:34:30.964493] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-03T17:34:30.965984] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-03T17:34:30.966047] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-03T17:34:31.200822] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-03T17:34:31.304081] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:34:31.382412] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:31.424415] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T17:34:31.982703] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T17:34:31.990620] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-03T17:34:32.764872] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:34:32.790677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-03T17:34:33.580540] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T17:34:33.590623] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-03T17:34:34.283048] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T17:34:34.284110] [INFO ] [REMOTE ] BFS: Full fetch complete (12716 records). [2025-10-03T17:34:34.284195] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-03T17:34:34.395784] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-03T17:34:34.682993] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-03T17:34:34.683079] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-03T17:34:34.683348] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-03T17:34:34.683409] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-03T17:34:34.683942] [DEBUG] [LOCAL ] BFS: Trimmed 12716 records to 9281 (keeping 200 days of data) [2025-10-03T17:34:34.743589] [DEBUG] [LOCAL ] BFS: Primary data saved (9281 records). [2025-10-03T17:34:34.743766] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-03T17:34:34.743880] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFS took 17.3s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-03T17:34:34.922115] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:34.941289] [DEBUG] [LOCAL ] BGB: Loaded 17717 existing records from primary storage. [2025-10-03T17:34:34.941565] [INFO ] [MAIN ] BGB: Loaded 17717 existing records. [2025-10-03T17:34:35.129238] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:35.129428] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-03T17:34:35.129482] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-03T17:34:35.130166] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-03T17:34:35.130229] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-03T17:34:35.194536] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-03T17:34:35.466740] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:34:35.554410] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:35.990713] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-03T17:34:36.790711] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-03T17:34:37.133038] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:34:37.540675] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T17:34:37.590697] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-03T17:34:37.808727] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:34:38.390728] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-03T17:34:39.190670] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-03T17:34:39.305411] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T17:34:39.834077] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T17:34:39.990638] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-03T17:34:40.035396] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:34:40.790690] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-03T17:34:41.601765] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-03T17:34:41.608921] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T17:34:41.841666] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T17:34:42.390686] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-03T17:34:43.190630] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-03T17:34:43.307418] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:34:43.409056] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:34:43.995670] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-03T17:34:43.999808] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T17:34:44.790685] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-03T17:34:44.941376] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:34:45.590675] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-03T17:34:45.754827] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T17:34:46.390683] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-03T17:34:47.194717] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-03T17:34:47.199637] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T17:34:47.263742] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:34:47.990677] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-03T17:34:48.790671] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-03T17:34:48.910166] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:34:48.922828] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T17:34:48.932445] [INFO ] [REMOTE ] BFLY: Full fetch complete (75285 records). [2025-10-03T17:34:48.932886] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-03T17:34:49.361844] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-03T17:34:49.361982] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-03T17:34:49.363099] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-03T17:34:49.363184] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-03T17:34:49.367771] [DEBUG] [LOCAL ] BFLY: Trimmed 75285 records to 52549 (keeping 200 days of data) [2025-10-03T17:34:49.602229] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-03T17:34:49.719923] [DEBUG] [LOCAL ] BFLY: Primary data saved (52549 records). [2025-10-03T17:34:49.720138] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-03T17:34:49.720275] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFLY took 47.3s. Estimated remaining: 4h 45m 44s. Rate: 7.4 symbols/min [2025-10-03T17:34:49.941973] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:49.967818] [DEBUG] [LOCAL ] BGH: Loaded 17043 existing records from primary storage. [2025-10-03T17:34:49.968181] [INFO ] [MAIN ] BGH: Loaded 17043 existing records. [2025-10-03T17:34:50.151209] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:34:50.151521] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-03T17:34:50.151574] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-03T17:34:50.152461] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-03T17:34:50.152525] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-03T17:34:50.398638] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-03T17:34:50.533877] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:50.568601] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:34:50.771464] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T17:34:51.162408] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T17:34:51.190617] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-03T17:34:51.990698] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-03T17:34:52.010404] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:34:52.011606] [INFO ] [REMOTE ] BFZ: Full fetch complete (17993 records). [2025-10-03T17:34:52.011708] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-03T17:34:52.419837] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-03T17:34:52.419949] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-03T17:34:52.420459] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-03T17:34:52.420510] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-03T17:34:52.421276] [DEBUG] [LOCAL ] BFZ: Trimmed 17993 records to 12261 (keeping 200 days of data) [2025-10-03T17:34:52.504242] [DEBUG] [LOCAL ] BFZ: Primary data saved (12261 records). [2025-10-03T17:34:52.504461] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-03T17:34:52.504577] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFZ took 25.1s. Estimated remaining: 4h 44m 52s. Rate: 7.4 symbols/min [2025-10-03T17:34:52.679512] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:34:52.679784] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-10-03T17:34:52.679832] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-10-03T17:34:52.679966] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-03T17:34:52.680009] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-03T17:34:52.680051] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-03T17:34:52.680086] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-03T17:34:52.795941] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-03T17:34:53.043845] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:34:53.590750] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-03T17:34:53.714908] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T17:34:54.159270] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:34:54.390680] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-03T17:34:54.603495] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:34:55.190740] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-03T17:34:55.640244] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T17:34:55.780837] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T17:34:55.990712] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-03T17:34:56.790710] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-03T17:34:57.590666] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-03T17:34:57.751409] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T17:34:57.900316] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T17:34:58.390639] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-03T17:34:58.495845] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T17:34:59.190687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-03T17:34:59.319514] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T17:34:59.990849] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-03T17:35:00.790752] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-03T17:35:01.167233] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-03T17:35:01.353432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-03T17:35:01.590687] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-03T17:35:01.759291] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:35:02.390737] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-03T17:35:03.190692] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-03T17:35:03.395155] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T17:35:03.990720] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-03T17:35:04.059160] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T17:35:04.626827] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T17:35:04.638506] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:35:04.790700] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-03T17:35:05.579386] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:35:05.590708] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-03T17:35:06.390635] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-03T17:35:06.532376] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T17:35:07.190725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-03T17:35:07.710038] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:35:07.990844] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-03T17:35:08.247377] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:35:08.726203] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:35:08.790745] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-03T17:35:09.448211] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:35:09.590689] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-03T17:35:10.390670] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-03T17:35:10.507335] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:35:10.509304] [INFO ] [REMOTE ] BGB: Full fetch complete (27093 records). [2025-10-03T17:35:10.509413] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-03T17:35:10.903583] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-03T17:35:10.903693] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-03T17:35:10.904111] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-03T17:35:10.904265] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-03T17:35:10.905048] [DEBUG] [LOCAL ] BGB: Trimmed 27093 records to 17901 (keeping 200 days of data) [2025-10-03T17:35:11.024011] [DEBUG] [LOCAL ] BGB: Primary data saved (17901 records). [2025-10-03T17:35:11.024183] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-03T17:35:11.024305] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BGB took 36.3s. Estimated remaining: 4h 46m 9s. Rate: 7.4 symbols/min [2025-10-03T17:35:11.191757] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-03T17:35:11.222377] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:11.290226] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T17:35:11.297266] [DEBUG] [LOCAL ] BGS: Loaded 50795 existing records from primary storage. [2025-10-03T17:35:11.297625] [INFO ] [MAIN ] BGS: Loaded 50795 existing records. [2025-10-03T17:35:11.497085] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:11.497329] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-03T17:35:11.497390] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-03T17:35:11.499037] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-03T17:35:11.499109] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-03T17:35:11.899850] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:11.990739] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-03T17:35:12.194607] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:35:12.790703] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-03T17:35:12.902455] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:35:13.590733] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-03T17:35:13.960906] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T17:35:14.390737] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-03T17:35:15.190705] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-03T17:35:15.286926] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T17:35:15.293107] [INFO ] [REMOTE ] BG: Full fetch complete (72765 records). [2025-10-03T17:35:15.293273] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-03T17:35:15.485294] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:35:15.760911] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-03T17:35:15.760997] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-03T17:35:15.761744] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-03T17:35:15.761813] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-03T17:35:15.763344] [DEBUG] [LOCAL ] BG: Trimmed 72765 records to 51115 (keeping 200 days of data) [2025-10-03T17:35:15.991157] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-03T17:35:16.105069] [DEBUG] [LOCAL ] BG: Primary data saved (51115 records). [2025-10-03T17:35:16.105229] [INFO ] [MAIN ] BG: Full history saved. [2025-10-03T17:35:16.106190] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 45.6s. Estimated remaining: 4h 45m 36s. Rate: 7.4 symbols/min [2025-10-03T17:35:16.297142] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:16.307775] [DEBUG] [LOCAL ] BGSF: Loaded 7557 existing records from primary storage. [2025-10-03T17:35:16.308014] [INFO ] [MAIN ] BGSF: Loaded 7557 existing records. [2025-10-03T17:35:16.503210] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:16.503486] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-03T17:35:16.503537] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-03T17:35:16.504081] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-03T17:35:16.504143] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-03T17:35:16.794574] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-03T17:35:16.918789] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:17.057133] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T17:35:17.191771] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T17:35:17.590696] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-03T17:35:17.604813] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:35:18.390719] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-03T17:35:18.572966] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:35:19.161965] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T17:35:19.163026] [INFO ] [REMOTE ] BGR: Full fetch complete (20131 records). [2025-10-03T17:35:19.163112] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-03T17:35:19.163786] [FATAL] [VALIDATOR ] BGR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:35:19.163900] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:35:19.163975] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:35:19.164122] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-03T17:35:19.164280] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-03T17:35:19.164348] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-10-03T17:35:19.164469] [DEBUG] [LOCAL ] BGR: No derivative data file found to delete. [2025-10-03T17:35:19.164573] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGR took 26.7s. Estimated remaining: 4h 44m 47s. Rate: 7.4 symbols/min [2025-10-03T17:35:19.198823] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-03T17:35:19.439206] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:19.468850] [DEBUG] [LOCAL ] BGT: Loaded 16702 existing records from primary storage. [2025-10-03T17:35:19.469295] [INFO ] [MAIN ] BGT: Loaded 16702 existing records. [2025-10-03T17:35:19.748234] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:19.748501] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-03T17:35:19.748563] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-03T17:35:19.749357] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-03T17:35:19.749431] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-03T17:35:19.996043] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-03T17:35:20.188731] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:20.790624] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-03T17:35:20.797144] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T17:35:20.892326] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T17:35:21.355055] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:35:21.590727] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-03T17:35:22.390700] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-03T17:35:22.445241] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:35:22.447719] [INFO ] [REMOTE ] BGH: Full fetch complete (22607 records). [2025-10-03T17:35:22.447882] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-03T17:35:22.881251] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-03T17:35:22.881331] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-03T17:35:22.881698] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-03T17:35:22.881767] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-03T17:35:22.882458] [DEBUG] [LOCAL ] BGH: Trimmed 22607 records to 17279 (keeping 200 days of data) [2025-10-03T17:35:22.970578] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T17:35:23.008551] [DEBUG] [LOCAL ] BGH: Primary data saved (17279 records). [2025-10-03T17:35:23.008738] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-03T17:35:23.008861] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGH took 33.3s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-03T17:35:23.195666] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:23.195742] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-03T17:35:23.209899] [DEBUG] [LOCAL ] BGX: Loaded 11102 existing records from primary storage. [2025-10-03T17:35:23.210268] [INFO ] [MAIN ] BGX: Loaded 11102 existing records. [2025-10-03T17:35:23.408997] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:23.409244] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-03T17:35:23.409295] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-03T17:35:23.410482] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-03T17:35:23.410545] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-03T17:35:23.859416] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:23.990796] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-03T17:35:24.790708] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-03T17:35:24.835989] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:35:24.969343] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T17:35:25.239277] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T17:35:25.590688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-03T17:35:26.390720] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-03T17:35:27.047242] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T17:35:27.190727] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-03T17:35:27.528847] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:35:27.990726] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-03T17:35:28.399368] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T17:35:28.454269] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T17:35:28.790718] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-03T17:35:29.258357] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:35:29.590673] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-03T17:35:30.357232] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:35:30.390677] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-03T17:35:31.194159] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-03T17:35:31.199883] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:35:31.990725] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-03T17:35:32.790729] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-03T17:35:32.886054] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:35:32.958712] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:35:33.590681] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-03T17:35:33.621265] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:35:34.390628] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-03T17:35:34.630793] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:35:35.190695] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-03T17:35:35.990693] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-03T17:35:36.074845] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T17:35:36.263638] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:35:36.790676] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-03T17:35:36.967779] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T17:35:37.590692] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-03T17:35:38.392734] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:35:38.390797] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-03T17:35:38.438524] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T17:35:39.190732] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-03T17:35:39.307927] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T17:35:39.990735] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-03T17:35:40.790707] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-03T17:35:40.854764] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:35:40.992707] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:35:41.590728] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-03T17:35:41.781210] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:35:42.212746] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T17:35:42.390690] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-03T17:35:43.190703] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-03T17:35:43.342986] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T17:35:43.990687] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-03T17:35:44.362567] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:35:44.521959] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-03T17:35:44.790706] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-03T17:35:45.337423] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:35:45.590709] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-03T17:35:46.390726] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-03T17:35:47.190751] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-03T17:35:47.284177] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:35:47.322203] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T17:35:47.990711] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-03T17:35:48.156560] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:35:48.716235] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T17:35:48.790725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-03T17:35:49.590735] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-03T17:35:50.398636] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-03T17:35:50.421413] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:35:50.846057] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T17:35:51.190629] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-03T17:35:51.348981] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T17:35:51.990681] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-03T17:35:52.211341] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T17:35:52.790690] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-03T17:35:52.853379] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:35:52.854771] [INFO ] [REMOTE ] BGX: Full fetch complete (16270 records). [2025-10-03T17:35:52.854844] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-03T17:35:53.241137] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-03T17:35:53.241216] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-03T17:35:53.241546] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-03T17:35:53.241600] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-03T17:35:53.242166] [DEBUG] [LOCAL ] BGX: Trimmed 16270 records to 11262 (keeping 200 days of data) [2025-10-03T17:35:53.315436] [DEBUG] [LOCAL ] BGX: Primary data saved (11262 records). [2025-10-03T17:35:53.315594] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-03T17:35:53.315733] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGX took 30.3s. Estimated remaining: 4h 46m 55s. Rate: 7.3 symbols/min [2025-10-03T17:35:53.534363] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:53.557396] [DEBUG] [LOCAL ] BGY: Loaded 22528 existing records from primary storage. [2025-10-03T17:35:53.557705] [INFO ] [MAIN ] BGY: Loaded 22528 existing records. [2025-10-03T17:35:53.592692] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-03T17:35:53.781978] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:53.776349] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:35:53.783366] [INFO ] [REMOTE ] BGT: Full fetch complete (24314 records). [2025-10-03T17:35:53.783458] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-03T17:35:53.783304] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-03T17:35:53.783663] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-03T17:35:53.816475] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-03T17:35:53.856143] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-03T17:35:54.397996] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-03T17:35:54.531608] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-03T17:35:54.531927] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-03T17:35:54.532431] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-03T17:35:54.532522] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-03T17:35:54.580927] [DEBUG] [LOCAL ] BGT: Trimmed 24314 records to 16780 (keeping 200 days of data) [2025-10-03T17:35:54.624953] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:54.742668] [DEBUG] [LOCAL ] BGT: Primary data saved (16780 records). [2025-10-03T17:35:54.742844] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-03T17:35:54.742939] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGT took 35.6s. Estimated remaining: 4h 45m 53s. Rate: 7.4 symbols/min [2025-10-03T17:35:54.933603] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:54.951827] [DEBUG] [LOCAL ] BH: Loaded 15980 existing records from primary storage. [2025-10-03T17:35:54.952091] [INFO ] [MAIN ] BH: Loaded 15980 existing records. [2025-10-03T17:35:55.145233] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:55.145476] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-03T17:35:55.145525] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-03T17:35:55.146120] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-03T17:35:55.146184] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-03T17:35:55.191019] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-03T17:35:55.272087] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:35:55.324172] [INFO ] [REMOTE ] BGS: Full fetch complete (72486 records). [2025-10-03T17:35:55.333306] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-03T17:35:55.754612] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:55.905289] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T17:35:55.928637] [INFO ] [REMOTE ] BGSF: Full fetch complete (9038 records). [2025-10-03T17:35:55.939178] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-03T17:35:55.999710] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-03T17:35:56.109978] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-03T17:35:56.134911] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-03T17:35:56.156398] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-03T17:35:56.162669] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-03T17:35:56.297808] [DEBUG] [LOCAL ] BGS: Trimmed 72486 records to 51155 (keeping 200 days of data) [2025-10-03T17:35:56.517469] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:35:56.639271] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-03T17:35:56.639904] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-03T17:35:56.640702] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-03T17:35:56.640785] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-03T17:35:56.643046] [DEBUG] [LOCAL ] BGSF: Trimmed 9038 records to 7724 (keeping 200 days of data) [2025-10-03T17:35:56.706443] [DEBUG] [LOCAL ] BGSF: Primary data saved (7724 records). [2025-10-03T17:35:56.706910] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-03T17:35:56.707262] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGSF took 40.6s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-10-03T17:35:56.799744] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-03T17:35:57.011165] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:57.021175] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T17:35:57.087789] [DEBUG] [LOCAL ] BHC: Loaded 47149 existing records from primary storage. [2025-10-03T17:35:57.089555] [INFO ] [MAIN ] BHC: Loaded 47149 existing records. [2025-10-03T17:35:57.332169] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:57.337885] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-03T17:35:57.353046] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-03T17:35:57.355035] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-03T17:35:57.355115] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-03T17:35:57.593943] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-03T17:35:57.726173] [DEBUG] [LOCAL ] BGS: Primary data saved (51155 records). [2025-10-03T17:35:57.731823] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-03T17:35:57.732933] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BGS took 46.7s. Estimated remaining: 4h 43m 51s. Rate: 7.4 symbols/min [2025-10-03T17:35:57.870631] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:57.988193] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:35:58.011024] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:35:58.038564] [DEBUG] [LOCAL ] BHE: Loaded 24774 existing records from primary storage. [2025-10-03T17:35:58.038894] [INFO ] [MAIN ] BHE: Loaded 24774 existing records. [2025-10-03T17:35:58.240484] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:35:58.240816] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-03T17:35:58.241047] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-03T17:35:58.247183] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-03T17:35:58.247384] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-03T17:35:58.253704] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:35:58.395881] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-03T17:35:58.663229] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:35:59.190673] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-03T17:35:59.565180] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T17:35:59.990697] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-03T17:36:00.488013] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:36:00.790732] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-03T17:36:01.383364] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T17:36:01.590724] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-03T17:36:01.999372] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T17:36:02.186045] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T17:36:02.390727] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-03T17:36:03.190637] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-03T17:36:03.337014] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T17:36:03.990733] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-03T17:36:04.427675] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:36:04.790737] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-03T17:36:05.046211] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T17:36:05.590743] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-03T17:36:06.390730] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-03T17:36:06.422525] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T17:36:06.542847] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:36:07.190702] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-03T17:36:07.405011] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:36:07.990735] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-03T17:36:08.354611] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T17:36:08.790637] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-03T17:36:09.026616] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:36:09.590714] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-03T17:36:09.778965] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:36:10.390707] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-03T17:36:10.957813] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:36:11.190695] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-03T17:36:11.292145] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:36:11.990736] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-03T17:36:12.715466] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T17:36:12.773415] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:36:12.790710] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-03T17:36:13.590636] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-03T17:36:13.912591] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T17:36:14.390734] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-03T17:36:14.657214] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:36:15.190762] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-03T17:36:15.505444] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T17:36:15.990708] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-03T17:36:16.113604] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T17:36:16.790740] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-03T17:36:17.529849] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:36:17.590683] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-03T17:36:17.600965] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T17:36:17.602765] [INFO ] [REMOTE ] BH: Full fetch complete (19687 records). [2025-10-03T17:36:17.603022] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-03T17:36:18.031480] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-03T17:36:18.031572] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-03T17:36:18.031943] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-03T17:36:18.032007] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-03T17:36:18.032700] [DEBUG] [LOCAL ] BH: Trimmed 19687 records to 16097 (keeping 200 days of data) [2025-10-03T17:36:18.139012] [DEBUG] [LOCAL ] BH: Primary data saved (16097 records). [2025-10-03T17:36:18.139173] [INFO ] [MAIN ] BH: Full history saved. [2025-10-03T17:36:18.139284] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BH took 23.4s. Estimated remaining: 4h 45m 20s. Rate: 7.4 symbols/min [2025-10-03T17:36:18.334351] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:18.358183] [DEBUG] [LOCAL ] BHK: Loaded 23155 existing records from primary storage. [2025-10-03T17:36:18.358499] [INFO ] [MAIN ] BHK: Loaded 23155 existing records. [2025-10-03T17:36:18.395965] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-03T17:36:18.566104] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:18.566348] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-03T17:36:18.566403] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-03T17:36:18.567307] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-03T17:36:18.567372] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-03T17:36:19.015994] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:19.195808] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-03T17:36:19.211498] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:36:19.296806] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:36:19.298907] [INFO ] [REMOTE ] BGY: Full fetch complete (33111 records). [2025-10-03T17:36:19.299047] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-03T17:36:19.721110] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-03T17:36:19.721201] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-03T17:36:19.721666] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-03T17:36:19.721741] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-03T17:36:19.722818] [DEBUG] [LOCAL ] BGY: Trimmed 33111 records to 22654 (keeping 200 days of data) [2025-10-03T17:36:19.865125] [DEBUG] [LOCAL ] BGY: Primary data saved (22654 records). [2025-10-03T17:36:19.865258] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-03T17:36:19.865349] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGY took 26.5s. Estimated remaining: 4h 44m 22s. Rate: 7.4 symbols/min [2025-10-03T17:36:19.995838] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-03T17:36:20.064498] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:20.129017] [DEBUG] [LOCAL ] BHP: Loaded 53758 existing records from primary storage. [2025-10-03T17:36:20.129358] [INFO ] [MAIN ] BHP: Loaded 53758 existing records. [2025-10-03T17:36:20.351670] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:20.352218] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-03T17:36:20.352342] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-03T17:36:20.359118] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-03T17:36:20.359228] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-03T17:36:20.460632] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T17:36:20.782173] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:20.790620] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-03T17:36:20.888810] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:36:21.590675] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-03T17:36:22.390637] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-03T17:36:22.514612] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T17:36:22.823173] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:36:23.190635] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-03T17:36:23.494273] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T17:36:23.990637] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-03T17:36:24.795771] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-03T17:36:24.801792] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T17:36:25.590704] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-03T17:36:25.761488] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T17:36:25.992929] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-03T17:36:26.390639] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-03T17:36:26.694512] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T17:36:27.190703] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-03T17:36:27.757153] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T17:36:27.990697] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-03T17:36:28.228097] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T17:36:28.790709] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-03T17:36:29.590696] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-03T17:36:29.930076] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T17:36:30.227424] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T17:36:30.390704] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-03T17:36:30.577881] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:36:31.190699] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-03T17:36:31.941036] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:36:31.990694] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-03T17:36:32.399023] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:36:32.790728] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-03T17:36:33.505251] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:36:33.590710] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-03T17:36:34.004012] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:36:34.390783] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-03T17:36:35.132277] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:36:35.190676] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-03T17:36:35.990712] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-03T17:36:36.613053] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-03T17:36:36.790712] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-03T17:36:37.036143] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:36:37.277856] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T17:36:37.590686] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-03T17:36:38.390731] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-03T17:36:38.642560] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:36:38.725535] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:36:39.190689] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-03T17:36:39.969964] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:36:39.990619] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-03T17:36:40.795724] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-03T17:36:40.802048] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:36:41.536136] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:36:41.539749] [INFO ] [REMOTE ] BHC: Full fetch complete (66934 records). [2025-10-03T17:36:41.539906] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-03T17:36:41.595778] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-03T17:36:41.864607] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:36:42.021821] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-03T17:36:42.021916] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-03T17:36:42.022607] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-03T17:36:42.022681] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-03T17:36:42.024115] [DEBUG] [LOCAL ] BHC: Trimmed 66934 records to 47483 (keeping 200 days of data) [2025-10-03T17:36:42.304200] [DEBUG] [LOCAL ] BHC: Primary data saved (47483 records). [2025-10-03T17:36:42.304355] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-03T17:36:42.305014] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BHC took 45.6s. Estimated remaining: 4h 46m 5s. Rate: 7.3 symbols/min [2025-10-03T17:36:42.395825] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-03T17:36:42.493872] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:42.518969] [DEBUG] [LOCAL ] BHR: Loaded 21586 existing records from primary storage. [2025-10-03T17:36:42.519240] [INFO ] [MAIN ] BHR: Loaded 21586 existing records. [2025-10-03T17:36:42.731748] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:42.731980] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-03T17:36:42.732034] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-03T17:36:42.732353] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-03T17:36:42.732417] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-03T17:36:43.128882] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:43.190680] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-03T17:36:43.432480] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:36:43.882081] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T17:36:43.990725] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-03T17:36:44.422592] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T17:36:44.790770] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-03T17:36:45.134721] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T17:36:45.590696] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-03T17:36:46.390673] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-03T17:36:46.473848] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T17:36:46.476082] [INFO ] [REMOTE ] BHK: Full fetch complete (30307 records). [2025-10-03T17:36:46.476180] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-03T17:36:46.899948] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-03T17:36:46.900134] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-03T17:36:46.900690] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-03T17:36:46.900773] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-03T17:36:46.930870] [DEBUG] [LOCAL ] BHK: Trimmed 30307 records to 23317 (keeping 200 days of data) [2025-10-03T17:36:46.932841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-03T17:36:47.092058] [DEBUG] [LOCAL ] BHK: Primary data saved (23317 records). [2025-10-03T17:36:47.092203] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-03T17:36:47.092304] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHK took 29.0s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-10-03T17:36:47.195793] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-03T17:36:47.301433] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:47.301689] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-03T17:36:47.301838] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-03T17:36:47.301995] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-03T17:36:47.302038] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-03T17:36:47.302081] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-03T17:36:47.302115] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-03T17:36:47.640954] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:36:47.714953] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:47.990708] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-03T17:36:48.048144] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:36:48.049617] [INFO ] [REMOTE ] BHE: Full fetch complete (36515 records). [2025-10-03T17:36:48.049870] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-03T17:36:48.468898] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-03T17:36:48.468991] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-03T17:36:48.469455] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-03T17:36:48.469553] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-03T17:36:48.470668] [DEBUG] [LOCAL ] BHE: Trimmed 36515 records to 24909 (keeping 200 days of data) [2025-10-03T17:36:48.627288] [DEBUG] [LOCAL ] BHE: Primary data saved (24909 records). [2025-10-03T17:36:48.627433] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-03T17:36:48.627528] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 50.9s. Estimated remaining: 4h 44m 31s. Rate: 7.4 symbols/min [2025-10-03T17:36:48.791577] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-03T17:36:48.845157] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:48.855973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T17:36:48.906883] [DEBUG] [LOCAL ] BHVN: Loaded 50165 existing records from primary storage. [2025-10-03T17:36:48.907260] [INFO ] [MAIN ] BHVN: Loaded 50165 existing records. [2025-10-03T17:36:49.101534] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:49.101814] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-03T17:36:49.101865] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-03T17:36:49.102524] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-03T17:36:49.102599] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-03T17:36:49.492786] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:49.590675] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-03T17:36:50.390634] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-03T17:36:50.521686] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:36:50.554060] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T17:36:51.190691] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-03T17:36:51.953456] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:36:51.990624] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-03T17:36:52.302990] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:36:52.790743] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-03T17:36:53.224355] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-03T17:36:53.542431] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:36:53.545296] [INFO ] [REMOTE ] BHP: Full fetch complete (77249 records). [2025-10-03T17:36:53.545433] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-03T17:36:53.595746] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-03T17:36:53.989335] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-03T17:36:53.989428] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-03T17:36:53.990310] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-03T17:36:53.990386] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-03T17:36:53.992097] [DEBUG] [LOCAL ] BHP: Trimmed 77249 records to 54148 (keeping 200 days of data) [2025-10-03T17:36:54.335341] [DEBUG] [LOCAL ] BHP: Primary data saved (54148 records). [2025-10-03T17:36:54.335494] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-03T17:36:54.335585] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHP took 34.5s. Estimated remaining: 4h 44m 5s. Rate: 7.4 symbols/min [2025-10-03T17:36:54.396015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-03T17:36:54.528608] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:36:54.578097] [DEBUG] [LOCAL ] BILL: Loaded 52726 existing records from primary storage. [2025-10-03T17:36:54.578688] [INFO ] [MAIN ] BILL: Loaded 52726 existing records. [2025-10-03T17:36:54.791966] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:36:54.803865] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-03T17:36:54.806933] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-03T17:36:54.807036] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-03T17:36:54.806816] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:36:54.812618] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-03T17:36:54.812722] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-03T17:36:55.206386] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-03T17:36:55.212831] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:36:55.990730] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-03T17:36:56.308278] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-03T17:36:56.403267] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:36:56.790727] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-03T17:36:57.136925] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T17:36:57.590685] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-03T17:36:57.950075] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T17:36:58.390723] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-03T17:36:59.190698] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-03T17:36:59.960200] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:36:59.990715] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-03T17:37:00.298406] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T17:37:00.790712] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-03T17:37:01.590720] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-03T17:37:01.953853] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T17:37:01.973729] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-03T17:37:02.390620] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-03T17:37:02.567713] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T17:37:03.190715] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-03T17:37:03.990635] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-03T17:37:04.117026] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:37:04.215330] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T17:37:04.448453] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T17:37:04.790729] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-03T17:37:05.590733] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-03T17:37:05.934195] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T17:37:06.390744] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-03T17:37:06.536700] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:37:07.190702] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-03T17:37:07.736622] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T17:37:07.990730] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-03T17:37:08.790697] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-03T17:37:08.885192] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:37:09.020915] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T17:37:09.022635] [INFO ] [REMOTE ] BHR: Full fetch complete (30914 records). [2025-10-03T17:37:09.022741] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-03T17:37:09.438453] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-03T17:37:09.438537] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-03T17:37:09.439045] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-03T17:37:09.439129] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-03T17:37:09.440063] [DEBUG] [LOCAL ] BHR: Trimmed 30914 records to 21779 (keeping 200 days of data) [2025-10-03T17:37:09.572224] [DEBUG] [LOCAL ] BHR: Primary data saved (21779 records). [2025-10-03T17:37:09.572353] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-03T17:37:09.572433] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHR took 27.3s. Estimated remaining: 4h 44m 51s. Rate: 7.4 symbols/min [2025-10-03T17:37:09.595723] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-03T17:37:09.759586] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:09.784809] [DEBUG] [LOCAL ] BIO: Loaded 25067 existing records from primary storage. [2025-10-03T17:37:09.785086] [INFO ] [MAIN ] BIO: Loaded 25067 existing records. [2025-10-03T17:37:09.979850] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:09.980102] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-03T17:37:09.980173] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-03T17:37:09.980417] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-03T17:37:09.980475] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-03T17:37:10.381799] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:10.390694] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-03T17:37:10.610249] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:37:11.001829] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:37:11.190621] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-03T17:37:11.505406] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T17:37:11.990672] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-03T17:37:12.790677] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-03T17:37:12.980939] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:37:13.590699] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-03T17:37:13.859799] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:37:13.928902] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T17:37:14.390739] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-03T17:37:14.852498] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T17:37:15.190693] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-03T17:37:15.335830] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:37:15.990684] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-03T17:37:16.511996] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:37:16.790717] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-03T17:37:17.217721] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:37:17.590740] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-03T17:37:17.700231] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:37:17.946148] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:37:17.946833] [INFO ] [REMOTE ] BHV: Full fetch complete (1365 records). [2025-10-03T17:37:17.946906] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-03T17:37:18.154624] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-03T17:37:18.154921] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:37:18.154998] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:37:18.155076] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-03T17:37:18.155147] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-03T17:37:18.155202] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-03T17:37:18.155268] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-03T17:37:18.155354] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHV took 31.1s. Estimated remaining: 4h 44m 46s. Rate: 7.4 symbols/min [2025-10-03T17:37:18.343075] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:18.395811] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-03T17:37:18.399571] [DEBUG] [LOCAL ] BIP: Loaded 39822 existing records from primary storage. [2025-10-03T17:37:18.400076] [INFO ] [MAIN ] BIP: Loaded 39822 existing records. [2025-10-03T17:37:18.601906] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:18.602143] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-03T17:37:18.602192] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-03T17:37:18.602427] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-03T17:37:18.602486] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-03T17:37:18.991809] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:19.190709] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-03T17:37:19.995816] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-03T17:37:20.013891] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:37:20.790718] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-03T17:37:21.008526] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T17:37:21.072581] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:37:21.590714] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-03T17:37:22.225600] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:37:22.390727] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-03T17:37:22.928366] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T17:37:23.190728] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-03T17:37:23.990698] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-03T17:37:24.050680] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:37:24.098102] [DEBUG] [REMOTE ] BIO: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T17:37:24.098445] [WARN ] [REMOTE ] BIO: No data returned for month 2025-05 [2025-10-03T17:37:24.098565] [FATAL] [REMOTE ] BIO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:37:24.098694] [FATAL] [MAIN ] BIO: Failed to fetch primary data. [2025-10-03T17:37:24.098767] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:37:24.098838] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-03T17:37:24.098906] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-03T17:37:24.098946] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-03T17:37:24.099273] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-03T17:37:24.099361] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BIO took 14.5s. Estimated remaining: 4h 44m 21s. Rate: 7.4 symbols/min [2025-10-03T17:37:24.293983] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:24.337831] [DEBUG] [LOCAL ] BIPC: Loaded 41695 existing records from primary storage. [2025-10-03T17:37:24.338218] [INFO ] [MAIN ] BIPC: Loaded 41695 existing records. [2025-10-03T17:37:24.553442] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:24.553703] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-03T17:37:24.553764] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-03T17:37:24.554198] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-03T17:37:24.554264] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-03T17:37:24.797551] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-03T17:37:24.970684] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:25.075163] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:37:25.590716] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-03T17:37:26.178496] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:37:26.390722] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-03T17:37:27.190703] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-03T17:37:27.387164] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:37:27.805903] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:37:27.990681] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-03T17:37:28.611217] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T17:37:28.790687] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-03T17:37:29.590688] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-03T17:37:29.632556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:37:29.635481] [INFO ] [REMOTE ] BILL: Full fetch complete (75741 records). [2025-10-03T17:37:29.635585] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-03T17:37:30.077234] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-03T17:37:30.077319] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-03T17:37:30.078231] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-03T17:37:30.078301] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-03T17:37:30.080009] [DEBUG] [LOCAL ] BILL: Trimmed 75741 records to 53112 (keeping 200 days of data) [2025-10-03T17:37:30.391351] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-03T17:37:30.413951] [DEBUG] [LOCAL ] BILL: Primary data saved (53112 records). [2025-10-03T17:37:30.414096] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-03T17:37:30.414181] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BILL took 36.1s. Estimated remaining: 4h 43m 59s. Rate: 7.4 symbols/min [2025-10-03T17:37:30.605257] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:30.605550] [DEBUG] [LOCAL ] BIPH: No existing data file found in primary storage. [2025-10-03T17:37:30.605624] [WARN ] [MAIN ] BIPH: No existing data found, performing full refresh instead. [2025-10-03T17:37:30.605883] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-03T17:37:30.605956] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-03T17:37:30.606068] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-10-03T17:37:30.606186] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-03T17:37:30.872578] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T17:37:31.052874] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:31.082380] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:37:31.190690] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-03T17:37:31.858915] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:37:31.979233] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T17:37:31.990599] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-03T17:37:32.790696] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-03T17:37:33.447812] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:37:33.590723] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-03T17:37:34.390715] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-03T17:37:34.483717] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T17:37:34.486463] [INFO ] [REMOTE ] BHVN: Full fetch complete (70033 records). [2025-10-03T17:37:34.486705] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-03T17:37:34.836687] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:37:34.941147] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-03T17:37:34.941247] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-03T17:37:34.942125] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-03T17:37:34.942201] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-03T17:37:34.943919] [DEBUG] [LOCAL ] BHVN: Trimmed 70033 records to 50537 (keeping 200 days of data) [2025-10-03T17:37:35.215669] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-03T17:37:35.256572] [DEBUG] [LOCAL ] BHVN: Primary data saved (50537 records). [2025-10-03T17:37:35.256790] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-03T17:37:35.258048] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BHVN took 46.6s. Estimated remaining: 4h 43m 26s. Rate: 7.4 symbols/min [2025-10-03T17:37:35.284597] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T17:37:35.990714] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-03T17:37:36.557199] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:37:36.790737] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-03T17:37:37.288336] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T17:37:37.590682] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-03T17:37:38.096388] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:37:38.390694] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-03T17:37:38.821706] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:37:39.063839] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T17:37:39.190698] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-03T17:37:39.742240] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T17:37:39.990749] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-03T17:37:40.541342] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:37:40.790733] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-03T17:37:41.590735] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-03T17:37:42.112863] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T17:37:42.333935] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:37:42.390747] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-03T17:37:43.190690] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-03T17:37:43.622248] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T17:37:43.811603] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:37:43.990728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-03T17:37:44.790698] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-03T17:37:45.379725] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T17:37:45.590758] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-03T17:37:46.037235] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T17:37:46.236612] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:37:46.390740] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-03T17:37:46.844308] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T17:37:47.190749] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-03T17:37:47.990761] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-03T17:37:48.661458] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:37:48.790733] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-03T17:37:49.564820] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:37:49.590613] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-03T17:37:50.390753] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-03T17:37:50.422799] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T17:37:50.889986] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:37:50.970531] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:37:51.190687] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-03T17:37:51.553833] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T17:37:51.554777] [INFO ] [REMOTE ] BIPH: Full fetch complete (4289 records). [2025-10-03T17:37:51.554851] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-03T17:37:51.939508] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-03T17:37:51.939634] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-03T17:37:51.940033] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-03T17:37:51.940104] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-03T17:37:51.940745] [DEBUG] [LOCAL ] BIPH: Trimmed 4289 records to 2595 (keeping 200 days of data) [2025-10-03T17:37:51.961224] [DEBUG] [LOCAL ] BIPH: Primary data saved (2595 records). [2025-10-03T17:37:51.961338] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-03T17:37:51.961436] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIPH took 21.5s. Estimated remaining: 4h 44m 23s. Rate: 7.4 symbols/min [2025-10-03T17:37:51.990703] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-03T17:37:52.790751] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-03T17:37:53.460524] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T17:37:53.590626] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-03T17:37:53.997839] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T17:37:54.000329] [INFO ] [REMOTE ] BIP: Full fetch complete (56949 records). [2025-10-03T17:37:54.000443] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-03T17:37:54.428624] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-03T17:37:54.428762] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-03T17:37:54.429451] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-03T17:37:54.429501] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-03T17:37:54.431005] [DEBUG] [LOCAL ] BIP: Trimmed 56949 records to 40146 (keeping 200 days of data) [2025-10-03T17:37:54.687177] [DEBUG] [LOCAL ] BIP: Primary data saved (40146 records). [2025-10-03T17:37:54.687344] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-03T17:37:54.687451] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BIP took 36.5s. Estimated remaining: 4h 43m 34s. Rate: 7.4 symbols/min [2025-10-03T17:37:54.820782] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:37:54.824530] [INFO ] [REMOTE ] BIPC: Full fetch complete (59910 records). [2025-10-03T17:37:54.824907] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-03T17:37:55.234288] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-03T17:37:55.234398] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-03T17:37:55.235265] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-03T17:37:55.235337] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-03T17:37:55.237059] [DEBUG] [LOCAL ] BIPC: Trimmed 59910 records to 41980 (keeping 200 days of data) [2025-10-03T17:37:55.513752] [DEBUG] [LOCAL ] BIPC: Primary data saved (41980 records). [2025-10-03T17:37:55.513997] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-03T17:37:55.515004] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 31.4s. Estimated remaining: 4h 42m 31s. Rate: 7.4 symbols/min [2025-10-03T17:37:56.227108] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.244162] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.330509] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.339792] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:37:56.346234] [DEBUG] [LOCAL ] BIPI: Loaded 3215 existing records from primary storage. [2025-10-03T17:37:56.346707] [INFO ] [MAIN ] BIPI: Loaded 3215 existing records. [2025-10-03T17:37:56.399800] [DEBUG] [LOCAL ] BIPJ: Loaded 3136 existing records from primary storage. [2025-10-03T17:37:56.453099] [INFO ] [MAIN ] BIPJ: Loaded 3136 existing records. [2025-10-03T17:37:56.565229] [DEBUG] [LOCAL ] BIT: Loaded 23002 existing records from primary storage. [2025-10-03T17:37:56.621802] [INFO ] [MAIN ] BIT: Loaded 23002 existing records. [2025-10-03T17:37:56.802045] [DEBUG] [LOCAL ] BIRK: Loaded 51310 existing records from primary storage. [2025-10-03T17:37:56.871637] [INFO ] [MAIN ] BIRK: Loaded 51310 existing records. [2025-10-03T17:37:56.910182] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:56.906141] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:56.976266] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-03T17:37:56.987154] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-03T17:37:56.981861] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.042997] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-03T17:37:57.048289] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-03T17:37:57.056715] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-03T17:37:57.066104] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-03T17:37:57.162581] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-03T17:37:57.384344] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:57.397145] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:37:57.423442] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.472076] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-03T17:37:57.533143] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-03T17:37:57.575778] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-03T17:37:57.586439] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-03T17:37:57.624257] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-03T17:37:57.639354] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-03T17:37:57.681758] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-03T17:37:58.132217] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.219498] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-03T17:37:58.693547] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.711581] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-03T17:37:58.864625] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.886192] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-03T17:37:58.885897] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:37:58.887373] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-03T17:37:59.025283] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:37:59.027616] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-03T17:37:59.521063] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T17:37:59.522766] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-03T17:37:59.532919] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:37:59.536665] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-03T17:37:59.760037] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T17:37:59.965139] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T17:37:59.990678] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-03T17:38:00.152219] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:38:00.253437] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:38:00.330544] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T17:38:00.790807] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-03T17:38:01.254977] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T17:38:01.590729] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-03T17:38:02.390790] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-03T17:38:02.862852] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:38:03.120583] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:38:03.190690] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-03T17:38:03.741665] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:38:03.990712] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-03T17:38:04.533203] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T17:38:04.790726] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-03T17:38:05.235014] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T17:38:05.590721] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-03T17:38:06.239846] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T17:38:06.390714] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-03T17:38:07.190717] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-03T17:38:07.311783] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T17:38:07.476610] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-03T17:38:07.990787] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-03T17:38:08.790745] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-03T17:38:08.957490] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:38:09.436742] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:38:09.590795] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-03T17:38:10.390779] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-03T17:38:11.121738] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:38:11.170139] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:38:11.190630] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-03T17:38:11.735362] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T17:38:11.990722] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-03T17:38:12.790709] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-03T17:38:13.140638] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:38:13.287765] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T17:38:13.288723] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4412 records). [2025-10-03T17:38:13.288796] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-03T17:38:13.596163] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-03T17:38:13.688370] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-03T17:38:13.688480] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-03T17:38:13.688693] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-03T17:38:13.688757] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-03T17:38:13.689144] [DEBUG] [LOCAL ] BIPJ: Trimmed 4412 records to 3148 (keeping 200 days of data) [2025-10-03T17:38:13.709879] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3148 records). [2025-10-03T17:38:13.709990] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-03T17:38:13.710080] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPJ took 18.2s. Estimated remaining: 4h 43m 38s. Rate: 7.4 symbols/min [2025-10-03T17:38:13.895323] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:13.950866] [DEBUG] [LOCAL ] BJ: Loaded 51762 existing records from primary storage. [2025-10-03T17:38:13.951238] [INFO ] [MAIN ] BJ: Loaded 51762 existing records. [2025-10-03T17:38:14.137898] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:14.138273] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-03T17:38:14.138329] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-03T17:38:14.138617] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-03T17:38:14.138716] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-03T17:38:14.399309] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-03T17:38:14.567422] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:15.190746] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-03T17:38:15.282963] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:38:15.344057] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:38:15.990738] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-03T17:38:16.563688] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:38:16.790711] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-03T17:38:17.437635] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T17:38:17.590737] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-03T17:38:18.157785] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T17:38:18.345596] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T17:38:18.390707] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-03T17:38:18.908114] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T17:38:19.190721] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-03T17:38:19.766203] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T17:38:19.990733] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-03T17:38:20.790758] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-03T17:38:21.590728] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-03T17:38:21.801144] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T17:38:21.841773] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:38:22.390696] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-03T17:38:23.190689] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-03T17:38:23.263204] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T17:38:23.929842] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:38:23.990689] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-03T17:38:24.201042] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:38:24.790725] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-03T17:38:25.590630] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-03T17:38:25.834574] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:38:25.921460] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:38:26.390695] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-03T17:38:27.003982] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:38:27.190690] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-03T17:38:27.701873] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T17:38:27.990685] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-03T17:38:28.790678] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-03T17:38:29.072522] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:38:29.590708] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-03T17:38:29.819887] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T17:38:30.220788] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T17:38:30.390782] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-03T17:38:31.190692] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-03T17:38:31.376872] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:38:31.519529] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T17:38:31.521513] [INFO ] [REMOTE ] BIT: Full fetch complete (31878 records). [2025-10-03T17:38:31.521718] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-03T17:38:31.950419] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-03T17:38:31.950523] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-03T17:38:31.951174] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-03T17:38:31.951243] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-03T17:38:31.952331] [DEBUG] [LOCAL ] BIT: Trimmed 31878 records to 23266 (keeping 200 days of data) [2025-10-03T17:38:32.012748] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-03T17:38:32.108505] [DEBUG] [LOCAL ] BIT: Primary data saved (23266 records). [2025-10-03T17:38:32.108671] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-03T17:38:32.108811] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIT took 36.6s. Estimated remaining: 4h 44m 46s. Rate: 7.3 symbols/min [2025-10-03T17:38:32.300314] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:32.359371] [DEBUG] [LOCAL ] BK: Loaded 53927 existing records from primary storage. [2025-10-03T17:38:32.359839] [INFO ] [MAIN ] BK: Loaded 53927 existing records. [2025-10-03T17:38:32.559367] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:32.559631] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-03T17:38:32.559725] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-03T17:38:32.560240] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-03T17:38:32.560300] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-03T17:38:32.794769] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-03T17:38:32.966138] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:33.001954] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:38:33.343732] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T17:38:33.344469] [INFO ] [REMOTE ] BIPI: Full fetch complete (5099 records). [2025-10-03T17:38:33.344552] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-03T17:38:33.600547] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-03T17:38:33.766819] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-03T17:38:33.767041] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-03T17:38:33.767238] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-03T17:38:33.767414] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-03T17:38:33.768028] [DEBUG] [LOCAL ] BIPI: Trimmed 5099 records to 3229 (keeping 200 days of data) [2025-10-03T17:38:33.791129] [DEBUG] [LOCAL ] BIPI: Primary data saved (3229 records). [2025-10-03T17:38:33.791441] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-03T17:38:33.791544] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIPI took 38.3s. Estimated remaining: 4h 43m 50s. Rate: 7.4 symbols/min [2025-10-03T17:38:33.966576] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T17:38:34.053840] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:34.114257] [DEBUG] [LOCAL ] BKD: Loaded 50577 existing records from primary storage. [2025-10-03T17:38:34.114691] [INFO ] [MAIN ] BKD: Loaded 50577 existing records. [2025-10-03T17:38:34.310704] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:34.310957] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-03T17:38:34.311009] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-03T17:38:34.311388] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-03T17:38:34.311449] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-03T17:38:34.397468] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-03T17:38:34.743265] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:35.190695] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-03T17:38:35.534900] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:38:35.990742] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-03T17:38:36.427774] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-03T17:38:36.434417] [INFO ] [REMOTE ] BIRK: Full fetch complete (73086 records). [2025-10-03T17:38:36.434560] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-03T17:38:36.801738] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-03T17:38:36.858623] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-03T17:38:36.858906] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-03T17:38:36.859819] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-03T17:38:36.859987] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-03T17:38:36.871912] [DEBUG] [LOCAL ] BIRK: Trimmed 73086 records to 51678 (keeping 200 days of data) [2025-10-03T17:38:36.890352] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T17:38:37.212586] [DEBUG] [LOCAL ] BIRK: Primary data saved (51678 records). [2025-10-03T17:38:37.212765] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-03T17:38:37.212873] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 41.7s. Estimated remaining: 4h 43m 7s. Rate: 7.4 symbols/min [2025-10-03T17:38:37.405233] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:37.438951] [DEBUG] [LOCAL ] BKE: Loaded 34657 existing records from primary storage. [2025-10-03T17:38:37.439245] [INFO ] [MAIN ] BKE: Loaded 34657 existing records. [2025-10-03T17:38:37.596929] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-03T17:38:37.629615] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:37.629852] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-03T17:38:37.629901] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-03T17:38:37.630292] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-03T17:38:37.630352] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-03T17:38:38.014445] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:38.050892] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T17:38:38.150992] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T17:38:38.390715] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-03T17:38:39.079808] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:38:39.190694] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-03T17:38:39.990685] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-03T17:38:40.066875] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:38:40.274007] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:38:40.790718] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-03T17:38:41.590716] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-03T17:38:41.626909] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:38:42.390714] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-03T17:38:42.536175] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:38:43.067810] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:38:43.190686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-03T17:38:43.978109] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:38:43.990619] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-03T17:38:44.546893] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T17:38:44.790678] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-03T17:38:45.237735] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T17:38:45.590687] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-03T17:38:46.390702] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-03T17:38:46.461639] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:38:47.190636] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-03T17:38:47.526591] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T17:38:47.973023] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T17:38:47.990702] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-03T17:38:48.561845] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:38:48.790728] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-03T17:38:49.590692] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-03T17:38:49.685114] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:38:50.256375] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:38:50.261609] [INFO ] [REMOTE ] BJ: Full fetch complete (73916 records). [2025-10-03T17:38:50.261840] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-03T17:38:50.395852] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-03T17:38:50.715120] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-03T17:38:50.715252] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-03T17:38:50.716043] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-03T17:38:50.716112] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-03T17:38:50.717874] [DEBUG] [LOCAL ] BJ: Trimmed 73916 records to 52136 (keeping 200 days of data) [2025-10-03T17:38:51.050489] [DEBUG] [LOCAL ] BJ: Primary data saved (52136 records). [2025-10-03T17:38:51.050723] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-03T17:38:51.050829] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BJ took 37.3s. Estimated remaining: 4h 43m 40s. Rate: 7.4 symbols/min [2025-10-03T17:38:51.195285] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-03T17:38:51.249452] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:38:51.294398] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:38:51.315364] [DEBUG] [LOCAL ] BKH: Loaded 36907 existing records from primary storage. [2025-10-03T17:38:51.315717] [INFO ] [MAIN ] BKH: Loaded 36907 existing records. [2025-10-03T17:38:51.504573] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:38:51.504833] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-03T17:38:51.504886] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-03T17:38:51.505340] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-03T17:38:51.505399] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-03T17:38:51.897759] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:38:51.929675] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:38:51.990700] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-03T17:38:52.790723] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-03T17:38:52.838089] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:38:53.529818] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:38:53.590689] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-03T17:38:54.063504] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:38:54.390727] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-03T17:38:55.149001] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:38:55.190706] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-03T17:38:55.671829] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:38:55.990680] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-03T17:38:56.415727] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:38:56.790754] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-03T17:38:57.356179] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T17:38:57.590716] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-03T17:38:58.393320] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-03T17:38:58.396628] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T17:38:58.574456] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:38:59.190750] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-03T17:38:59.919628] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:38:59.990632] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-03T17:39:00.790736] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-03T17:39:01.398739] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T17:39:01.590689] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-03T17:39:01.723711] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T17:39:02.204088] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:39:02.390728] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-03T17:39:03.190726] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-03T17:39:03.394008] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:39:03.990672] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-03T17:39:04.065331] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:39:04.410393] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T17:39:04.790712] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-03T17:39:05.568335] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T17:39:05.590691] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-03T17:39:06.258339] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:39:06.390721] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-03T17:39:06.739360] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T17:39:06.743714] [INFO ] [REMOTE ] BK: Full fetch complete (77479 records). [2025-10-03T17:39:06.743942] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-03T17:39:07.195874] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-03T17:39:07.437585] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-03T17:39:07.437789] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-03T17:39:07.439426] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-03T17:39:07.439582] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-03T17:39:07.458468] [DEBUG] [LOCAL ] BK: Trimmed 77479 records to 54317 (keeping 200 days of data) [2025-10-03T17:39:07.485144] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T17:39:07.951953] [DEBUG] [LOCAL ] BK: Primary data saved (54317 records). [2025-10-03T17:39:07.952120] [INFO ] [MAIN ] BK: Full history saved. [2025-10-03T17:39:07.952848] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BK took 35.8s. Estimated remaining: 4h 44m 36s. Rate: 7.3 symbols/min [2025-10-03T17:39:07.995895] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-03T17:39:08.183036] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:08.226031] [DEBUG] [LOCAL ] BKKT: Loaded 35643 existing records from primary storage. [2025-10-03T17:39:08.226362] [INFO ] [MAIN ] BKKT: Loaded 35643 existing records. [2025-10-03T17:39:08.427499] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:08.427799] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-03T17:39:08.427852] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-03T17:39:08.428185] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-03T17:39:08.428256] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-03T17:39:08.796087] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-03T17:39:08.835157] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:08.856237] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T17:39:09.218914] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T17:39:09.221164] [INFO ] [REMOTE ] BKE: Full fetch complete (50229 records). [2025-10-03T17:39:09.221276] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-03T17:39:09.596447] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-03T17:39:09.653008] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-03T17:39:09.653154] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-03T17:39:09.653818] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-03T17:39:09.653893] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-03T17:39:09.655108] [DEBUG] [LOCAL ] BKE: Trimmed 50229 records to 34858 (keeping 200 days of data) [2025-10-03T17:39:09.873243] [DEBUG] [LOCAL ] BKE: Primary data saved (34858 records). [2025-10-03T17:39:09.873409] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-03T17:39:09.873517] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 32.7s. Estimated remaining: 4h 43m 42s. Rate: 7.3 symbols/min [2025-10-03T17:39:10.070677] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:10.081320] [DEBUG] [LOCAL ] BKN: Loaded 7808 existing records from primary storage. [2025-10-03T17:39:10.081593] [INFO ] [MAIN ] BKN: Loaded 7808 existing records. [2025-10-03T17:39:10.278540] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:10.278804] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-03T17:39:10.278865] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-03T17:39:10.279127] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-03T17:39:10.279188] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-03T17:39:10.402315] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-03T17:39:10.603538] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T17:39:10.618977] [INFO ] [REMOTE ] BKD: Full fetch complete (71734 records). [2025-10-03T17:39:10.629731] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-03T17:39:10.780947] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:11.152519] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-03T17:39:11.152706] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-03T17:39:11.153810] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-03T17:39:11.153921] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-03T17:39:11.155637] [DEBUG] [LOCAL ] BKD: Trimmed 71734 records to 50962 (keeping 200 days of data) [2025-10-03T17:39:11.201817] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-03T17:39:11.265131] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:39:11.503913] [DEBUG] [LOCAL ] BKD: Primary data saved (50962 records). [2025-10-03T17:39:11.504062] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-03T17:39:11.504201] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BKD took 37.7s. Estimated remaining: 4h 42m 47s. Rate: 7.4 symbols/min [2025-10-03T17:39:11.690144] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:11.690338] [DEBUG] [LOCAL ] BKSY: No existing data file found in primary storage. [2025-10-03T17:39:11.690384] [WARN ] [MAIN ] BKSY: No existing data found, performing full refresh instead. [2025-10-03T17:39:11.690504] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-03T17:39:11.690548] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-03T17:39:11.690593] [DEBUG] [LOCAL ] BKSY: No primary data file found to delete. [2025-10-03T17:39:11.690627] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-03T17:39:11.999066] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-03T17:39:12.098889] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:12.284436] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:39:12.333590] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:39:12.790717] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-03T17:39:13.416747] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T17:39:13.590709] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-03T17:39:14.058836] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:39:14.390691] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-03T17:39:15.190732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-03T17:39:15.408771] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:39:15.599897] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T17:39:15.994763] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-03T17:39:15.995897] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T17:39:16.790689] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-03T17:39:17.174751] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:39:17.406452] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T17:39:17.590695] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-03T17:39:18.390715] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-03T17:39:18.928993] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T17:39:19.190697] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-03T17:39:19.990718] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-03T17:39:20.133571] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T17:39:20.790716] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-03T17:39:20.855919] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:39:21.397104] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T17:39:21.399688] [INFO ] [REMOTE ] BKH: Full fetch complete (52456 records). [2025-10-03T17:39:21.399798] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-03T17:39:21.595310] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-03T17:39:21.820940] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-03T17:39:21.821217] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-03T17:39:21.821875] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-03T17:39:21.821943] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-03T17:39:21.823219] [DEBUG] [LOCAL ] BKH: Trimmed 52456 records to 37195 (keeping 200 days of data) [2025-10-03T17:39:22.061832] [DEBUG] [LOCAL ] BKH: Primary data saved (37195 records). [2025-10-03T17:39:22.062614] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-03T17:39:22.062907] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKH took 31.0s. Estimated remaining: 4h 42m 56s. Rate: 7.4 symbols/min [2025-10-03T17:39:22.254774] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:22.268847] [DEBUG] [LOCAL ] BKT: Loaded 11524 existing records from primary storage. [2025-10-03T17:39:22.269100] [INFO ] [MAIN ] BKT: Loaded 11524 existing records. [2025-10-03T17:39:22.395747] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-03T17:39:22.471196] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:22.471545] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-03T17:39:22.471680] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-03T17:39:22.472259] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-03T17:39:22.472325] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-03T17:39:22.612813] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:39:22.883721] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:22.910840] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T17:39:23.190685] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-03T17:39:23.694732] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T17:39:23.950891] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:39:23.990611] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-03T17:39:24.768551] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T17:39:24.790614] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-03T17:39:25.292248] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T17:39:25.590687] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-03T17:39:25.694044] [DEBUG] [REMOTE ] BKKT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T17:39:25.694375] [WARN ] [REMOTE ] BKKT: No data returned for month 2025-05 [2025-10-03T17:39:25.694485] [FATAL] [REMOTE ] BKKT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:39:25.694588] [FATAL] [MAIN ] BKKT: Failed to fetch primary data. [2025-10-03T17:39:25.694679] [WARN ] [MAIN ] BKKT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:39:25.694760] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-03T17:39:25.694839] [DEBUG] [LOCAL ] BKKT: No primary data file found to delete. [2025-10-03T17:39:25.694914] [INFO ] [LOCAL ] BKKT: Starting deletion of derivative data. [2025-10-03T17:39:25.695286] [DEBUG] [LOCAL ] BKKT: Deleted derivative data file. [2025-10-03T17:39:25.697104] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKKT took 17.7s. Estimated remaining: 4h 42m 15s. Rate: 7.4 symbols/min [2025-10-03T17:39:25.891056] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:25.933813] [DEBUG] [LOCAL ] BKU: Loaded 41707 existing records from primary storage. [2025-10-03T17:39:25.934177] [INFO ] [MAIN ] BKU: Loaded 41707 existing records. [2025-10-03T17:39:26.133197] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:26.133408] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-03T17:39:26.133459] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-03T17:39:26.133981] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-03T17:39:26.134043] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-03T17:39:26.395775] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-03T17:39:26.571926] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:27.190684] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-03T17:39:27.211932] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:39:27.990636] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-03T17:39:28.108547] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T17:39:28.790700] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-03T17:39:29.388707] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:39:29.590700] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-03T17:39:29.697678] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:39:30.260283] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T17:39:30.390685] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-03T17:39:31.190690] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-03T17:39:31.941026] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T17:39:31.992896] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-03T17:39:31.998096] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T17:39:32.716515] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T17:39:32.790713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-03T17:39:33.590674] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-03T17:39:33.703366] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T17:39:34.390723] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-03T17:39:34.426158] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T17:39:35.190713] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-03T17:39:35.746673] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T17:39:35.990713] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-03T17:39:36.354920] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:39:36.522335] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:39:36.523348] [INFO ] [REMOTE ] BKN: Full fetch complete (11870 records). [2025-10-03T17:39:36.523423] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-03T17:39:36.796923] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-03T17:39:36.936727] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-03T17:39:36.936816] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-03T17:39:36.937091] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-03T17:39:36.937153] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-03T17:39:36.937679] [DEBUG] [LOCAL ] BKN: Trimmed 11870 records to 7844 (keeping 200 days of data) [2025-10-03T17:39:36.989334] [DEBUG] [LOCAL ] BKN: Primary data saved (7844 records). [2025-10-03T17:39:36.989473] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-03T17:39:36.989580] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKN took 27.1s. Estimated remaining: 4h 42m 30s. Rate: 7.4 symbols/min [2025-10-03T17:39:37.166397] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:37.166608] [DEBUG] [LOCAL ] BKV: No existing data file found in primary storage. [2025-10-03T17:39:37.166684] [WARN ] [MAIN ] BKV: No existing data found, performing full refresh instead. [2025-10-03T17:39:37.166805] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-03T17:39:37.166849] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-03T17:39:37.166893] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-03T17:39:37.166927] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-03T17:39:37.550820] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:37.590612] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-03T17:39:38.358581] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T17:39:38.390684] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-03T17:39:38.596966] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:39:39.190721] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-03T17:39:39.956331] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:39:39.990680] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-03T17:39:40.459118] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T17:39:40.790728] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-03T17:39:40.982362] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T17:39:41.590718] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-03T17:39:41.714772] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T17:39:42.390719] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-03T17:39:43.037130] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:39:43.190734] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-03T17:39:43.990628] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-03T17:39:44.264064] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T17:39:44.418591] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T17:39:44.790666] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-03T17:39:44.811604] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:39:45.590680] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-03T17:39:46.016207] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T17:39:46.390682] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-03T17:39:46.960494] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:39:47.190690] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-03T17:39:47.223456] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T17:39:47.990733] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-03T17:39:48.790738] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-03T17:39:49.506416] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T17:39:49.539905] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T17:39:49.571048] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T17:39:49.590628] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-03T17:39:50.390717] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-03T17:39:51.094317] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:39:51.190730] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-03T17:39:51.863625] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:39:51.990729] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-03T17:39:52.692074] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:39:52.790728] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-03T17:39:53.098383] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:39:53.590726] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-03T17:39:54.046708] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:39:54.390744] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-03T17:39:54.802231] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T17:39:55.190735] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-03T17:39:55.322384] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T17:39:55.990635] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-03T17:39:56.414359] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:39:56.790717] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-03T17:39:57.091911] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T17:39:57.094938] [INFO ] [REMOTE ] BKU: Full fetch complete (59887 records). [2025-10-03T17:39:57.095102] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-03T17:39:57.539777] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-03T17:39:57.539879] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-03T17:39:57.540617] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-03T17:39:57.540722] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-03T17:39:57.542157] [DEBUG] [LOCAL ] BKU: Trimmed 59887 records to 42022 (keeping 200 days of data) [2025-10-03T17:39:57.605329] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-03T17:39:57.815592] [DEBUG] [LOCAL ] BKU: Primary data saved (42022 records). [2025-10-03T17:39:57.815780] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-03T17:39:57.816482] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKU took 32.1s. Estimated remaining: 4h 43m 52s. Rate: 7.3 symbols/min [2025-10-03T17:39:57.994849] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T17:39:58.027983] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:39:58.067751] [DEBUG] [LOCAL ] BLCO: Loaded 35657 existing records from primary storage. [2025-10-03T17:39:58.068078] [INFO ] [MAIN ] BLCO: Loaded 35657 existing records. [2025-10-03T17:39:58.260550] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:39:58.260885] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-03T17:39:58.260951] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-03T17:39:58.261233] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-03T17:39:58.261297] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-03T17:39:58.395860] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-03T17:39:58.661679] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:39:59.190737] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-03T17:39:59.446993] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:39:59.448528] [INFO ] [REMOTE ] BKT: Full fetch complete (15574 records). [2025-10-03T17:39:59.448631] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-03T17:39:59.971255] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-03T17:39:59.971471] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-03T17:39:59.972132] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-03T17:39:59.972411] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-03T17:39:59.995622] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-03T17:39:59.996272] [DEBUG] [LOCAL ] BKT: Trimmed 15574 records to 11681 (keeping 200 days of data) [2025-10-03T17:40:00.023413] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-03T17:40:00.148926] [DEBUG] [LOCAL ] BKT: Primary data saved (11681 records). [2025-10-03T17:40:00.149116] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-03T17:40:00.149244] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 38.1s. Estimated remaining: 4h 43m 2s. Rate: 7.3 symbols/min [2025-10-03T17:40:00.461555] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:00.461891] [DEBUG] [LOCAL ] BLD: No existing data file found in primary storage. [2025-10-03T17:40:00.461986] [WARN ] [MAIN ] BLD: No existing data found, performing full refresh instead. [2025-10-03T17:40:00.462505] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-03T17:40:00.462626] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-03T17:40:00.462777] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-03T17:40:00.462856] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-03T17:40:00.795747] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-03T17:40:00.834984] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T17:40:00.926661] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:01.451472] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T17:40:01.590666] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-03T17:40:02.390748] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-03T17:40:02.844320] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:40:02.845933] [INFO ] [REMOTE ] BKV: Full fetch complete (44692 records). [2025-10-03T17:40:02.846044] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-03T17:40:02.846811] [FATAL] [VALIDATOR ] BKV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:40:02.846932] [FATAL] [MAIN ] BKV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:40:02.847008] [WARN ] [MAIN ] BKV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:40:02.847089] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-03T17:40:02.847166] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-03T17:40:02.847211] [INFO ] [LOCAL ] BKV: Starting deletion of derivative data. [2025-10-03T17:40:02.847298] [DEBUG] [LOCAL ] BKV: No derivative data file found to delete. [2025-10-03T17:40:02.847384] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKV took 25.9s. Estimated remaining: 4h 42m 15s. Rate: 7.4 symbols/min [2025-10-03T17:40:03.039999] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:03.073494] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T17:40:03.144090] [DEBUG] [LOCAL ] BLDR: Loaded 52007 existing records from primary storage. [2025-10-03T17:40:03.144476] [INFO ] [MAIN ] BLDR: Loaded 52007 existing records. [2025-10-03T17:40:03.195925] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-03T17:40:03.367743] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:03.367991] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-03T17:40:03.368044] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-03T17:40:03.368730] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-03T17:40:03.368802] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-03T17:40:03.790102] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:03.849041] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:40:03.990715] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-03T17:40:04.790688] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-03T17:40:05.057980] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:40:05.061882] [INFO ] [REMOTE ] BKSY: Full fetch complete (69761 records). [2025-10-03T17:40:05.062060] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-03T17:40:05.551370] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-03T17:40:05.551527] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-03T17:40:05.552899] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-03T17:40:05.553136] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-03T17:40:05.555489] [DEBUG] [LOCAL ] BKSY: Trimmed 69761 records to 48985 (keeping 200 days of data) [2025-10-03T17:40:05.636380] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-03T17:40:05.649743] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:40:05.903068] [DEBUG] [LOCAL ] BKSY: Primary data saved (48985 records). [2025-10-03T17:40:05.903228] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-03T17:40:05.903309] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BKSY took 54.4s. Estimated remaining: 4h 41m 31s. Rate: 7.4 symbols/min [2025-10-03T17:40:06.096525] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:06.112376] [DEBUG] [LOCAL ] BLE: Loaded 14402 existing records from primary storage. [2025-10-03T17:40:06.112622] [INFO ] [MAIN ] BLE: Loaded 14402 existing records. [2025-10-03T17:40:06.326600] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:06.328288] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T17:40:06.328485] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-03T17:40:06.335108] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-03T17:40:06.335385] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-03T17:40:06.335445] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-03T17:40:06.397451] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-03T17:40:06.743478] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:07.098508] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T17:40:07.190723] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-03T17:40:07.990714] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-03T17:40:08.409726] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:40:08.457038] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T17:40:08.790695] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-03T17:40:09.366048] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T17:40:09.515621] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:40:09.590735] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-03T17:40:10.390706] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-03T17:40:11.195757] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-03T17:40:11.222092] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:40:11.617067] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T17:40:11.990636] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-03T17:40:12.048077] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:40:12.790720] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-03T17:40:13.523932] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T17:40:13.590678] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-03T17:40:13.805755] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:40:14.390712] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-03T17:40:14.762635] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T17:40:15.190725] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-03T17:40:15.547519] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T17:40:15.990693] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-03T17:40:16.557055] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T17:40:16.790697] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-03T17:40:17.388897] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:40:17.590712] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-03T17:40:18.396623] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-03T17:40:18.402758] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T17:40:18.498230] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T17:40:19.190726] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-03T17:40:19.808431] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T17:40:19.990639] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-03T17:40:20.197468] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T17:40:20.790728] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-03T17:40:21.365381] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T17:40:21.584974] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:40:21.590616] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-03T17:40:22.137521] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T17:40:22.390729] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-03T17:40:23.190700] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-03T17:40:23.990705] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-03T17:40:24.145117] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:40:24.559416] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:40:24.790697] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-03T17:40:25.436587] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:40:25.468624] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:40:25.590718] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-03T17:40:26.390686] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-03T17:40:27.068751] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:40:27.190699] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-03T17:40:27.276495] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T17:40:27.278600] [INFO ] [REMOTE ] BLCO: Full fetch complete (52497 records). [2025-10-03T17:40:27.278732] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-03T17:40:27.721965] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-03T17:40:27.722134] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-03T17:40:27.722767] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-03T17:40:27.722833] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-03T17:40:27.724071] [DEBUG] [LOCAL ] BLCO: Trimmed 52497 records to 35851 (keeping 200 days of data) [2025-10-03T17:40:27.944851] [DEBUG] [LOCAL ] BLCO: Primary data saved (35851 records). [2025-10-03T17:40:27.945020] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-03T17:40:27.945542] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BLCO took 30.1s. Estimated remaining: 4h 43m 0s. Rate: 7.3 symbols/min [2025-10-03T17:40:27.995816] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-03T17:40:28.134353] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:28.175754] [DEBUG] [LOCAL ] BLK: Loaded 34684 existing records from primary storage. [2025-10-03T17:40:28.176067] [INFO ] [MAIN ] BLK: Loaded 34684 existing records. [2025-10-03T17:40:28.378498] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:28.378927] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-03T17:40:28.379003] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-03T17:40:28.385256] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-03T17:40:28.395321] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-03T17:40:28.402190] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:40:28.797737] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-03T17:40:28.826727] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:28.924077] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:40:28.925360] [INFO ] [REMOTE ] BLE: Full fetch complete (20271 records). [2025-10-03T17:40:28.925442] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-03T17:40:29.330867] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-03T17:40:29.330967] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-03T17:40:29.331396] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-03T17:40:29.331458] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-03T17:40:29.332220] [DEBUG] [LOCAL ] BLE: Trimmed 20271 records to 14475 (keeping 200 days of data) [2025-10-03T17:40:29.424394] [DEBUG] [LOCAL ] BLE: Primary data saved (14475 records). [2025-10-03T17:40:29.424585] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-03T17:40:29.424706] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLE took 23.5s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-10-03T17:40:29.602083] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-03T17:40:29.621638] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:29.674462] [DEBUG] [LOCAL ] BLND: Loaded 49624 existing records from primary storage. [2025-10-03T17:40:29.674879] [INFO ] [MAIN ] BLND: Loaded 49624 existing records. [2025-10-03T17:40:29.867693] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:29.867953] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-03T17:40:29.868009] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-03T17:40:29.868613] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-03T17:40:29.868718] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-03T17:40:30.264674] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:30.284977] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T17:40:30.390720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-03T17:40:31.038770] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T17:40:31.190715] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-03T17:40:31.990711] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-03T17:40:32.277116] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T17:40:32.501183] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T17:40:32.790724] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-03T17:40:33.597993] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-03T17:40:33.600553] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:40:34.390702] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-03T17:40:34.452316] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:40:35.190688] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-03T17:40:35.620989] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T17:40:35.653290] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:40:35.990728] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-03T17:40:36.445608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T17:40:36.790705] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-03T17:40:37.590673] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-03T17:40:37.788807] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T17:40:38.390680] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-03T17:40:38.572368] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T17:40:38.630115] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:40:39.190717] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-03T17:40:39.983548] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:40:39.992798] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-03T17:40:40.790708] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-03T17:40:41.069358] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:40:41.590686] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-03T17:40:41.719439] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:40:41.723177] [INFO ] [REMOTE ] BLD: Full fetch complete (40256 records). [2025-10-03T17:40:41.723309] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-03T17:40:42.117235] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T17:40:42.203592] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-03T17:40:42.203715] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-03T17:40:42.204312] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-03T17:40:42.204381] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-03T17:40:42.205525] [DEBUG] [LOCAL ] BLD: Trimmed 40256 records to 27960 (keeping 200 days of data) [2025-10-03T17:40:42.387525] [DEBUG] [LOCAL ] BLD: Primary data saved (27960 records). [2025-10-03T17:40:42.387698] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-03T17:40:42.387812] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLD took 42.2s. Estimated remaining: 4h 42m 30s. Rate: 7.3 symbols/min [2025-10-03T17:40:42.399607] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-03T17:40:42.586710] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:42.587163] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-03T17:40:42.587219] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-03T17:40:42.587416] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-03T17:40:42.587481] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-03T17:40:42.587550] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-03T17:40:42.587586] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-03T17:40:42.982880] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:43.190720] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-03T17:40:43.826019] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T17:40:43.990636] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-03T17:40:44.247778] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T17:40:44.790708] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-03T17:40:44.982450] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:40:44.987270] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:40:44.994984] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-03T17:40:44.995422] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:40:44.995594] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-03T17:40:44.995716] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:40:44.995812] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-03T17:40:44.995898] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-03T17:40:44.995955] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-03T17:40:44.996033] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-03T17:40:44.996136] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLSH took 2.6s. Estimated remaining: 4h 41m 44s. Rate: 7.4 symbols/min [2025-10-03T17:40:45.182024] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:45.197870] [DEBUG] [LOCAL ] BLW: Loaded 13258 existing records from primary storage. [2025-10-03T17:40:45.198101] [INFO ] [MAIN ] BLW: Loaded 13258 existing records. [2025-10-03T17:40:45.392624] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:45.392934] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-03T17:40:45.393017] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-03T17:40:45.393697] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-03T17:40:45.393764] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-03T17:40:45.593380] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-03T17:40:45.696742] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:40:45.818138] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:46.390698] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-03T17:40:47.190639] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-03T17:40:47.293034] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T17:40:47.984274] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:40:47.991961] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-03T17:40:48.005384] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T17:40:48.790731] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-03T17:40:49.590713] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-03T17:40:49.615388] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T17:40:49.956309] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T17:40:50.390687] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-03T17:40:50.893935] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T17:40:51.190717] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-03T17:40:51.990684] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-03T17:40:52.053109] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T17:40:52.055771] [INFO ] [REMOTE ] BLDR: Full fetch complete (74472 records). [2025-10-03T17:40:52.055929] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-03T17:40:52.259013] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:40:52.505454] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-03T17:40:52.505541] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-03T17:40:52.506406] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-03T17:40:52.506510] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-03T17:40:52.508279] [DEBUG] [LOCAL ] BLDR: Trimmed 74472 records to 52382 (keeping 200 days of data) [2025-10-03T17:40:52.804725] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-03T17:40:52.854753] [DEBUG] [LOCAL ] BLDR: Primary data saved (52382 records). [2025-10-03T17:40:52.854886] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-03T17:40:52.854979] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLDR took 50.0s. Estimated remaining: 4h 41m 33s. Rate: 7.4 symbols/min [2025-10-03T17:40:53.048791] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:40:53.065440] [DEBUG] [LOCAL ] BLX: Loaded 15738 existing records from primary storage. [2025-10-03T17:40:53.065714] [INFO ] [MAIN ] BLX: Loaded 15738 existing records. [2025-10-03T17:40:53.267976] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:40:53.268256] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-03T17:40:53.268426] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-03T17:40:53.268799] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-03T17:40:53.268861] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-03T17:40:53.561099] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:40:53.602561] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-03T17:40:53.728995] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:40:54.390682] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-03T17:40:54.614162] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:40:54.721863] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:40:55.190732] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-03T17:40:55.990674] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-03T17:40:56.140608] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T17:40:56.503291] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:40:56.790719] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-03T17:40:56.978524] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:40:57.590621] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-03T17:40:57.793034] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:40:58.390620] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-03T17:40:58.464800] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T17:40:59.190686] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-03T17:40:59.219409] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:40:59.990697] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-03T17:41:00.063532] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:41:00.790733] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-03T17:41:01.590722] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-03T17:41:01.634177] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T17:41:01.903369] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T17:41:02.274269] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T17:41:02.390726] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-03T17:41:03.190702] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-03T17:41:03.928319] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T17:41:03.931436] [INFO ] [REMOTE ] BLND: Full fetch complete (72237 records). [2025-10-03T17:41:03.931599] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-03T17:41:04.001700] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-03T17:41:04.388588] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-03T17:41:04.402478] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-03T17:41:04.404417] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-03T17:41:04.405338] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:41:04.405612] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-03T17:41:04.413131] [DEBUG] [LOCAL ] BLND: Trimmed 72237 records to 49987 (keeping 200 days of data) [2025-10-03T17:41:04.710150] [DEBUG] [LOCAL ] BLND: Primary data saved (49987 records). [2025-10-03T17:41:04.710323] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-03T17:41:04.711183] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLND took 35.3s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-03T17:41:04.799561] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-03T17:41:04.914336] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:04.953050] [DEBUG] [LOCAL ] BMA: Loaded 35644 existing records from primary storage. [2025-10-03T17:41:04.953386] [INFO ] [MAIN ] BMA: Loaded 35644 existing records. [2025-10-03T17:41:05.154281] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:05.154529] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-03T17:41:05.154579] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-03T17:41:05.154875] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-03T17:41:05.154937] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-03T17:41:05.559226] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:05.583485] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:41:05.590623] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-03T17:41:05.926147] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:41:06.167200] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T17:41:06.390688] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-03T17:41:07.191100] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-03T17:41:07.193524] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:41:07.990764] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-03T17:41:08.253367] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T17:41:08.790703] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-03T17:41:09.051290] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T17:41:09.590722] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-03T17:41:09.744424] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:41:10.390723] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-03T17:41:10.988159] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:41:11.024726] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T17:41:11.027008] [INFO ] [REMOTE ] BLW: Full fetch complete (19314 records). [2025-10-03T17:41:11.027169] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-03T17:41:11.195800] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-03T17:41:11.482835] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-03T17:41:11.482916] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-03T17:41:11.483236] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-03T17:41:11.483276] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-03T17:41:11.483887] [DEBUG] [LOCAL ] BLW: Trimmed 19314 records to 13457 (keeping 200 days of data) [2025-10-03T17:41:11.572634] [DEBUG] [LOCAL ] BLW: Primary data saved (13457 records). [2025-10-03T17:41:11.572823] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-03T17:41:11.572939] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLW took 26.6s. Estimated remaining: 4h 41m 33s. Rate: 7.3 symbols/min [2025-10-03T17:41:11.770324] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:11.783172] [DEBUG] [LOCAL ] BME: Loaded 11009 existing records from primary storage. [2025-10-03T17:41:11.783400] [INFO ] [MAIN ] BME: Loaded 11009 existing records. [2025-10-03T17:41:11.970710] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:11.970977] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-03T17:41:11.971028] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-03T17:41:11.971246] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-03T17:41:11.971305] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-03T17:41:11.995790] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-03T17:41:12.381519] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:12.623213] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:41:12.625374] [INFO ] [REMOTE ] BLK: Full fetch complete (52630 records). [2025-10-03T17:41:12.625494] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-03T17:41:12.797690] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-03T17:41:13.056447] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-03T17:41:13.056553] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-03T17:41:13.057385] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-03T17:41:13.057479] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-03T17:41:13.059060] [DEBUG] [LOCAL ] BLK: Trimmed 52630 records to 34890 (keeping 200 days of data) [2025-10-03T17:41:13.311158] [DEBUG] [LOCAL ] BLK: Primary data saved (34890 records). [2025-10-03T17:41:13.311452] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-03T17:41:13.312046] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLK took 45.4s. Estimated remaining: 4h 40m 41s. Rate: 7.4 symbols/min [2025-10-03T17:41:13.502731] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:13.535694] [DEBUG] [LOCAL ] BMEZ: Loaded 26437 existing records from primary storage. [2025-10-03T17:41:13.536163] [INFO ] [MAIN ] BMEZ: Loaded 26437 existing records. [2025-10-03T17:41:13.598562] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-03T17:41:13.771842] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:41:13.776297] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:13.785067] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-03T17:41:13.785425] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-03T17:41:13.785878] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-03T17:41:13.785939] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-03T17:41:14.122935] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:41:14.201951] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:14.390695] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-03T17:41:14.689357] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:41:15.190699] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-03T17:41:15.210453] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T17:41:15.990706] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-03T17:41:16.328811] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T17:41:16.636946] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:41:16.790715] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-03T17:41:17.590719] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-03T17:41:17.614576] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T17:41:18.390697] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-03T17:41:18.959078] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:41:19.156550] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T17:41:19.190690] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-03T17:41:19.990683] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-03T17:41:20.708553] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T17:41:20.790695] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-03T17:41:21.058439] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:41:21.059918] [INFO ] [REMOTE ] BLX: Full fetch complete (22756 records). [2025-10-03T17:41:21.059996] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-03T17:41:21.483298] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-03T17:41:21.483391] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-03T17:41:21.483805] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-03T17:41:21.483872] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-03T17:41:21.484771] [DEBUG] [LOCAL ] BLX: Trimmed 22756 records to 15829 (keeping 200 days of data) [2025-10-03T17:41:21.586528] [DEBUG] [LOCAL ] BLX: Primary data saved (15829 records). [2025-10-03T17:41:21.586712] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-03T17:41:21.586820] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BLX took 28.7s. Estimated remaining: 4h 40m 34s. Rate: 7.4 symbols/min [2025-10-03T17:41:21.599486] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-03T17:41:21.785115] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:21.812669] [DEBUG] [LOCAL ] BMI: Loaded 24385 existing records from primary storage. [2025-10-03T17:41:21.812962] [INFO ] [MAIN ] BMI: Loaded 24385 existing records. [2025-10-03T17:41:22.026054] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:22.026455] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-03T17:41:22.026514] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-03T17:41:22.026891] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-03T17:41:22.026951] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-03T17:41:22.262638] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:41:22.390632] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-03T17:41:22.483476] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:22.492352] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T17:41:23.190682] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-03T17:41:23.572804] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:41:23.990686] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-03T17:41:24.034804] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T17:41:24.790699] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-03T17:41:25.545808] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T17:41:25.590707] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-03T17:41:25.884450] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:41:26.390683] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-03T17:41:26.841737] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:41:27.190700] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-03T17:41:27.292688] [DEBUG] [REMOTE ] BMEZ: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-03T17:41:27.293039] [WARN ] [REMOTE ] BMEZ: No data returned for month 2025-04 [2025-10-03T17:41:27.293137] [FATAL] [REMOTE ] BMEZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:41:27.293223] [FATAL] [MAIN ] BMEZ: Failed to fetch primary data. [2025-10-03T17:41:27.293290] [WARN ] [MAIN ] BMEZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:41:27.293365] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-03T17:41:27.293433] [DEBUG] [LOCAL ] BMEZ: No primary data file found to delete. [2025-10-03T17:41:27.293471] [INFO ] [LOCAL ] BMEZ: Starting deletion of derivative data. [2025-10-03T17:41:27.293769] [DEBUG] [LOCAL ] BMEZ: Deleted derivative data file. [2025-10-03T17:41:27.293861] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BMEZ took 14.0s. Estimated remaining: 4h 40m 9s. Rate: 7.4 symbols/min [2025-10-03T17:41:27.484472] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T17:41:27.512839] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:27.518823] [DEBUG] [LOCAL ] BMN: Loaded 2594 existing records from primary storage. [2025-10-03T17:41:27.519005] [INFO ] [MAIN ] BMN: Loaded 2594 existing records. [2025-10-03T17:41:27.720005] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:27.720287] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-03T17:41:27.720347] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-03T17:41:27.720603] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-03T17:41:27.720698] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-03T17:41:27.995778] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-03T17:41:28.148007] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:28.790698] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-03T17:41:29.271213] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:41:29.459087] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:41:29.590703] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-03T17:41:30.051074] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T17:41:30.390731] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-03T17:41:31.190720] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-03T17:41:31.559196] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:41:31.990692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-03T17:41:32.159096] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T17:41:32.440742] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T17:41:32.790735] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-03T17:41:33.590692] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-03T17:41:34.057324] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:41:34.390726] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-03T17:41:34.807956] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T17:41:35.190694] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-03T17:41:35.361992] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T17:41:35.990636] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-03T17:41:36.184159] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T17:41:36.430421] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-03T17:41:36.790692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-03T17:41:37.393523] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T17:41:37.590732] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-03T17:41:38.281049] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T17:41:38.390735] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-03T17:41:39.184110] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:41:39.190605] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-03T17:41:39.990673] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-03T17:41:40.033896] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T17:41:40.462255] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T17:41:40.790724] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-03T17:41:41.599407] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T17:41:41.598260] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-03T17:41:42.390754] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-03T17:41:42.948003] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T17:41:43.019849] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T17:41:43.021081] [INFO ] [REMOTE ] BME: Full fetch complete (16143 records). [2025-10-03T17:41:43.021163] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-03T17:41:43.193505] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-03T17:41:43.440543] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-03T17:41:43.440676] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-03T17:41:43.441132] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-03T17:41:43.441198] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-03T17:41:43.442048] [DEBUG] [LOCAL ] BME: Trimmed 16143 records to 11124 (keeping 200 days of data) [2025-10-03T17:41:43.517438] [DEBUG] [LOCAL ] BME: Primary data saved (11124 records). [2025-10-03T17:41:43.517598] [INFO ] [MAIN ] BME: Full history saved. [2025-10-03T17:41:43.517745] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BME took 31.9s. Estimated remaining: 4h 40m 56s. Rate: 7.3 symbols/min [2025-10-03T17:41:43.743755] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:43.787044] [DEBUG] [LOCAL ] BMO: Loaded 41494 existing records from primary storage. [2025-10-03T17:41:43.787385] [INFO ] [MAIN ] BMO: Loaded 41494 existing records. [2025-10-03T17:41:43.984559] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:43.984837] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-03T17:41:43.984929] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-03T17:41:43.985276] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-03T17:41:43.985361] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-03T17:41:43.997770] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-03T17:41:44.431272] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:44.546489] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:41:44.645302] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T17:41:44.790814] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-03T17:41:45.590763] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-03T17:41:46.226104] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:41:46.390757] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-03T17:41:47.187679] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:41:47.196285] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-03T17:41:47.649302] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T17:41:47.977353] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T17:41:47.990628] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-03T17:41:48.790735] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-03T17:41:49.297577] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T17:41:49.590734] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-03T17:41:49.833024] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T17:41:49.834469] [INFO ] [REMOTE ] BMI: Full fetch complete (32943 records). [2025-10-03T17:41:49.834802] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-03T17:41:50.215470] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-03T17:41:50.215588] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-03T17:41:50.216171] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-03T17:41:50.216238] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-03T17:41:50.217492] [DEBUG] [LOCAL ] BMI: Trimmed 32943 records to 24515 (keeping 200 days of data) [2025-10-03T17:41:50.384630] [DEBUG] [LOCAL ] BMI: Primary data saved (24515 records). [2025-10-03T17:41:50.384938] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-03T17:41:50.385089] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMI took 28.8s. Estimated remaining: 4h 40m 39s. Rate: 7.4 symbols/min [2025-10-03T17:41:50.397520] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-03T17:41:50.572230] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:50.634041] [DEBUG] [LOCAL ] BMY: Loaded 54147 existing records from primary storage. [2025-10-03T17:41:50.634615] [INFO ] [MAIN ] BMY: Loaded 54147 existing records. [2025-10-03T17:41:50.895477] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:50.895982] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-03T17:41:50.896067] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-03T17:41:50.896609] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-03T17:41:50.896708] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-03T17:41:51.192427] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-03T17:41:51.313830] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:51.375809] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:41:51.833492] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T17:41:51.925184] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T17:41:51.990692] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-03T17:41:52.516604] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:41:52.790703] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-03T17:41:53.590726] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-03T17:41:54.390754] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-03T17:41:54.964369] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:41:54.967814] [INFO ] [REMOTE ] BMA: Full fetch complete (51601 records). [2025-10-03T17:41:54.967939] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-03T17:41:55.237079] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-03T17:41:55.283230] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T17:41:55.470729] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-03T17:41:55.470824] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-03T17:41:55.471436] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-03T17:41:55.471482] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-03T17:41:55.474078] [DEBUG] [LOCAL ] BMA: Trimmed 51601 records to 35953 (keeping 200 days of data) [2025-10-03T17:41:55.704612] [DEBUG] [LOCAL ] BMA: Primary data saved (35953 records). [2025-10-03T17:41:55.704982] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-03T17:41:55.705621] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMA took 51.0s. Estimated remaining: 4h 40m 12s. Rate: 7.4 symbols/min [2025-10-03T17:41:55.810623] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:41:55.833921] [INFO ] [REMOTE ] BMN: Full fetch complete (3745 records). [2025-10-03T17:41:55.845224] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-03T17:41:55.953496] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:56.012460] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-03T17:41:56.244377] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:41:56.459689] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-03T17:41:56.459805] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-03T17:41:56.460012] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-03T17:41:56.460088] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-03T17:41:56.462523] [DEBUG] [LOCAL ] BMN: Trimmed 3745 records to 2606 (keeping 200 days of data) [2025-10-03T17:41:56.462264] [DEBUG] [LOCAL ] BN: Loaded 53383 existing records from primary storage. [2025-10-03T17:41:56.463524] [INFO ] [MAIN ] BN: Loaded 53383 existing records. [2025-10-03T17:41:56.536974] [DEBUG] [LOCAL ] BMN: Primary data saved (2606 records). [2025-10-03T17:41:56.550767] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-03T17:41:56.558681] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BMN took 29.3s. Estimated remaining: 4h 39m 15s. Rate: 7.4 symbols/min [2025-10-03T17:41:56.795472] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-03T17:41:56.953545] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:41:57.004846] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:57.005143] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-03T17:41:57.005232] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-03T17:41:57.005487] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-03T17:41:57.005564] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-03T17:41:57.268522] [DEBUG] [LOCAL ] BNED: Loaded 29657 existing records from primary storage. [2025-10-03T17:41:57.313704] [INFO ] [MAIN ] BNED: Loaded 29657 existing records. [2025-10-03T17:41:57.636126] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:57.648116] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-03T17:41:57.689148] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:41:57.689408] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-03T17:41:57.689463] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-03T17:41:57.689705] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-03T17:41:57.689765] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-03T17:41:58.085552] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:41:58.117582] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-03T17:41:58.390737] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-03T17:41:58.492296] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T17:41:59.190701] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-03T17:41:59.850772] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T17:41:59.990696] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-03T17:42:00.285213] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T17:42:00.790667] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-03T17:42:00.934631] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:42:01.436555] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:42:01.590733] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-03T17:42:02.390727] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-03T17:42:02.698507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:42:02.918443] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T17:42:03.190711] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-03T17:42:03.990672] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-03T17:42:04.256029] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T17:42:04.605377] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:42:04.790736] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-03T17:42:05.366528] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:42:05.590715] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-03T17:42:05.904833] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:42:06.390744] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-03T17:42:07.195970] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-03T17:42:07.214466] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:42:07.702733] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:42:07.990683] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-03T17:42:08.628446] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T17:42:08.790732] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-03T17:42:09.590688] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-03T17:42:09.726448] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T17:42:10.390698] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-03T17:42:11.013138] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:42:11.133396] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-03T17:42:11.190691] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-03T17:42:11.583226] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:42:11.990677] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-03T17:42:12.790697] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-03T17:42:13.281581] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T17:42:13.303571] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T17:42:13.306036] [INFO ] [REMOTE ] BMO: Full fetch complete (59723 records). [2025-10-03T17:42:13.306178] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-03T17:42:13.595904] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-03T17:42:13.736006] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-03T17:42:13.736109] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-03T17:42:13.736846] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-03T17:42:13.736913] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-03T17:42:13.738447] [DEBUG] [LOCAL ] BMO: Trimmed 59723 records to 41826 (keeping 200 days of data) [2025-10-03T17:42:14.014284] [DEBUG] [LOCAL ] BMO: Primary data saved (41826 records). [2025-10-03T17:42:14.014428] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-03T17:42:14.014539] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMO took 30.5s. Estimated remaining: 4h 40m 9s. Rate: 7.4 symbols/min [2025-10-03T17:42:14.211633] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:14.232385] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:42:14.246179] [DEBUG] [LOCAL ] BNH: Loaded 5161 existing records from primary storage. [2025-10-03T17:42:14.246436] [INFO ] [MAIN ] BNH: Loaded 5161 existing records. [2025-10-03T17:42:14.405452] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-03T17:42:14.452948] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:14.453298] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-03T17:42:14.453355] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-03T17:42:14.453719] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-03T17:42:14.453781] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-03T17:42:14.855678] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:15.190668] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-03T17:42:15.730963] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T17:42:15.885694] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T17:42:15.990698] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-03T17:42:16.440793] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T17:42:16.489838] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T17:42:16.790704] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-03T17:42:17.333908] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T17:42:17.590709] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-03T17:42:18.390714] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-03T17:42:19.190704] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-03T17:42:19.716101] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T17:42:19.990681] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-03T17:42:20.222521] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:42:20.464921] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:42:20.558782] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T17:42:20.790672] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-03T17:42:21.294398] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-03T17:42:21.590682] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-03T17:42:22.390692] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-03T17:42:23.053292] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T17:42:23.190704] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-03T17:42:23.990668] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-03T17:42:24.229981] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:42:24.790715] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-03T17:42:25.232323] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T17:42:25.401771] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T17:42:25.451458] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:42:25.590747] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-03T17:42:26.390632] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-03T17:42:26.721218] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:42:27.190734] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-03T17:42:27.990729] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-03T17:42:28.390578] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:42:28.632762] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T17:42:28.790692] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-03T17:42:29.325501] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:42:29.343279] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:42:29.590721] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-03T17:42:30.167166] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T17:42:30.390712] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-03T17:42:31.190733] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-03T17:42:31.870093] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T17:42:31.872886] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-03T17:42:31.873043] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-03T17:42:32.000223] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-03T17:42:32.326782] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-03T17:42:32.326968] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-03T17:42:32.327855] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-03T17:42:32.328007] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-03T17:42:32.363827] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54537 (keeping 200 days of data) [2025-10-03T17:42:32.367344] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T17:42:32.732500] [DEBUG] [LOCAL ] BMY: Primary data saved (54537 records). [2025-10-03T17:42:32.732679] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-03T17:42:32.732792] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMY took 42.3s. Estimated remaining: 4h 41m 10s. Rate: 7.3 symbols/min [2025-10-03T17:42:32.802815] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-03T17:42:32.922686] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:32.922884] [DEBUG] [LOCAL ] BNJ: No existing data file found in primary storage. [2025-10-03T17:42:32.922923] [WARN ] [MAIN ] BNJ: No existing data found, performing full refresh instead. [2025-10-03T17:42:32.923033] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-03T17:42:32.923076] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-03T17:42:32.923117] [DEBUG] [LOCAL ] BNJ: No primary data file found to delete. [2025-10-03T17:42:32.923150] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-03T17:42:33.122993] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T17:42:33.179207] [INFO ] [REMOTE ] BNED: Full fetch complete (43775 records). [2025-10-03T17:42:33.202991] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-03T17:42:33.465170] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:33.509104] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T17:42:33.591487] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-03T17:42:33.771631] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-03T17:42:33.771781] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-03T17:42:33.772387] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-03T17:42:33.772454] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-03T17:42:33.773609] [DEBUG] [LOCAL ] BNED: Trimmed 43775 records to 29850 (keeping 200 days of data) [2025-10-03T17:42:33.956776] [DEBUG] [LOCAL ] BNED: Primary data saved (29850 records). [2025-10-03T17:42:33.956948] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-03T17:42:33.957047] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 37.4s. Estimated remaining: 4h 40m 16s. Rate: 7.3 symbols/min [2025-10-03T17:42:34.149811] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:34.204704] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-03T17:42:34.206097] [DEBUG] [LOCAL ] BNL: Loaded 47291 existing records from primary storage. [2025-10-03T17:42:34.208091] [INFO ] [MAIN ] BNL: Loaded 47291 existing records. [2025-10-03T17:42:34.207925] [INFO ] [REMOTE ] BNH: Full fetch complete (7006 records). [2025-10-03T17:42:34.213495] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-03T17:42:34.395939] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-03T17:42:34.646110] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:34.657521] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-03T17:42:34.667083] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-03T17:42:34.697827] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-03T17:42:34.766522] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-03T17:42:35.085971] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-03T17:42:35.087411] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-03T17:42:35.103360] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-03T17:42:35.105875] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-03T17:42:35.190025] [DEBUG] [LOCAL ] BNH: Trimmed 7006 records to 5198 (keeping 200 days of data) [2025-10-03T17:42:35.206043] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-03T17:42:35.256871] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:42:35.345507] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:35.351004] [DEBUG] [LOCAL ] BNH: Primary data saved (5198 records). [2025-10-03T17:42:35.351084] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-03T17:42:35.351163] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BNH took 21.3s. Estimated remaining: 4h 39m 24s. Rate: 7.4 symbols/min [2025-10-03T17:42:35.548420] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:35.601368] [DEBUG] [LOCAL ] BNS: Loaded 51859 existing records from primary storage. [2025-10-03T17:42:35.601790] [INFO ] [MAIN ] BNS: Loaded 51859 existing records. [2025-10-03T17:42:35.794676] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:35.794959] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-03T17:42:35.795017] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-03T17:42:35.795366] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-03T17:42:35.795426] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-03T17:42:35.997192] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-03T17:42:36.229081] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:36.790682] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-03T17:42:37.061986] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T17:42:37.590728] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-03T17:42:37.820858] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T17:42:38.108398] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T17:42:38.390696] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-03T17:42:38.698529] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T17:42:38.780338] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T17:42:39.190734] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-03T17:42:39.722201] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T17:42:39.990736] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-03T17:42:40.790747] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-03T17:42:41.590731] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-03T17:42:41.975046] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T17:42:42.390692] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-03T17:42:42.450055] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T17:42:42.968891] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T17:42:43.051738] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:42:43.190695] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-03T17:42:43.990725] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-03T17:42:44.479602] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T17:42:44.647547] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T17:42:44.790713] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-03T17:42:45.201100] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T17:42:45.590706] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-03T17:42:46.029301] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T17:42:46.390713] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-03T17:42:47.190744] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-03T17:42:47.996544] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-03T17:42:48.019598] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T17:42:48.790740] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-03T17:42:48.877281] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T17:42:49.590730] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-03T17:42:49.706487] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:42:49.709322] [INFO ] [REMOTE ] BN: Full fetch complete (76697 records). [2025-10-03T17:42:49.709441] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-03T17:42:50.138379] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-03T17:42:50.138482] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-03T17:42:50.139282] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-03T17:42:50.139350] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-03T17:42:50.140950] [DEBUG] [LOCAL ] BN: Trimmed 76697 records to 53772 (keeping 200 days of data) [2025-10-03T17:42:50.394255] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-03T17:42:50.529938] [DEBUG] [LOCAL ] BN: Primary data saved (53772 records). [2025-10-03T17:42:50.530277] [INFO ] [MAIN ] BN: Full history saved. [2025-10-03T17:42:50.531961] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BN took 54.8s. Estimated remaining: 4h 40m 1s. Rate: 7.3 symbols/min [2025-10-03T17:42:50.724424] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:50.760873] [DEBUG] [LOCAL ] BNT: Loaded 3393 existing records from primary storage. [2025-10-03T17:42:50.761687] [INFO ] [MAIN ] BNT: Loaded 3393 existing records. [2025-10-03T17:42:50.763061] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T17:42:50.893354] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T17:42:50.978617] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:50.978852] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-03T17:42:50.978901] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-03T17:42:50.979093] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-03T17:42:50.979152] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-03T17:42:51.195836] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-03T17:42:51.382907] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:51.459338] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:42:51.990718] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-03T17:42:52.790703] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-03T17:42:53.181211] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T17:42:53.350199] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:42:53.531053] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:42:53.590725] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-03T17:42:54.208589] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T17:42:54.390704] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-03T17:42:54.861851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T17:42:55.190714] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-03T17:42:55.504834] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T17:42:55.990690] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-03T17:42:56.524044] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T17:42:56.525263] [INFO ] [REMOTE ] BNJ: Full fetch complete (4295 records). [2025-10-03T17:42:56.525355] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-03T17:42:56.796045] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-03T17:42:56.932859] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-03T17:42:56.932947] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-03T17:42:56.933098] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-03T17:42:56.933139] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-03T17:42:56.933533] [DEBUG] [LOCAL ] BNJ: Trimmed 4295 records to 2666 (keeping 200 days of data) [2025-10-03T17:42:56.951146] [DEBUG] [LOCAL ] BNJ: Primary data saved (2666 records). [2025-10-03T17:42:56.951226] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-03T17:42:56.951292] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNJ took 24.2s. Estimated remaining: 4h 39m 42s. Rate: 7.3 symbols/min [2025-10-03T17:42:57.135701] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:42:57.147288] [DEBUG] [LOCAL ] BNY: Loaded 7174 existing records from primary storage. [2025-10-03T17:42:57.147499] [INFO ] [MAIN ] BNY: Loaded 7174 existing records. [2025-10-03T17:42:57.341030] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:42:57.341251] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-03T17:42:57.341302] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-03T17:42:57.341571] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-03T17:42:57.341630] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-03T17:42:57.598476] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-03T17:42:57.740552] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:42:58.337063] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T17:42:58.390685] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-03T17:42:59.122621] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:42:59.190733] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-03T17:42:59.470331] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:42:59.990724] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-03T17:43:00.790700] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-03T17:43:01.212566] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:43:01.391865] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:43:01.590697] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-03T17:43:01.786838] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T17:43:02.326779] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T17:43:02.390719] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-03T17:43:03.036669] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T17:43:03.190686] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-03T17:43:03.990721] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-03T17:43:04.639427] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T17:43:04.762369] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T17:43:04.790631] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-03T17:43:05.590682] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-03T17:43:06.366714] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:43:06.368008] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T17:43:06.390617] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-03T17:43:07.190703] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-03T17:43:07.844361] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:43:07.847264] [INFO ] [REMOTE ] BNL: Full fetch complete (67041 records). [2025-10-03T17:43:07.847376] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-03T17:43:07.969603] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T17:43:07.992191] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-03T17:43:08.283800] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-03T17:43:08.283934] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-03T17:43:08.284713] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-03T17:43:08.284783] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-03T17:43:08.286259] [DEBUG] [LOCAL ] BNL: Trimmed 67041 records to 47668 (keeping 200 days of data) [2025-10-03T17:43:08.593106] [DEBUG] [LOCAL ] BNL: Primary data saved (47668 records). [2025-10-03T17:43:08.593264] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-03T17:43:08.594375] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNL took 34.6s. Estimated remaining: 4h 39m 56s. Rate: 7.3 symbols/min [2025-10-03T17:43:08.708272] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:43:08.785171] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:08.790684] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-03T17:43:08.809056] [DEBUG] [LOCAL ] BOC: Loaded 18384 existing records from primary storage. [2025-10-03T17:43:08.809317] [INFO ] [MAIN ] BOC: Loaded 18384 existing records. [2025-10-03T17:43:08.999861] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:09.000070] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-03T17:43:09.000180] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-03T17:43:09.000425] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-03T17:43:09.000483] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-03T17:43:09.384600] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:09.590694] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-03T17:43:10.316928] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T17:43:10.390696] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-03T17:43:10.530974] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T17:43:11.190722] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-03T17:43:11.466031] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T17:43:11.990693] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-03T17:43:12.309830] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T17:43:12.790706] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-03T17:43:13.077831] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T17:43:13.378559] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T17:43:13.590696] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-03T17:43:14.310364] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T17:43:14.390665] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-03T17:43:15.190703] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-03T17:43:15.209148] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:43:15.990689] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-03T17:43:16.221618] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T17:43:16.444066] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T17:43:16.790687] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-03T17:43:17.590716] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-03T17:43:18.210387] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:43:18.360623] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T17:43:18.390728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-03T17:43:19.055595] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T17:43:19.056608] [INFO ] [REMOTE ] BNT: Full fetch complete (4520 records). [2025-10-03T17:43:19.056737] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-03T17:43:19.195883] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-03T17:43:19.451616] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-03T17:43:19.451780] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-03T17:43:19.452051] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-03T17:43:19.452121] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-03T17:43:19.453146] [DEBUG] [LOCAL ] BNT: Trimmed 4520 records to 3434 (keeping 200 days of data) [2025-10-03T17:43:19.476140] [DEBUG] [LOCAL ] BNT: Primary data saved (3434 records). [2025-10-03T17:43:19.476253] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-03T17:43:19.476366] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 28.9s. Estimated remaining: 4h 40m 6s. Rate: 7.3 symbols/min [2025-10-03T17:43:19.990710] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-03T17:43:20.661909] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:43:20.664874] [INFO ] [REMOTE ] BNS: Full fetch complete (74293 records). [2025-10-03T17:43:20.665033] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-03T17:43:20.795832] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-03T17:43:21.032446] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:43:21.122555] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-03T17:43:21.122699] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-03T17:43:21.123576] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-03T17:43:21.123667] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-03T17:43:21.125707] [DEBUG] [LOCAL ] BNS: Trimmed 74293 records to 52238 (keeping 200 days of data) [2025-10-03T17:43:21.467292] [DEBUG] [LOCAL ] BNS: Primary data saved (52238 records). [2025-10-03T17:43:21.467480] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-03T17:43:21.467674] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNS took 46.1s. Estimated remaining: 4h 39m 17s. Rate: 7.3 symbols/min [2025-10-03T17:43:21.590674] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-03T17:43:21.647809] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T17:43:22.390747] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-03T17:43:22.787710] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T17:43:22.800559] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T17:43:23.190734] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-03T17:43:23.882688] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T17:43:23.990690] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-03T17:43:24.790724] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-03T17:43:25.080616] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:43:25.590691] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-03T17:43:25.710455] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T17:43:25.711572] [INFO ] [REMOTE ] BNY: Full fetch complete (10444 records). [2025-10-03T17:43:25.711677] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-03T17:43:26.099827] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-03T17:43:26.100146] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-03T17:43:26.100445] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-03T17:43:26.100493] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-03T17:43:26.101213] [DEBUG] [LOCAL ] BNY: Trimmed 10444 records to 7209 (keeping 200 days of data) [2025-10-03T17:43:26.151171] [DEBUG] [LOCAL ] BNY: Primary data saved (7209 records). [2025-10-03T17:43:26.151313] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-03T17:43:26.151401] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNY took 29.2s. Estimated remaining: 4h 38m 47s. Rate: 7.4 symbols/min [2025-10-03T17:43:26.538502] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T17:43:26.543033] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-03T17:43:27.592758] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T17:43:27.597622] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-03T17:43:28.649972] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:43:28.655596] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-03T17:43:29.674797] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T17:43:29.679639] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-03T17:43:30.481671] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T17:43:30.483153] [INFO ] [REMOTE ] BOC: Full fetch complete (25762 records). [2025-10-03T17:43:30.483239] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-03T17:43:30.914357] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-03T17:43:30.914448] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-03T17:43:30.914912] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-03T17:43:30.914993] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-03T17:43:30.916339] [DEBUG] [LOCAL ] BOC: Trimmed 25762 records to 18490 (keeping 200 days of data) [2025-10-03T17:43:31.039637] [DEBUG] [LOCAL ] BOC: Primary data saved (18490 records). [2025-10-03T17:43:31.039818] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-03T17:43:31.039922] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BOC took 22.4s. Estimated remaining: 4h 38m 18s. Rate: 7.4 symbols/min [2025-10-03T17:43:31.700241] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.807396] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.818494] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.847963] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:31.872665] [DEBUG] [LOCAL ] BOE: Loaded 17889 existing records from primary storage. [2025-10-03T17:43:31.872940] [INFO ] [MAIN ] BOE: Loaded 17889 existing records. [2025-10-03T17:43:32.045012] [DEBUG] [LOCAL ] BOH: Loaded 30959 existing records from primary storage. [2025-10-03T17:43:32.060601] [DEBUG] [LOCAL ] BOND: Loaded 32444 existing records from primary storage. [2025-10-03T17:43:32.062079] [INFO ] [MAIN ] BOH: Loaded 30959 existing records. [2025-10-03T17:43:32.062340] [INFO ] [MAIN ] BOND: Loaded 32444 existing records. [2025-10-03T17:43:32.073422] [DEBUG] [LOCAL ] BOOT: Loaded 40795 existing records from primary storage. [2025-10-03T17:43:32.084061] [INFO ] [MAIN ] BOOT: Loaded 40795 existing records. [2025-10-03T17:43:32.336942] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.369165] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.384793] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-03T17:43:32.466489] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-03T17:43:32.498601] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-03T17:43:32.803889] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.843562] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.843344] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.882735] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.898596] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-03T17:43:32.898750] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-03T17:43:32.921715] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-03T17:43:32.925705] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:32.941696] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-03T17:43:32.962521] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-03T17:43:32.941593] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-03T17:43:32.993329] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-03T17:43:32.986830] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-03T17:43:33.019625] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-03T17:43:33.049959] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-03T17:43:33.755499] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:33.848995] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-03T17:43:34.379235] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.431461] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-03T17:43:34.435015] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.477963] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-03T17:43:34.501047] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:34.502728] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-03T17:43:35.224909] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T17:43:35.230242] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-03T17:43:35.912753] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T17:43:35.936163] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-03T17:43:35.938263] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:43:35.945925] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-03T17:43:36.125142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:43:36.133681] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-03T17:43:36.312320] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:43:36.317271] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-03T17:43:37.263470] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T17:43:37.288295] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T17:43:37.287329] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-03T17:43:37.317570] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:43:37.590682] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-03T17:43:37.743751] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:43:38.390743] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-03T17:43:38.437387] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T17:43:38.811541] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:43:39.190708] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-03T17:43:39.675055] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T17:43:39.990622] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-03T17:43:40.400820] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:43:40.790692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-03T17:43:41.584117] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:43:41.594171] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-03T17:43:42.216520] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T17:43:42.390710] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-03T17:43:42.816245] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T17:43:43.190704] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-03T17:43:43.888123] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T17:43:43.990732] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-03T17:43:44.441112] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T17:43:44.790703] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-03T17:43:45.332482] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T17:43:45.453175] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T17:43:45.590707] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-03T17:43:46.390692] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-03T17:43:46.644220] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:43:47.190684] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-03T17:43:47.391678] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T17:43:47.990666] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-03T17:43:48.184031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T17:43:48.790702] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-03T17:43:49.590701] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-03T17:43:49.682142] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:43:49.844364] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T17:43:50.390712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-03T17:43:50.857627] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T17:43:51.190740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-03T17:43:51.425033] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:43:51.990725] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-03T17:43:52.566136] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:43:52.790689] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-03T17:43:53.590637] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-03T17:43:53.622386] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T17:43:54.133012] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T17:43:54.390708] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-03T17:43:55.042008] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T17:43:55.190696] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-03T17:43:55.716130] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:43:55.990730] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-03T17:43:56.473951] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T17:43:56.790712] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-03T17:43:57.438938] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T17:43:57.590719] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-03T17:43:57.871067] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T17:43:57.872796] [INFO ] [REMOTE ] BOE: Full fetch complete (26819 records). [2025-10-03T17:43:57.872878] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-03T17:43:58.327824] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-03T17:43:58.327907] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-03T17:43:58.328348] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-03T17:43:58.328410] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-03T17:43:58.329175] [DEBUG] [LOCAL ] BOE: Trimmed 26819 records to 18104 (keeping 200 days of data) [2025-10-03T17:43:58.390839] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-03T17:43:58.449478] [DEBUG] [LOCAL ] BOE: Primary data saved (18104 records). [2025-10-03T17:43:58.449624] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-03T17:43:58.449780] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOE took 27.4s. Estimated remaining: 4h 40m 13s. Rate: 7.3 symbols/min [2025-10-03T17:43:58.644423] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:43:58.704848] [DEBUG] [LOCAL ] BORR: Loaded 51498 existing records from primary storage. [2025-10-03T17:43:58.705205] [INFO ] [MAIN ] BORR: Loaded 51498 existing records. [2025-10-03T17:43:58.903378] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:43:58.903764] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-03T17:43:58.903857] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-03T17:43:58.904355] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-03T17:43:58.904415] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-03T17:43:59.038376] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:43:59.195748] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-03T17:43:59.326874] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:43:59.694237] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T17:43:59.990740] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-03T17:44:00.303229] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:44:00.304695] [INFO ] [REMOTE ] BOH: Full fetch complete (44632 records). [2025-10-03T17:44:00.304816] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-03T17:44:00.305464] [FATAL] [VALIDATOR ] BOH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:44:00.305562] [FATAL] [MAIN ] BOH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:44:00.305610] [WARN ] [MAIN ] BOH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:44:00.305683] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-03T17:44:00.305773] [DEBUG] [LOCAL ] BOH: No primary data file found to delete. [2025-10-03T17:44:00.305817] [INFO ] [LOCAL ] BOH: Starting deletion of derivative data. [2025-10-03T17:44:00.306252] [DEBUG] [LOCAL ] BOH: Deleted derivative data file. [2025-10-03T17:44:00.306373] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOH took 29.3s. Estimated remaining: 4h 39m 24s. Rate: 7.3 symbols/min [2025-10-03T17:44:00.490355] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:00.519636] [DEBUG] [LOCAL ] BOW: Loaded 23861 existing records from primary storage. [2025-10-03T17:44:00.520069] [INFO ] [MAIN ] BOW: Loaded 23861 existing records. [2025-10-03T17:44:00.720577] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:00.720854] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-03T17:44:00.720907] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-03T17:44:00.721156] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-03T17:44:00.721268] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-03T17:44:00.795811] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-03T17:44:01.121033] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:01.435036] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T17:44:01.590696] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-03T17:44:02.390731] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-03T17:44:02.495621] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:44:02.497782] [INFO ] [REMOTE ] BOND: Full fetch complete (46509 records). [2025-10-03T17:44:02.497924] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-03T17:44:02.965790] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-03T17:44:02.965897] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-03T17:44:02.966503] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-03T17:44:02.966681] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-03T17:44:02.997149] [DEBUG] [LOCAL ] BOND: Trimmed 46509 records to 32665 (keeping 200 days of data) [2025-10-03T17:44:02.999142] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-03T17:44:03.195404] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-03T17:44:03.237851] [DEBUG] [LOCAL ] BOND: Primary data saved (32665 records). [2025-10-03T17:44:03.238000] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-03T17:44:03.238097] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOND took 32.2s. Estimated remaining: 4h 38m 43s. Rate: 7.3 symbols/min [2025-10-03T17:44:03.415860] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:03.474687] [DEBUG] [LOCAL ] BOX: Loaded 50593 existing records from primary storage. [2025-10-03T17:44:03.475083] [INFO ] [MAIN ] BOX: Loaded 50593 existing records. [2025-10-03T17:44:03.666527] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:03.666770] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-03T17:44:03.666829] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-03T17:44:03.667763] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-03T17:44:03.667834] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-03T17:44:04.002050] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-03T17:44:04.049248] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:04.220513] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T17:44:04.422284] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T17:44:04.790678] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-03T17:44:05.590679] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-03T17:44:05.756462] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:44:05.909450] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:44:06.390725] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-03T17:44:07.154721] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:44:07.190692] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-03T17:44:07.990685] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-03T17:44:08.174045] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:44:08.790700] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-03T17:44:08.939590] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T17:44:09.362976] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T17:44:09.590672] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-03T17:44:09.645341] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T17:44:10.390704] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-03T17:44:11.190690] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-03T17:44:11.267013] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:44:11.882945] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T17:44:11.885343] [INFO ] [REMOTE ] BOOT: Full fetch complete (60221 records). [2025-10-03T17:44:11.885448] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-03T17:44:11.994318] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-03T17:44:12.309307] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-03T17:44:12.309451] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-03T17:44:12.310282] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-03T17:44:12.310397] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-03T17:44:12.311912] [DEBUG] [LOCAL ] BOOT: Trimmed 60221 records to 41070 (keeping 200 days of data) [2025-10-03T17:44:12.571088] [DEBUG] [LOCAL ] BOOT: Primary data saved (41070 records). [2025-10-03T17:44:12.571223] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-03T17:44:12.571322] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOOT took 41.5s. Estimated remaining: 4h 38m 42s. Rate: 7.3 symbols/min [2025-10-03T17:44:12.772321] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:12.801177] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-03T17:44:12.804674] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T17:44:12.867539] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-10-03T17:44:12.867955] [INFO ] [MAIN ] BP: Loaded 54101 existing records. [2025-10-03T17:44:13.075810] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:13.076070] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-03T17:44:13.076141] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-03T17:44:13.077837] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-03T17:44:13.077906] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-03T17:44:13.477695] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:13.498414] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T17:44:13.590721] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-03T17:44:14.390698] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-03T17:44:14.586104] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T17:44:15.190699] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-03T17:44:15.600176] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:44:15.990747] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-03T17:44:16.063901] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T17:44:16.775475] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:44:16.790618] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-03T17:44:17.211052] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T17:44:17.590681] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-03T17:44:18.390700] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-03T17:44:18.858951] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-03T17:44:19.195873] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-03T17:44:19.213082] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:44:19.656945] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T17:44:19.990724] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-03T17:44:20.790726] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-03T17:44:21.249481] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-10-03T17:44:21.416909] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:44:21.590743] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-03T17:44:22.380932] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T17:44:22.391629] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-03T17:44:22.428590] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T17:44:23.190714] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-03T17:44:23.990698] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-03T17:44:24.578333] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T17:44:24.790749] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-03T17:44:24.965132] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T17:44:25.590734] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-03T17:44:25.718002] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T17:44:25.767899] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T17:44:26.390689] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-03T17:44:27.190731] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-03T17:44:28.001574] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T17:44:28.001749] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-03T17:44:28.020146] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-03T17:44:28.612541] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:44:28.790673] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-03T17:44:28.820979] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T17:44:29.590749] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-03T17:44:30.390704] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-03T17:44:30.906239] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-03T17:44:30.954455] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T17:44:31.190679] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-03T17:44:31.425078] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T17:44:31.990735] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-03T17:44:32.790707] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-03T17:44:32.982326] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:44:32.984686] [INFO ] [REMOTE ] BOW: Full fetch complete (31735 records). [2025-10-03T17:44:32.984810] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-03T17:44:33.112118] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:44:33.452456] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-03T17:44:33.452537] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-03T17:44:33.452968] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-03T17:44:33.453032] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-03T17:44:33.453910] [DEBUG] [LOCAL ] BOW: Trimmed 31735 records to 24158 (keeping 200 days of data) [2025-10-03T17:44:33.592118] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-03T17:44:33.607164] [DEBUG] [LOCAL ] BOW: Primary data saved (24158 records). [2025-10-03T17:44:33.607375] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-03T17:44:33.607500] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOW took 33.3s. Estimated remaining: 4h 39m 55s. Rate: 7.3 symbols/min [2025-10-03T17:44:33.790466] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:33.829003] [DEBUG] [LOCAL ] BR: Loaded 34933 existing records from primary storage. [2025-10-03T17:44:33.829340] [INFO ] [MAIN ] BR: Loaded 34933 existing records. [2025-10-03T17:44:34.063946] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:34.064440] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-03T17:44:34.064677] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-03T17:44:34.066058] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-03T17:44:34.066126] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-03T17:44:34.400254] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-03T17:44:34.505834] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:44:34.511665] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:35.154713] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:44:35.190625] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-03T17:44:35.990668] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-03T17:44:36.390625] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T17:44:36.711603] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:44:36.714618] [INFO ] [REMOTE ] BOX: Full fetch complete (72088 records). [2025-10-03T17:44:36.714816] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-03T17:44:36.796874] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-03T17:44:37.135946] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-03T17:44:37.136036] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-03T17:44:37.136847] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-03T17:44:37.136935] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-03T17:44:37.138488] [DEBUG] [LOCAL ] BOX: Trimmed 72088 records to 50948 (keeping 200 days of data) [2025-10-03T17:44:37.453376] [DEBUG] [LOCAL ] BOX: Primary data saved (50948 records). [2025-10-03T17:44:37.453758] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-03T17:44:37.453977] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BOX took 34.2s. Estimated remaining: 4h 39m 19s. Rate: 7.3 symbols/min [2025-10-03T17:44:37.595794] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-03T17:44:37.646354] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:37.708805] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T17:44:37.710108] [DEBUG] [LOCAL ] BRBR: Loaded 51682 existing records from primary storage. [2025-10-03T17:44:37.712906] [INFO ] [MAIN ] BRBR: Loaded 51682 existing records. [2025-10-03T17:44:37.746891] [INFO ] [REMOTE ] BORR: Full fetch complete (74633 records). [2025-10-03T17:44:37.783568] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-03T17:44:38.077583] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:38.096078] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-03T17:44:38.096349] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-03T17:44:38.158085] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-03T17:44:38.179246] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-03T17:44:38.669129] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T17:44:38.683812] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-03T17:44:38.728085] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-03T17:44:38.727992] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-03T17:44:38.735510] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-03T17:44:38.741954] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-03T17:44:38.820358] [DEBUG] [LOCAL ] BORR: Trimmed 74633 records to 51865 (keeping 200 days of data) [2025-10-03T17:44:38.834349] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:39.143521] [DEBUG] [LOCAL ] BORR: Primary data saved (51865 records). [2025-10-03T17:44:39.143709] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-03T17:44:39.143826] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BORR took 40.7s. Estimated remaining: 4h 38m 30s. Rate: 7.3 symbols/min [2025-10-03T17:44:39.207857] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-03T17:44:39.337247] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:39.357215] [DEBUG] [LOCAL ] BRC: Loaded 19152 existing records from primary storage. [2025-10-03T17:44:39.357482] [INFO ] [MAIN ] BRC: Loaded 19152 existing records. [2025-10-03T17:44:39.564262] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:39.564478] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-03T17:44:39.564528] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-03T17:44:39.565133] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-03T17:44:39.565223] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-03T17:44:40.019338] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:40.020560] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-03T17:44:40.065926] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-03T17:44:40.092189] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:44:40.504058] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T17:44:40.790710] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-03T17:44:41.368962] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T17:44:41.590685] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-03T17:44:41.884507] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T17:44:42.390717] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-03T17:44:43.001611] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:44:43.190717] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-03T17:44:43.573523] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T17:44:43.990733] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-03T17:44:44.270969] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:44:44.790726] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-03T17:44:45.126122] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T17:44:45.590695] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-03T17:44:46.390734] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-03T17:44:46.980727] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-03T17:44:47.062070] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T17:44:47.190678] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-03T17:44:47.701922] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T17:44:47.990694] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-03T17:44:48.729327] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:44:48.790712] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-03T17:44:49.590739] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-03T17:44:50.017734] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:44:50.128704] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:44:50.390631] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-03T17:44:50.620512] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T17:44:51.190717] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-03T17:44:51.565281] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:44:51.990707] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-03T17:44:52.466733] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:44:52.790723] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-03T17:44:53.590695] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-03T17:44:53.668560] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T17:44:53.946465] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T17:44:54.390731] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-03T17:44:55.190737] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-03T17:44:55.418552] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:44:55.550789] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T17:44:55.553580] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-10-03T17:44:55.553777] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-03T17:44:55.998543] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-03T17:44:56.002573] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-03T17:44:56.003687] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-03T17:44:56.004610] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-03T17:44:56.004837] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-03T17:44:56.006442] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54491 (keeping 200 days of data) [2025-10-03T17:44:56.369813] [DEBUG] [LOCAL ] BP: Primary data saved (54491 records). [2025-10-03T17:44:56.369967] [INFO ] [MAIN ] BP: Full history saved. [2025-10-03T17:44:56.372375] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BP took 43.8s. Estimated remaining: 4h 39m 18s. Rate: 7.3 symbols/min [2025-10-03T17:44:56.564941] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:44:56.612324] [DEBUG] [LOCAL ] BRCC: Loaded 40474 existing records from primary storage. [2025-10-03T17:44:56.612882] [INFO ] [MAIN ] BRCC: Loaded 40474 existing records. [2025-10-03T17:44:56.794810] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-03T17:44:56.875086] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:44:56.876165] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-03T17:44:56.876390] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-03T17:44:56.878816] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:44:56.891559] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-03T17:44:56.892285] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-03T17:44:56.941065] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:44:57.292810] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:44:57.590710] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-03T17:44:58.390618] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-03T17:44:58.424128] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:44:59.190637] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-03T17:44:59.302629] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:44:59.344061] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T17:44:59.990693] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-03T17:45:00.790684] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-03T17:45:00.862698] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T17:45:01.590703] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-03T17:45:01.779856] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:45:01.828733] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T17:45:02.390734] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-03T17:45:03.190704] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-03T17:45:03.351811] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T17:45:03.862000] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:45:03.990684] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-03T17:45:04.790719] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-03T17:45:05.339024] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T17:45:05.401390] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:45:05.590698] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-03T17:45:06.156250] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T17:45:06.158202] [INFO ] [REMOTE ] BR: Full fetch complete (49329 records). [2025-10-03T17:45:06.158316] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-03T17:45:06.397151] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-03T17:45:06.578619] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-03T17:45:06.578744] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-03T17:45:06.579440] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-03T17:45:06.579534] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-03T17:45:06.580952] [DEBUG] [LOCAL ] BR: Trimmed 49329 records to 35147 (keeping 200 days of data) [2025-10-03T17:45:06.828536] [DEBUG] [LOCAL ] BR: Primary data saved (35147 records). [2025-10-03T17:45:06.828734] [INFO ] [MAIN ] BR: Full history saved. [2025-10-03T17:45:06.828861] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 33.2s. Estimated remaining: 4h 39m 24s. Rate: 7.3 symbols/min [2025-10-03T17:45:07.022618] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:07.083594] [DEBUG] [LOCAL ] BRO: Loaded 52266 existing records from primary storage. [2025-10-03T17:45:07.084023] [INFO ] [MAIN ] BRO: Loaded 52266 existing records. [2025-10-03T17:45:07.196639] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-03T17:45:07.288128] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:07.288486] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-03T17:45:07.288566] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-03T17:45:07.291095] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-03T17:45:07.291177] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-03T17:45:07.672530] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T17:45:07.757572] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:07.990690] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-03T17:45:08.077119] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T17:45:08.347940] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:45:08.790693] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-03T17:45:09.590682] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-03T17:45:09.615587] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:45:09.618357] [INFO ] [REMOTE ] BRBR: Full fetch complete (72128 records). [2025-10-03T17:45:09.618490] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-03T17:45:10.064477] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-03T17:45:10.064633] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-03T17:45:10.065617] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-03T17:45:10.065725] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-03T17:45:10.067307] [DEBUG] [LOCAL ] BRBR: Trimmed 72128 records to 52061 (keeping 200 days of data) [2025-10-03T17:45:10.316755] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:45:10.392891] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-03T17:45:10.440803] [DEBUG] [LOCAL ] BRBR: Primary data saved (52061 records). [2025-10-03T17:45:10.440973] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-03T17:45:10.441069] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRBR took 33.0s. Estimated remaining: 4h 38m 47s. Rate: 7.3 symbols/min [2025-10-03T17:45:10.625636] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:10.681804] [DEBUG] [LOCAL ] BROS: Loaded 53681 existing records from primary storage. [2025-10-03T17:45:10.682180] [INFO ] [MAIN ] BROS: Loaded 53681 existing records. [2025-10-03T17:45:10.872519] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:10.872755] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-03T17:45:10.872809] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-03T17:45:10.874844] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-03T17:45:10.874912] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-03T17:45:11.192609] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-03T17:45:11.266260] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:11.365459] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:45:11.990624] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-03T17:45:12.079022] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T17:45:12.099996] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T17:45:12.101736] [INFO ] [REMOTE ] BRC: Full fetch complete (28887 records). [2025-10-03T17:45:12.101879] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-03T17:45:12.102502] [FATAL] [VALIDATOR ] BRC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:45:12.102613] [FATAL] [MAIN ] BRC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:45:12.102711] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:45:12.102804] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-03T17:45:12.102895] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-10-03T17:45:12.103133] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-10-03T17:45:12.103541] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-10-03T17:45:12.103720] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BRC took 33.0s. Estimated remaining: 4h 37m 59s. Rate: 7.3 symbols/min [2025-10-03T17:45:12.308967] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:12.309177] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-03T17:45:12.309235] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-03T17:45:12.309354] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-03T17:45:12.309399] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-03T17:45:12.309444] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-03T17:45:12.309478] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-03T17:45:12.704162] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:12.790638] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-03T17:45:13.008766] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:45:13.009009] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-03T17:45:13.009110] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:45:13.009183] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-03T17:45:13.009259] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:45:13.009350] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-03T17:45:13.009426] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-03T17:45:13.009469] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-03T17:45:13.009510] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-03T17:45:13.009558] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 37m 6s. Rate: 7.4 symbols/min [2025-10-03T17:45:13.196701] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:13.196933] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-03T17:45:13.196989] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-03T17:45:13.197102] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-03T17:45:13.197144] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-03T17:45:13.197185] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-03T17:45:13.197259] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-03T17:45:13.599981] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:13.593033] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-03T17:45:13.771011] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T17:45:14.390622] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-03T17:45:15.181251] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T17:45:15.190621] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-03T17:45:15.736723] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:45:15.990699] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-03T17:45:16.790720] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-03T17:45:16.838770] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T17:45:17.590708] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-03T17:45:17.837949] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:45:18.390678] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-03T17:45:18.819879] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:45:19.190697] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-03T17:45:19.295771] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:45:19.990685] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-03T17:45:20.155890] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T17:45:20.679093] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T17:45:20.790704] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-03T17:45:20.921726] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T17:45:21.590735] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-03T17:45:22.390679] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-03T17:45:22.499497] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:45:22.999927] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T17:45:23.190737] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-03T17:45:23.987446] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:45:23.997402] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-03T17:45:24.555407] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:45:24.790731] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-03T17:45:25.452444] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:45:25.590724] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-03T17:45:26.390671] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-03T17:45:26.837242] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T17:45:27.063338] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:45:27.190794] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-03T17:45:27.990719] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-03T17:45:28.267884] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T17:45:28.790675] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-03T17:45:28.964300] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:45:29.344316] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T17:45:29.590758] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-03T17:45:30.390632] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-03T17:45:30.495533] [DEBUG] [REMOTE ] BRCC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T17:45:30.495913] [WARN ] [REMOTE ] BRCC: No data returned for month 2025-09 [2025-10-03T17:45:30.496010] [FATAL] [REMOTE ] BRCC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:45:30.496096] [FATAL] [MAIN ] BRCC: Failed to fetch primary data. [2025-10-03T17:45:30.496160] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:45:30.496232] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-03T17:45:30.496298] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-10-03T17:45:30.496335] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-10-03T17:45:30.496595] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-10-03T17:45:30.496710] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 34.1s. Estimated remaining: 4h 37m 55s. Rate: 7.3 symbols/min [2025-10-03T17:45:30.692961] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:30.693612] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-10-03T17:45:30.694150] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-10-03T17:45:30.712987] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-03T17:45:30.726058] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-03T17:45:30.732768] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:45:30.762257] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-03T17:45:30.762851] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-03T17:45:30.823954] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-03T17:45:31.176340] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:31.190721] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-03T17:45:31.990727] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-03T17:45:32.801621] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-03T17:45:32.826928] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:45:33.381913] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:45:33.590752] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-03T17:45:33.618963] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T17:45:34.390703] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-03T17:45:35.090467] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T17:45:35.096340] [INFO ] [REMOTE ] BRO: Full fetch complete (74272 records). [2025-10-03T17:45:35.096473] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-03T17:45:35.195804] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-03T17:45:35.517391] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-03T17:45:35.517486] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-03T17:45:35.518348] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-03T17:45:35.518539] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-03T17:45:35.520315] [DEBUG] [LOCAL ] BRO: Trimmed 74272 records to 52641 (keeping 200 days of data) [2025-10-03T17:45:35.872142] [DEBUG] [LOCAL ] BRO: Primary data saved (52641 records). [2025-10-03T17:45:35.872286] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-03T17:45:35.872376] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRO took 29.0s. Estimated remaining: 4h 37m 30s. Rate: 7.3 symbols/min [2025-10-03T17:45:35.991314] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-03T17:45:36.080720] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:36.106959] [DEBUG] [LOCAL ] BRW: Loaded 20369 existing records from primary storage. [2025-10-03T17:45:36.107448] [INFO ] [MAIN ] BRW: Loaded 20369 existing records. [2025-10-03T17:45:36.326909] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:36.327469] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-03T17:45:36.327713] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-03T17:45:36.328221] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-03T17:45:36.328320] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-03T17:45:36.478066] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T17:45:36.706800] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:45:36.794924] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-03T17:45:36.796609] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:45:36.869455] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:37.360143] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:45:37.590721] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-03T17:45:38.390715] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-03T17:45:39.190712] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-03T17:45:39.629414] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T17:45:39.791270] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:45:39.990722] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-03T17:45:39.994849] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T17:45:40.790732] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-03T17:45:41.431751] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T17:45:41.590706] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-03T17:45:42.158296] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T17:45:42.390630] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-03T17:45:42.787734] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T17:45:43.190738] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-03T17:45:43.943189] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T17:45:43.990662] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-03T17:45:44.440179] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T17:45:44.593877] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T17:45:44.790713] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-03T17:45:45.590733] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-03T17:45:46.222868] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T17:45:46.242683] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T17:45:46.390712] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-03T17:45:47.190719] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-03T17:45:47.990730] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-03T17:45:48.339265] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T17:45:48.342803] [INFO ] [REMOTE ] BROS: Full fetch complete (77050 records). [2025-10-03T17:45:48.342998] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-03T17:45:48.789091] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T17:45:48.794485] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-03T17:45:48.869635] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-03T17:45:48.869803] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-03T17:45:48.870706] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-03T17:45:48.871335] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-03T17:45:48.888537] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:45:48.894805] [DEBUG] [LOCAL ] BROS: Trimmed 77050 records to 54071 (keeping 200 days of data) [2025-10-03T17:45:49.236625] [DEBUG] [LOCAL ] BROS: Primary data saved (54071 records). [2025-10-03T17:45:49.236816] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-03T17:45:49.236923] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BROS took 38.8s. Estimated remaining: 4h 37m 53s. Rate: 7.3 symbols/min [2025-10-03T17:45:49.436287] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:49.493039] [DEBUG] [LOCAL ] BRX: Loaded 52084 existing records from primary storage. [2025-10-03T17:45:49.493418] [INFO ] [MAIN ] BRX: Loaded 52084 existing records. [2025-10-03T17:45:49.595736] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-03T17:45:49.685761] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:45:49.748790] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:49.749033] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-03T17:45:49.749090] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-03T17:45:49.749782] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-03T17:45:49.749845] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-03T17:45:50.153970] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:50.390730] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-03T17:45:51.009540] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:45:51.039814] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T17:45:51.041885] [INFO ] [REMOTE ] BRSP: Full fetch complete (54192 records). [2025-10-03T17:45:51.041989] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-03T17:45:51.195847] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-03T17:45:51.461033] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-03T17:45:51.461166] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-03T17:45:51.461914] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-03T17:45:51.461982] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-03T17:45:51.463179] [DEBUG] [LOCAL ] BRSP: Trimmed 54192 records to 37343 (keeping 200 days of data) [2025-10-03T17:45:51.698802] [DEBUG] [LOCAL ] BRSP: Primary data saved (37343 records). [2025-10-03T17:45:51.698954] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-03T17:45:51.699071] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BRSP took 38.7s. Estimated remaining: 4h 37m 10s. Rate: 7.3 symbols/min [2025-10-03T17:45:51.906427] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:51.906632] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T17:45:51.908352] [INFO ] [REMOTE ] BRT: Full fetch complete (6803 records). [2025-10-03T17:45:51.908443] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-03T17:45:51.994765] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-03T17:45:52.201268] [DEBUG] [LOCAL ] BSAC: Loaded 33243 existing records from primary storage. [2025-10-03T17:45:52.226045] [INFO ] [MAIN ] BSAC: Loaded 33243 existing records. [2025-10-03T17:45:52.573517] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-03T17:45:52.573233] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:52.573718] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-03T17:45:52.573899] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-03T17:45:52.574297] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-03T17:45:52.574397] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-03T17:45:52.574543] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-03T17:45:52.574799] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-03T17:45:52.574875] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-03T17:45:52.636753] [DEBUG] [LOCAL ] BRT: Trimmed 6803 records to 5030 (keeping 200 days of data) [2025-10-03T17:45:52.793304] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-03T17:45:52.989070] [DEBUG] [LOCAL ] BRT: Primary data saved (5030 records). [2025-10-03T17:45:53.005407] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-03T17:45:53.021972] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRT took 22.5s. Estimated remaining: 4h 36m 21s. Rate: 7.4 symbols/min [2025-10-03T17:45:53.196862] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:53.269422] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T17:45:53.437067] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:45:53.502382] [DEBUG] [LOCAL ] BSBR: Loaded 35696 existing records from primary storage. [2025-10-03T17:45:53.502912] [INFO ] [MAIN ] BSBR: Loaded 35696 existing records. [2025-10-03T17:45:53.602015] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-03T17:45:53.794755] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:45:53.795103] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-03T17:45:53.795188] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-03T17:45:53.796841] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-03T17:45:53.796927] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-03T17:45:54.283007] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:45:54.390735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-03T17:45:54.800531] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T17:45:54.851734] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:45:55.190711] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-03T17:45:55.441017] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T17:45:55.990629] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-03T17:45:56.306997] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:45:56.790738] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-03T17:45:56.918920] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T17:45:57.590705] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-03T17:45:57.699232] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T17:45:58.390699] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-03T17:45:58.575679] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T17:45:59.190689] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-03T17:45:59.990612] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-03T17:46:00.034777] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:46:00.074735] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T17:46:00.790688] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-03T17:46:00.999886] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T17:46:01.590737] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-03T17:46:02.390751] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-03T17:46:02.479490] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T17:46:03.002064] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T17:46:03.190685] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-03T17:46:03.445203] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T17:46:03.990687] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-03T17:46:04.636787] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:46:04.790706] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-03T17:46:05.038606] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:46:05.590633] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-03T17:46:05.993550] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:46:06.390689] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-03T17:46:06.988712] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:46:07.190696] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-03T17:46:07.893064] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:46:07.990687] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-03T17:46:08.537613] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T17:46:08.790698] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-03T17:46:09.318086] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T17:46:09.590689] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-03T17:46:10.390665] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-03T17:46:10.740510] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T17:46:11.159718] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T17:46:11.190661] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-03T17:46:11.458815] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T17:46:11.990718] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-03T17:46:12.566862] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T17:46:12.790714] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-03T17:46:13.314470] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:46:13.590663] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-03T17:46:14.056444] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T17:46:14.390738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-03T17:46:14.867859] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T17:46:15.190742] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-03T17:46:15.741576] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:46:15.743783] [INFO ] [REMOTE ] BRW: Full fetch complete (30542 records). [2025-10-03T17:46:15.743878] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-03T17:46:16.000495] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-03T17:46:16.146383] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-03T17:46:16.146470] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-03T17:46:16.146921] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-03T17:46:16.147017] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-03T17:46:16.147917] [DEBUG] [LOCAL ] BRW: Trimmed 30542 records to 20684 (keeping 200 days of data) [2025-10-03T17:46:16.275942] [DEBUG] [LOCAL ] BRW: Primary data saved (20684 records). [2025-10-03T17:46:16.276080] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-03T17:46:16.276170] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRW took 40.4s. Estimated remaining: 4h 37m 43s. Rate: 7.3 symbols/min [2025-10-03T17:46:16.487269] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:16.487585] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-03T17:46:16.487685] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-03T17:46:16.487851] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-03T17:46:16.487897] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-03T17:46:16.487941] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-03T17:46:16.487977] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-03T17:46:16.793955] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-03T17:46:16.867440] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:16.997838] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:46:17.590690] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-03T17:46:17.690935] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:46:17.942859] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:46:18.390758] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-03T17:46:18.486670] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T17:46:19.190726] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-03T17:46:19.443937] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:46:19.446008] [INFO ] [REMOTE ] BSAC: Full fetch complete (44003 records). [2025-10-03T17:46:19.446094] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-03T17:46:19.851426] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-03T17:46:19.851521] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-03T17:46:19.852133] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-03T17:46:19.852213] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-03T17:46:19.853383] [DEBUG] [LOCAL ] BSAC: Trimmed 44003 records to 33459 (keeping 200 days of data) [2025-10-03T17:46:20.014796] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-03T17:46:20.068499] [DEBUG] [LOCAL ] BSAC: Primary data saved (33459 records). [2025-10-03T17:46:20.068728] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-03T17:46:20.068857] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BSAC took 28.4s. Estimated remaining: 4h 37m 9s. Rate: 7.3 symbols/min [2025-10-03T17:46:20.264507] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:20.264796] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-03T17:46:20.264850] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-03T17:46:20.264968] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-03T17:46:20.265033] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-03T17:46:20.265097] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-03T17:46:20.265132] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-03T17:46:20.674617] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:20.676144] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:46:20.790708] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-03T17:46:21.121011] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:46:21.590728] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-03T17:46:21.626861] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:46:22.390724] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-03T17:46:22.864983] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T17:46:23.190766] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-03T17:46:23.192897] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T17:46:23.990735] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-03T17:46:24.790711] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-03T17:46:24.943208] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T17:46:25.302338] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T17:46:25.383004] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T17:46:25.590703] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-03T17:46:26.390719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-03T17:46:26.725017] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T17:46:27.190724] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-03T17:46:27.830876] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:46:27.990719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-03T17:46:28.603905] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T17:46:28.606047] [INFO ] [REMOTE ] BSBR: Full fetch complete (50706 records). [2025-10-03T17:46:28.606157] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-03T17:46:28.796367] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-03T17:46:29.067716] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-03T17:46:29.067816] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-03T17:46:29.068425] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-03T17:46:29.068495] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-03T17:46:29.069984] [DEBUG] [LOCAL ] BSBR: Trimmed 50706 records to 35923 (keeping 200 days of data) [2025-10-03T17:46:29.277732] [DEBUG] [LOCAL ] BSBR: Primary data saved (35923 records). [2025-10-03T17:46:29.277889] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-03T17:46:29.278464] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BSBR took 36.2s. Estimated remaining: 4h 37m 6s. Rate: 7.3 symbols/min [2025-10-03T17:46:29.483192] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:29.483419] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-03T17:46:29.483469] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-03T17:46:29.483822] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-03T17:46:29.483875] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-03T17:46:29.483920] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-03T17:46:29.483966] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-03T17:46:29.591117] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-03T17:46:29.829800] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:46:29.862600] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T17:46:29.958986] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:30.390719] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-03T17:46:30.915898] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:46:31.190688] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-03T17:46:31.990740] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-03T17:46:32.221815] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T17:46:32.239001] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T17:46:32.654976] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T17:46:32.790721] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-03T17:46:33.590709] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-03T17:46:34.115406] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T17:46:34.117847] [INFO ] [REMOTE ] BRX: Full fetch complete (74571 records). [2025-10-03T17:46:34.118045] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-03T17:46:34.119123] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:46:34.119250] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:46:34.119320] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:46:34.119393] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-03T17:46:34.119477] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-10-03T17:46:34.119535] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-10-03T17:46:34.119906] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-10-03T17:46:34.120040] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BRX took 44.9s. Estimated remaining: 4h 36m 38s. Rate: 7.3 symbols/min [2025-10-03T17:46:34.317923] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:34.323979] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-03T17:46:34.324827] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T17:46:34.324451] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-03T17:46:34.327462] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-03T17:46:34.327851] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-03T17:46:34.327912] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-03T17:46:34.327948] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-03T17:46:34.395890] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-03T17:46:34.733353] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:34.809788] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T17:46:35.190736] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-03T17:46:35.987270] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T17:46:35.990602] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-03T17:46:36.728179] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T17:46:36.729914] [INFO ] [REMOTE ] BSL: Full fetch complete (12771 records). [2025-10-03T17:46:36.730037] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-03T17:46:36.799396] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-03T17:46:37.139779] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-03T17:46:37.139865] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-03T17:46:37.140169] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-03T17:46:37.140210] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-03T17:46:37.140719] [DEBUG] [LOCAL ] BSL: Trimmed 12771 records to 8434 (keeping 200 days of data) [2025-10-03T17:46:37.194628] [DEBUG] [LOCAL ] BSL: Primary data saved (8434 records). [2025-10-03T17:46:37.194796] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-03T17:46:37.194903] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSL took 20.9s. Estimated remaining: 4h 35m 60s. Rate: 7.3 symbols/min [2025-10-03T17:46:37.375953] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:46:37.432485] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-10-03T17:46:37.432942] [INFO ] [MAIN ] BSX: Loaded 54078 existing records. [2025-10-03T17:46:37.600329] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-03T17:46:37.636475] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:46:37.636789] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-03T17:46:37.636868] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-03T17:46:37.638835] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-03T17:46:37.638931] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-03T17:46:38.032375] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:46:38.046106] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:46:38.390680] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-03T17:46:38.918780] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T17:46:39.190715] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-03T17:46:39.938472] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T17:46:39.990635] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-03T17:46:40.302915] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T17:46:40.790680] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-03T17:46:41.018696] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:46:41.590637] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-03T17:46:41.827838] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T17:46:42.390711] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-03T17:46:42.899918] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T17:46:43.190718] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-03T17:46:43.990714] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-03T17:46:44.288846] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T17:46:44.593938] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:46:44.790700] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-03T17:46:45.161780] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T17:46:45.590719] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-03T17:46:46.390741] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-03T17:46:46.733139] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T17:46:47.065208] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T17:46:47.190772] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-03T17:46:47.594982] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:46:47.990710] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-03T17:46:48.660191] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T17:46:48.790725] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-03T17:46:48.991054] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T17:46:49.590723] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-03T17:46:50.390694] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-03T17:46:50.918890] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T17:46:50.949683] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:46:50.997082] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-03T17:46:51.190707] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-03T17:46:51.990675] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-03T17:46:52.355056] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T17:46:52.790630] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-03T17:46:53.590667] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-03T17:46:53.916254] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T17:46:54.235847] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T17:46:54.390749] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-03T17:46:54.771880] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T17:46:55.190697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-03T17:46:55.561326] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T17:46:55.990715] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-03T17:46:56.790632] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-03T17:46:57.063681] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T17:46:57.183617] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T17:46:57.590740] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-03T17:46:58.171827] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T17:46:58.390705] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-03T17:46:58.486967] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T17:46:59.190712] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-03T17:46:59.990776] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-03T17:47:00.271876] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T17:47:00.329448] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T17:47:00.790736] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-03T17:47:00.964493] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T17:47:01.590790] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-03T17:47:01.837766] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T17:47:01.839521] [INFO ] [REMOTE ] BSM: Full fetch complete (47199 records). [2025-10-03T17:47:01.839637] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-03T17:47:01.841505] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:01.841849] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:01.841928] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:01.842009] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-03T17:47:01.842100] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-03T17:47:01.842161] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-03T17:47:01.842222] [DEBUG] [LOCAL ] BSM: No derivative data file found to delete. [2025-10-03T17:47:01.842340] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSM took 41.8s. Estimated remaining: 4h 37m 29s. Rate: 7.3 symbols/min [2025-10-03T17:47:02.030299] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:02.030575] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-10-03T17:47:02.030634] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-10-03T17:47:02.030762] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-03T17:47:02.030830] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-03T17:47:02.030894] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-03T17:47:02.030930] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-03T17:47:02.395932] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-03T17:47:02.458910] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:02.672244] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T17:47:03.190760] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-03T17:47:03.990694] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-03T17:47:04.250109] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T17:47:04.251834] [INFO ] [REMOTE ] BST: Full fetch complete (28810 records). [2025-10-03T17:47:04.251944] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-03T17:47:04.788488] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-10-03T17:47:04.788736] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-10-03T17:47:04.789491] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-10-03T17:47:04.789586] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-10-03T17:47:04.790742] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-03T17:47:04.792753] [DEBUG] [LOCAL ] BST: Trimmed 28810 records to 19287 (keeping 200 days of data) [2025-10-03T17:47:04.951042] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T17:47:04.995913] [DEBUG] [LOCAL ] BST: Primary data saved (19287 records). [2025-10-03T17:47:04.996147] [INFO ] [MAIN ] BST: Full history saved. [2025-10-03T17:47:04.996266] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BST took 35.7s. Estimated remaining: 4h 36m 51s. Rate: 7.3 symbols/min [2025-10-03T17:47:05.184050] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:05.205362] [DEBUG] [LOCAL ] BTCM: Loaded 15505 existing records from primary storage. [2025-10-03T17:47:05.205787] [INFO ] [MAIN ] BTCM: Loaded 15505 existing records. [2025-10-03T17:47:05.397354] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:05.397868] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-03T17:47:05.409003] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-03T17:47:05.416076] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-10-03T17:47:05.416152] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-03T17:47:05.422352] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T17:47:05.592154] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-03T17:47:05.758299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T17:47:05.874760] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:06.390708] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-03T17:47:06.845630] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T17:47:07.190680] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-03T17:47:07.608579] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T17:47:07.990728] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-03T17:47:08.507494] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:47:08.790699] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-03T17:47:08.852793] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T17:47:09.590737] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-03T17:47:10.308371] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:47:10.390734] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-03T17:47:10.899200] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T17:47:11.190671] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-03T17:47:11.232754] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T17:47:11.990730] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-03T17:47:12.792942] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:47:12.791789] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-03T17:47:13.072502] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T17:47:13.392722] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T17:47:13.590736] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-03T17:47:14.257454] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T17:47:14.390689] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-03T17:47:15.190710] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-03T17:47:15.878250] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T17:47:15.990728] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-03T17:47:16.153030] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:47:16.155533] [INFO ] [REMOTE ] BSX: Full fetch complete (77309 records). [2025-10-03T17:47:16.155708] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-03T17:47:16.157825] [FATAL] [VALIDATOR ] BSX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:16.157929] [FATAL] [MAIN ] BSX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:16.157989] [WARN ] [MAIN ] BSX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:16.158080] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-03T17:47:16.158168] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-03T17:47:16.158238] [INFO ] [LOCAL ] BSX: Starting deletion of derivative data. [2025-10-03T17:47:16.158729] [DEBUG] [LOCAL ] BSX: Deleted derivative data file. [2025-10-03T17:47:16.158912] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BSX took 39.0s. Estimated remaining: 4h 37m 0s. Rate: 7.3 symbols/min [2025-10-03T17:47:16.366864] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:16.427196] [DEBUG] [LOCAL ] BTE: Loaded 53107 existing records from primary storage. [2025-10-03T17:47:16.427568] [INFO ] [MAIN ] BTE: Loaded 53107 existing records. [2025-10-03T17:47:16.630087] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:16.630310] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-03T17:47:16.630360] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-03T17:47:16.630853] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-03T17:47:16.630913] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-03T17:47:16.750565] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T17:47:16.800985] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-03T17:47:17.056025] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:17.590724] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-03T17:47:17.858781] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T17:47:17.861394] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36783 records). [2025-10-03T17:47:17.861493] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-03T17:47:18.267548] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-03T17:47:18.267639] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-03T17:47:18.268160] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-03T17:47:18.268208] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-03T17:47:18.269800] [DEBUG] [LOCAL ] BSTZ: Trimmed 36783 records to 25154 (keeping 200 days of data) [2025-10-03T17:47:18.392547] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-03T17:47:18.438594] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25154 records). [2025-10-03T17:47:18.438761] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-03T17:47:18.438860] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSTZ took 44.3s. Estimated remaining: 4h 36m 17s. Rate: 7.3 symbols/min [2025-10-03T17:47:18.627943] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:18.694329] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-10-03T17:47:18.694790] [INFO ] [MAIN ] BTI: Loaded 53946 existing records. [2025-10-03T17:47:18.898398] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:18.899473] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-03T17:47:18.899885] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-03T17:47:18.899792] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T17:47:18.901989] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-03T17:47:18.902408] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-03T17:47:19.192081] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-03T17:47:19.305887] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:19.512687] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T17:47:19.990672] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-03T17:47:20.791192] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T17:47:20.791310] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-03T17:47:21.424704] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T17:47:21.464000] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T17:47:21.590721] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-03T17:47:22.390737] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-03T17:47:23.189597] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:47:23.193913] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-03T17:47:23.990745] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-03T17:47:24.488715] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T17:47:24.758560] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-03T17:47:24.790636] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-03T17:47:25.590696] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-03T17:47:25.846685] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T17:47:26.293122] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T17:47:26.390707] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-03T17:47:26.628423] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:47:27.190727] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-03T17:47:27.990688] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-03T17:47:28.058111] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T17:47:28.643943] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T17:47:28.790705] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-03T17:47:29.282583] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T17:47:29.590742] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-03T17:47:30.390637] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-03T17:47:30.627117] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:47:30.833889] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T17:47:30.835469] [INFO ] [REMOTE ] BTCM: Full fetch complete (19483 records). [2025-10-03T17:47:30.835553] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-03T17:47:31.197638] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-03T17:47:31.237059] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-03T17:47:31.237140] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-03T17:47:31.237509] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-03T17:47:31.237550] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-03T17:47:31.238210] [DEBUG] [LOCAL ] BTCM: Trimmed 19483 records to 15705 (keeping 200 days of data) [2025-10-03T17:47:31.337341] [DEBUG] [LOCAL ] BTCM: Primary data saved (15705 records). [2025-10-03T17:47:31.337493] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-03T17:47:31.337584] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTCM took 26.3s. Estimated remaining: 4h 36m 37s. Rate: 7.3 symbols/min [2025-10-03T17:47:31.515596] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:31.527222] [DEBUG] [LOCAL ] BTO: Loaded 8811 existing records from primary storage. [2025-10-03T17:47:31.527476] [INFO ] [MAIN ] BTO: Loaded 8811 existing records. [2025-10-03T17:47:31.731662] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:31.731900] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-03T17:47:31.731950] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-03T17:47:31.732168] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-03T17:47:31.732226] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-03T17:47:32.002251] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-03T17:47:32.151610] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:32.535787] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T17:47:32.737357] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T17:47:32.793918] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-03T17:47:32.800251] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:47:33.590689] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-03T17:47:34.390678] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-03T17:47:34.518112] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:47:34.774961] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T17:47:34.992511] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:47:35.190707] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-03T17:47:35.990688] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-03T17:47:36.790735] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-03T17:47:37.379758] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-03T17:47:37.398982] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T17:47:37.590703] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-03T17:47:37.727902] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T17:47:38.365021] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:47:38.390733] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-03T17:47:39.157907] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T17:47:39.190729] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-03T17:47:39.810009] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T17:47:39.810843] [INFO ] [REMOTE ] BTA: Full fetch complete (9451 records). [2025-10-03T17:47:39.810915] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-03T17:47:39.995812] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-03T17:47:40.199459] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-03T17:47:40.199541] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-03T17:47:40.199791] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-03T17:47:40.199853] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-03T17:47:40.200296] [DEBUG] [LOCAL ] BTA: Trimmed 9451 records to 5450 (keeping 200 days of data) [2025-10-03T17:47:40.235389] [DEBUG] [LOCAL ] BTA: Primary data saved (5450 records). [2025-10-03T17:47:40.235535] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-03T17:47:40.235616] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BTA took 38.4s. Estimated remaining: 4h 36m 33s. Rate: 7.3 symbols/min [2025-10-03T17:47:40.438609] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:40.438839] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-03T17:47:40.438931] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-03T17:47:40.439062] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-03T17:47:40.439108] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-03T17:47:40.439152] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-03T17:47:40.439185] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-03T17:47:40.796694] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-03T17:47:40.845541] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:41.590710] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-03T17:47:41.703019] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:47:41.995196] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:47:42.390730] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-03T17:47:43.190711] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-03T17:47:43.594222] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:47:43.647168] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T17:47:43.990685] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-03T17:47:44.014371] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T17:47:44.790670] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-03T17:47:44.944067] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T17:47:45.590705] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-03T17:47:46.390699] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-03T17:47:46.790536] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T17:47:47.190459] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T17:47:47.190632] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-03T17:47:47.353355] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:47:47.990717] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-03T17:47:48.790730] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-03T17:47:49.309047] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T17:47:49.533352] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T17:47:49.590665] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-03T17:47:49.769575] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:47:50.328377] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T17:47:50.390698] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-03T17:47:51.190701] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-03T17:47:51.859985] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T17:47:51.862189] [INFO ] [REMOTE ] BTE: Full fetch complete (75696 records). [2025-10-03T17:47:51.862314] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-03T17:47:51.863275] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T17:47:51.863400] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:47:51.863685] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:47:51.863766] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-03T17:47:51.863849] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-10-03T17:47:51.863908] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-10-03T17:47:51.864163] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-10-03T17:47:51.864264] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BTE took 35.7s. Estimated remaining: 4h 36m 44s. Rate: 7.3 symbols/min [2025-10-03T17:47:51.995740] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-03T17:47:52.064860] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T17:47:52.065824] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:52.068914] [DEBUG] [LOCAL ] BTU: No existing data file found in primary storage. [2025-10-03T17:47:52.068973] [WARN ] [MAIN ] BTU: No existing data found, performing full refresh instead. [2025-10-03T17:47:52.069085] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-03T17:47:52.069133] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-03T17:47:52.069179] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-03T17:47:52.069214] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-03T17:47:52.459174] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:52.790736] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-03T17:47:53.590711] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-03T17:47:53.901785] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T17:47:54.133475] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:47:54.390686] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-03T17:47:55.122804] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T17:47:55.190697] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-03T17:47:55.368086] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:47:55.814570] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T17:47:55.815565] [INFO ] [REMOTE ] BTO: Full fetch complete (13231 records). [2025-10-03T17:47:55.815662] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-03T17:47:56.001378] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-03T17:47:56.206401] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-03T17:47:56.206487] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-03T17:47:56.206837] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-03T17:47:56.206900] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-03T17:47:56.207601] [DEBUG] [LOCAL ] BTO: Trimmed 13231 records to 8859 (keeping 200 days of data) [2025-10-03T17:47:56.269496] [DEBUG] [LOCAL ] BTO: Primary data saved (8859 records). [2025-10-03T17:47:56.269676] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-03T17:47:56.269791] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTO took 24.9s. Estimated remaining: 4h 36m 14s. Rate: 7.3 symbols/min [2025-10-03T17:47:56.464854] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:56.465061] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-03T17:47:56.465100] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-03T17:47:56.465224] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-03T17:47:56.465337] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-03T17:47:56.465412] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-03T17:47:56.465463] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-03T17:47:56.795824] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-03T17:47:56.864857] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:47:57.590671] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-03T17:47:57.895564] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T17:47:57.898208] [INFO ] [REMOTE ] BTI: Full fetch complete (77458 records). [2025-10-03T17:47:57.898365] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-03T17:47:58.337780] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-03T17:47:58.337880] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-03T17:47:58.338824] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-03T17:47:58.338893] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-03T17:47:58.340512] [DEBUG] [LOCAL ] BTI: Trimmed 77458 records to 54336 (keeping 200 days of data) [2025-10-03T17:47:58.394253] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-03T17:47:58.581106] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T17:47:58.668752] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:47:58.708691] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-03T17:47:58.709546] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:47:58.710028] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-03T17:47:58.712203] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:47:58.714364] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:47:58.714839] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-03T17:47:58.715854] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-03T17:47:58.726969] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-03T17:47:58.728712] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-03T17:47:58.728862] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTX took 2.5s. Estimated remaining: 4h 35m 33s. Rate: 7.3 symbols/min [2025-10-03T17:47:58.931971] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:58.951739] [DEBUG] [LOCAL ] BTI: Primary data saved (54336 records). [2025-10-03T17:47:58.951922] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-03T17:47:58.952016] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTI took 40.5s. Estimated remaining: 4h 34m 39s. Rate: 7.3 symbols/min [2025-10-03T17:47:59.073261] [DEBUG] [LOCAL ] BTZ: Loaded 22996 existing records from primary storage. [2025-10-03T17:47:59.084372] [INFO ] [MAIN ] BTZ: Loaded 22996 existing records. [2025-10-03T17:47:59.195764] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-03T17:47:59.248678] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:47:59.261026] [DEBUG] [LOCAL ] BUD: No existing data file found in primary storage. [2025-10-03T17:47:59.261087] [WARN ] [MAIN ] BUD: No existing data found, performing full refresh instead. [2025-10-03T17:47:59.267263] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-03T17:47:59.277726] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-03T17:47:59.282968] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-10-03T17:47:59.288164] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-03T17:47:59.423187] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:47:59.456183] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-03T17:47:59.456289] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-03T17:47:59.456563] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-03T17:47:59.456633] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-03T17:47:59.993783] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-03T17:48:00.023809] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:00.160109] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:00.790683] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-03T17:48:01.124585] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T17:48:01.311287] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T17:48:01.590705] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-03T17:48:02.390723] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-03T17:48:02.685550] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T17:48:02.821746] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:48:03.190689] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-03T17:48:03.547213] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:48:03.990697] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-03T17:48:04.685567] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T17:48:04.790631] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-03T17:48:05.084950] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:48:05.590689] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-03T17:48:06.155491] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:48:06.390707] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-03T17:48:07.190624] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-03T17:48:07.454944] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T17:48:07.990688] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-03T17:48:08.285566] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T17:48:08.307416] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:48:08.790721] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-03T17:48:09.590718] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-03T17:48:09.731837] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T17:48:09.905206] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:48:10.390696] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-03T17:48:10.747303] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T17:48:11.190697] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-03T17:48:11.276295] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:48:11.990741] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-03T17:48:12.790690] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-03T17:48:13.088981] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T17:48:13.590744] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-03T17:48:14.008429] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:48:14.160687] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T17:48:14.390704] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-03T17:48:14.559462] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T17:48:15.190636] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-03T17:48:15.501616] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T17:48:15.990728] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-03T17:48:16.790630] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-03T17:48:17.265101] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:48:17.590693] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-03T17:48:17.832737] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T17:48:17.912539] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T17:48:18.390701] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-03T17:48:19.190731] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-03T17:48:19.272386] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:48:19.952329] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T17:48:19.990620] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-03T17:48:20.626200] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T17:48:20.790728] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-03T17:48:21.044410] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T17:48:21.590685] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-03T17:48:22.390704] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-03T17:48:22.459572] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T17:48:22.642698] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:48:23.190703] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-03T17:48:23.990725] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-03T17:48:24.287277] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T17:48:24.790749] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-03T17:48:24.918984] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:48:24.924579] [INFO ] [REMOTE ] BTT: Full fetch complete (24070 records). [2025-10-03T17:48:24.924810] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-03T17:48:25.369226] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T17:48:25.392694] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-03T17:48:25.392919] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-03T17:48:25.393429] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-03T17:48:25.393500] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-03T17:48:25.394302] [DEBUG] [LOCAL ] BTT: Trimmed 24070 records to 16174 (keeping 200 days of data) [2025-10-03T17:48:25.499026] [DEBUG] [LOCAL ] BTT: Primary data saved (16174 records). [2025-10-03T17:48:25.499183] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-03T17:48:25.499289] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTT took 45.3s. Estimated remaining: 4h 36m 16s. Rate: 7.3 symbols/min [2025-10-03T17:48:25.595863] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-03T17:48:25.731955] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:25.732141] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-03T17:48:25.732301] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-03T17:48:25.732481] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-03T17:48:25.732531] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-03T17:48:25.732575] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-03T17:48:25.732609] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-03T17:48:25.857587] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:48:25.901599] [INFO ] [REMOTE ] BTZ: Full fetch complete (33870 records). [2025-10-03T17:48:25.947800] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-03T17:48:26.307047] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:26.396482] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-03T17:48:26.590788] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-03T17:48:26.591100] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-03T17:48:26.591684] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-03T17:48:26.591750] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-03T17:48:26.592715] [DEBUG] [LOCAL ] BTZ: Trimmed 33870 records to 23173 (keeping 200 days of data) [2025-10-03T17:48:26.745826] [DEBUG] [LOCAL ] BTZ: Primary data saved (23173 records). [2025-10-03T17:48:26.745966] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-03T17:48:26.746059] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTZ took 28.0s. Estimated remaining: 4h 35m 28s. Rate: 7.3 symbols/min [2025-10-03T17:48:26.932833] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:26.983018] [DEBUG] [LOCAL ] BUR: Loaded 45456 existing records from primary storage. [2025-10-03T17:48:26.983350] [INFO ] [MAIN ] BUR: Loaded 45456 existing records. [2025-10-03T17:48:27.196679] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-03T17:48:27.203375] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:27.204614] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-03T17:48:27.204707] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-03T17:48:27.205209] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-03T17:48:27.205271] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-03T17:48:27.383539] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T17:48:27.412444] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T17:48:27.510479] [INFO ] [REMOTE ] BTU: Full fetch complete (76996 records). [2025-10-03T17:48:27.529470] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-03T17:48:27.764725] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:27.995800] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-03T17:48:28.072389] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-03T17:48:28.072526] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-03T17:48:28.073452] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-03T17:48:28.073520] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-03T17:48:28.075154] [DEBUG] [LOCAL ] BTU: Trimmed 76996 records to 54088 (keeping 200 days of data) [2025-10-03T17:48:28.422334] [DEBUG] [LOCAL ] BTU: Primary data saved (54088 records). [2025-10-03T17:48:28.422482] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-03T17:48:28.422560] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 36.6s. Estimated remaining: 4h 34m 43s. Rate: 7.3 symbols/min [2025-10-03T17:48:28.601936] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:28.648372] [DEBUG] [LOCAL ] BURL: Loaded 46323 existing records from primary storage. [2025-10-03T17:48:28.648725] [INFO ] [MAIN ] BURL: Loaded 46323 existing records. [2025-10-03T17:48:28.795971] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-03T17:48:28.865168] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:28.865429] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-03T17:48:28.865483] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-03T17:48:28.865800] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-03T17:48:28.865862] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-03T17:48:28.998689] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:48:29.275859] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:29.310270] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T17:48:29.590743] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-03T17:48:30.390639] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-03T17:48:30.416450] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:48:30.915901] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T17:48:31.190740] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-03T17:48:31.253136] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T17:48:31.990739] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-03T17:48:32.427605] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T17:48:32.790739] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-03T17:48:33.556724] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:48:33.590697] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-03T17:48:34.300866] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:48:34.390730] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-03T17:48:35.190689] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-03T17:48:35.990669] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-03T17:48:36.033472] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-03T17:48:36.102565] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T17:48:36.132858] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:48:36.790702] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-03T17:48:37.600228] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-03T17:48:37.607004] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:48:37.993305] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T17:48:38.390724] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-03T17:48:38.656841] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T17:48:39.190692] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-03T17:48:39.990676] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-03T17:48:40.043790] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-03T17:48:40.192918] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T17:48:40.790723] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-03T17:48:41.590639] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-03T17:48:41.923339] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T17:48:42.390720] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-03T17:48:42.748724] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:48:42.973048] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:48:42.975752] [INFO ] [REMOTE ] BUD: Full fetch complete (76475 records). [2025-10-03T17:48:42.975874] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-03T17:48:43.192323] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-03T17:48:43.318856] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T17:48:43.425021] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-03T17:48:43.425112] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-03T17:48:43.425938] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-03T17:48:43.426007] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-03T17:48:43.427539] [DEBUG] [LOCAL ] BUD: Trimmed 76475 records to 53478 (keeping 200 days of data) [2025-10-03T17:48:43.779849] [DEBUG] [LOCAL ] BUD: Primary data saved (53478 records). [2025-10-03T17:48:43.780060] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-03T17:48:43.780179] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BUD took 44.8s. Estimated remaining: 4h 35m 15s. Rate: 7.3 symbols/min [2025-10-03T17:48:43.978395] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:48:43.994925] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-03T17:48:43.995358] [DEBUG] [LOCAL ] BUXX: Loaded 15276 existing records from primary storage. [2025-10-03T17:48:43.996367] [INFO ] [MAIN ] BUXX: Loaded 15276 existing records. [2025-10-03T17:48:44.195148] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:48:44.195389] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-03T17:48:44.195440] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-03T17:48:44.195758] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-10-03T17:48:44.195819] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-03T17:48:44.590300] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:48:44.790639] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-03T17:48:44.956917] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:48:45.023460] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T17:48:45.590692] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-03T17:48:46.390789] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-03T17:48:46.434263] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:48:46.516947] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:48:46.954591] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T17:48:47.190715] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-03T17:48:47.990701] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-03T17:48:48.790737] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-03T17:48:48.959495] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T17:48:49.590736] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-03T17:48:49.684432] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T17:48:49.791630] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T17:48:50.390742] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-03T17:48:51.195797] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-03T17:48:51.218965] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T17:48:51.990679] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-03T17:48:52.013512] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:48:52.014778] [INFO ] [REMOTE ] BUI: Full fetch complete (16438 records). [2025-10-03T17:48:52.014853] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-03T17:48:52.429609] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-03T17:48:52.429723] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-03T17:48:52.430091] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-03T17:48:52.430153] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-03T17:48:52.430721] [DEBUG] [LOCAL ] BUI: Trimmed 16438 records to 11813 (keeping 200 days of data) [2025-10-03T17:48:52.512201] [DEBUG] [LOCAL ] BUI: Primary data saved (11813 records). [2025-10-03T17:48:52.512341] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-03T17:48:52.512432] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BUI took 27.0s. Estimated remaining: 4h 35m 10s. Rate: 7.3 symbols/min [2025-10-03T17:48:52.648499] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-03T17:48:52.790686] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-03T17:48:53.599469] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-03T17:48:53.605806] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T17:48:54.367448] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T17:48:54.390709] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-03T17:48:54.438004] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T17:48:55.132342] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:48:55.190679] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-03T17:48:55.980390] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:48:55.990618] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-03T17:48:56.790634] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-03T17:48:57.085341] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T17:48:57.590681] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-03T17:48:58.390683] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-03T17:48:58.467409] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T17:48:58.632072] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T17:48:59.190704] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-03T17:48:59.731786] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T17:48:59.734042] [INFO ] [REMOTE ] BUR: Full fetch complete (63475 records). [2025-10-03T17:48:59.734138] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-03T17:48:59.998441] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-03T17:49:00.149264] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-03T17:49:00.149380] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-03T17:49:00.150204] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-03T17:49:00.150294] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-03T17:49:00.161629] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T17:49:00.166923] [DEBUG] [LOCAL ] BUR: Trimmed 63475 records to 45747 (keeping 200 days of data) [2025-10-03T17:49:00.456938] [DEBUG] [LOCAL ] BUR: Primary data saved (45747 records). [2025-10-03T17:49:00.457078] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-03T17:49:00.458455] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUR took 33.7s. Estimated remaining: 4h 35m 0s. Rate: 7.3 symbols/min [2025-10-03T17:49:00.790716] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-03T17:49:01.713922] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T17:49:01.718624] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-03T17:49:01.804778] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:49:02.390723] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-03T17:49:02.570082] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T17:49:03.190743] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-03T17:49:03.769108] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:49:03.772316] [INFO ] [REMOTE ] BURL: Full fetch complete (65640 records). [2025-10-03T17:49:03.772489] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-03T17:49:04.229456] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-03T17:49:04.234354] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-03T17:49:04.235466] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-03T17:49:04.235597] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-03T17:49:04.237204] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:49:04.241587] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-03T17:49:04.243132] [DEBUG] [LOCAL ] BURL: Trimmed 65640 records to 46622 (keeping 200 days of data) [2025-10-03T17:49:04.542996] [DEBUG] [LOCAL ] BURL: Primary data saved (46622 records). [2025-10-03T17:49:04.543146] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-03T17:49:04.543235] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BURL took 36.1s. Estimated remaining: 4h 34m 29s. Rate: 7.3 symbols/min [2025-10-03T17:49:05.219107] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T17:49:05.220275] [INFO ] [REMOTE ] BUXX: Full fetch complete (20359 records). [2025-10-03T17:49:05.220350] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-03T17:49:05.643397] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-03T17:49:05.643492] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-03T17:49:05.643919] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-03T17:49:05.644027] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-03T17:49:05.644824] [DEBUG] [LOCAL ] BUXX: Trimmed 20359 records to 15366 (keeping 200 days of data) [2025-10-03T17:49:05.749725] [DEBUG] [LOCAL ] BUXX: Primary data saved (15366 records). [2025-10-03T17:49:05.749880] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-03T17:49:05.749976] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUXX took 22.0s. Estimated remaining: 4h 33m 42s. Rate: 7.3 symbols/min [2025-10-03T17:49:06.431349] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.574089] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.550958] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.579396] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:06.698253] [DEBUG] [LOCAL ] BV: Loaded 38582 existing records from primary storage. [2025-10-03T17:49:06.701485] [DEBUG] [LOCAL ] BWA: Loaded 52569 existing records from primary storage. [2025-10-03T17:49:06.701724] [INFO ] [MAIN ] BV: Loaded 38582 existing records. [2025-10-03T17:49:06.700514] [DEBUG] [LOCAL ] BW: Loaded 40202 existing records from primary storage. [2025-10-03T17:49:06.713690] [INFO ] [MAIN ] BW: Loaded 40202 existing records. [2025-10-03T17:49:06.719942] [INFO ] [MAIN ] BWA: Loaded 52569 existing records. [2025-10-03T17:49:06.874010] [DEBUG] [LOCAL ] BVN: Loaded 44365 existing records from primary storage. [2025-10-03T17:49:07.052517] [INFO ] [MAIN ] BVN: Loaded 44365 existing records. [2025-10-03T17:49:07.366245] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.326756] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.424182] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.413749] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.429580] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-03T17:49:07.444350] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.429509] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-03T17:49:07.450199] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-10-03T17:49:07.471099] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-03T17:49:07.455545] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.476463] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-03T17:49:07.507828] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-03T17:49:07.549828] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-03T17:49:07.573866] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-03T17:49:07.590812] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-03T17:49:07.685837] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:07.708127] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-03T17:49:07.774297] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-03T17:49:07.936868] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-03T17:49:08.083298] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-03T17:49:08.742692] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:08.804902] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-03T17:49:08.837679] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:08.921431] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-03T17:49:09.117493] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:09.123475] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-03T17:49:09.203439] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:09.203798] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-03T17:49:10.305925] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T17:49:10.313378] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-03T17:49:10.661732] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:49:10.672433] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-03T17:49:10.701825] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T17:49:10.713164] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-03T17:49:10.747259] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T17:49:10.758632] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-03T17:49:11.544076] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T17:49:11.550886] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-03T17:49:12.230046] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:49:12.239540] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-03T17:49:12.268949] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T17:49:12.346729] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T17:49:12.790630] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-03T17:49:12.954521] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:49:13.590675] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-03T17:49:13.810939] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T17:49:14.390673] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-03T17:49:14.433150] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:49:15.051553] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T17:49:15.190721] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-03T17:49:15.869709] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:49:15.990729] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-03T17:49:16.586833] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T17:49:16.790775] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-03T17:49:17.401232] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T17:49:17.590693] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-03T17:49:18.390674] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-03T17:49:18.458089] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T17:49:19.190686] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-03T17:49:19.431243] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:49:19.867910] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T17:49:19.990747] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-03T17:49:20.731965] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T17:49:20.790716] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-03T17:49:21.590713] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-03T17:49:21.952625] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T17:49:22.022739] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T17:49:22.390690] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-03T17:49:23.190709] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-03T17:49:23.794371] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-03T17:49:23.829506] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:49:23.990694] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-03T17:49:24.614255] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T17:49:24.790711] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-03T17:49:25.117441] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T17:49:25.590747] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-03T17:49:26.383296] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T17:49:26.391366] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-03T17:49:27.051953] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T17:49:27.190721] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-03T17:49:27.990699] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-03T17:49:28.169733] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T17:49:28.641587] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:49:28.790737] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-03T17:49:29.209417] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:49:29.590728] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-03T17:49:30.037754] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T17:49:30.040112] [INFO ] [REMOTE ] BV: Full fetch complete (54247 records). [2025-10-03T17:49:30.040223] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-03T17:49:30.404192] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-03T17:49:30.470972] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-03T17:49:30.471107] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-03T17:49:30.471781] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-03T17:49:30.471847] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-03T17:49:30.473251] [DEBUG] [LOCAL ] BV: Trimmed 54247 records to 38880 (keeping 200 days of data) [2025-10-03T17:49:30.711150] [DEBUG] [LOCAL ] BV: Primary data saved (38880 records). [2025-10-03T17:49:30.711311] [INFO ] [MAIN ] BV: Full history saved. [2025-10-03T17:49:30.711434] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BV took 25.0s. Estimated remaining: 4h 35m 7s. Rate: 7.3 symbols/min [2025-10-03T17:49:30.900944] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:30.916355] [DEBUG] [LOCAL ] BWG: Loaded 12660 existing records from primary storage. [2025-10-03T17:49:30.916590] [INFO ] [MAIN ] BWG: Loaded 12660 existing records. [2025-10-03T17:49:31.109564] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:31.109913] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-03T17:49:31.109985] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-03T17:49:31.110222] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-03T17:49:31.110294] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-03T17:49:31.202272] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-03T17:49:31.214917] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T17:49:31.528795] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:31.990626] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-03T17:49:32.101468] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T17:49:32.743677] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T17:49:32.790627] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-03T17:49:33.488718] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T17:49:33.590692] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-03T17:49:34.107949] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:49:34.390727] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-03T17:49:34.601524] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T17:49:35.190695] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-03T17:49:35.990635] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-03T17:49:36.139531] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T17:49:36.551054] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T17:49:36.553754] [INFO ] [REMOTE ] BVN: Full fetch complete (62892 records). [2025-10-03T17:49:36.553930] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-03T17:49:36.799624] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-03T17:49:36.983414] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-03T17:49:36.983547] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-03T17:49:36.984723] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-03T17:49:36.984796] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-03T17:49:36.986871] [DEBUG] [LOCAL ] BVN: Trimmed 62892 records to 44704 (keeping 200 days of data) [2025-10-03T17:49:37.264979] [DEBUG] [LOCAL ] BVN: Primary data saved (44704 records). [2025-10-03T17:49:37.265177] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-03T17:49:37.265325] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BVN took 31.5s. Estimated remaining: 4h 34m 50s. Rate: 7.3 symbols/min [2025-10-03T17:49:37.457610] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:37.491775] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:49:37.538668] [DEBUG] [LOCAL ] BWLP: Loaded 32667 existing records from primary storage. [2025-10-03T17:49:37.539119] [INFO ] [MAIN ] BWLP: Loaded 32667 existing records. [2025-10-03T17:49:37.595887] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-03T17:49:37.763862] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:37.764280] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-03T17:49:37.764351] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-03T17:49:37.764860] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-03T17:49:37.764940] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-03T17:49:38.183476] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:38.390725] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-03T17:49:38.575759] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T17:49:38.600299] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T17:49:39.190712] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-03T17:49:39.853133] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T17:49:39.934703] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:49:39.990730] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-03T17:49:40.790746] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-03T17:49:41.592628] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-03T17:49:41.596448] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-03T17:49:41.707383] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:49:42.390692] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-03T17:49:43.058833] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T17:49:43.190713] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-03T17:49:43.990630] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-03T17:49:44.103869] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T17:49:44.538254] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T17:49:44.790705] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-03T17:49:44.865079] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T17:49:45.590706] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-03T17:49:46.163709] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T17:49:46.390706] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-03T17:49:47.189117] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T17:49:47.191098] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-03T17:49:47.192688] [INFO ] [REMOTE ] BWA: Full fetch complete (75720 records). [2025-10-03T17:49:47.192776] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-03T17:49:47.635606] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-03T17:49:47.635755] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-03T17:49:47.636810] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-03T17:49:47.636938] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-03T17:49:47.638730] [DEBUG] [LOCAL ] BWA: Trimmed 75720 records to 52955 (keeping 200 days of data) [2025-10-03T17:49:47.785746] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T17:49:48.013288] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-03T17:49:48.063688] [DEBUG] [LOCAL ] BWA: Primary data saved (52955 records). [2025-10-03T17:49:48.063929] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-03T17:49:48.064053] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BWA took 42.3s. Estimated remaining: 4h 34m 56s. Rate: 7.3 symbols/min [2025-10-03T17:49:48.250268] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:48.260256] [DEBUG] [LOCAL ] BWMX: Loaded 7725 existing records from primary storage. [2025-10-03T17:49:48.260500] [INFO ] [MAIN ] BWMX: Loaded 7725 existing records. [2025-10-03T17:49:48.449188] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:48.449442] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-03T17:49:48.449496] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-03T17:49:48.449709] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-03T17:49:48.449771] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-03T17:49:48.797758] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-03T17:49:48.833568] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:48.897939] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:49:48.902923] [INFO ] [REMOTE ] BW: Full fetch complete (58840 records). [2025-10-03T17:49:48.903066] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-03T17:49:49.027798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T17:49:49.337968] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-03T17:49:49.338072] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-03T17:49:49.338829] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-03T17:49:49.338913] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-03T17:49:49.340323] [DEBUG] [LOCAL ] BW: Trimmed 58840 records to 40559 (keeping 200 days of data) [2025-10-03T17:49:49.577432] [DEBUG] [LOCAL ] BW: Primary data saved (40559 records). [2025-10-03T17:49:49.577560] [INFO ] [MAIN ] BW: Full history saved. [2025-10-03T17:49:49.577665] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BW took 43.8s. Estimated remaining: 4h 34m 10s. Rate: 7.3 symbols/min [2025-10-03T17:49:49.600389] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-03T17:49:49.763075] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:49:49.770758] [DEBUG] [LOCAL ] BWNB: Loaded 4466 existing records from primary storage. [2025-10-03T17:49:49.770983] [INFO ] [MAIN ] BWNB: Loaded 4466 existing records. [2025-10-03T17:49:49.976271] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:49:49.976762] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-03T17:49:49.976823] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-03T17:49:49.977070] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-03T17:49:49.977130] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-03T17:49:50.361354] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:49:50.383213] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T17:49:50.390769] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-03T17:49:50.472568] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T17:49:50.902160] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-03T17:49:51.190659] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-03T17:49:51.671271] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T17:49:51.990692] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-03T17:49:52.790673] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-03T17:49:52.914952] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T17:49:53.590683] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-03T17:49:53.653072] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:49:54.390721] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-03T17:49:54.928205] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T17:49:54.971490] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T17:49:55.190681] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-03T17:49:55.750027] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T17:49:55.990679] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-03T17:49:56.547211] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T17:49:56.790730] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-03T17:49:57.590680] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-03T17:49:57.733860] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T17:49:58.132093] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T17:49:58.390699] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-03T17:49:59.001226] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T17:49:59.190676] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-03T17:49:59.990633] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-03T17:50:00.085373] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T17:50:00.790697] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-03T17:50:01.590726] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-03T17:50:01.675121] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T17:50:01.805341] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T17:50:01.806797] [INFO ] [REMOTE ] BWG: Full fetch complete (17921 records). [2025-10-03T17:50:01.806878] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-03T17:50:02.161583] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T17:50:02.247443] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-03T17:50:02.247538] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-03T17:50:02.247917] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-03T17:50:02.247982] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-03T17:50:02.248734] [DEBUG] [LOCAL ] BWG: Trimmed 17921 records to 12694 (keeping 200 days of data) [2025-10-03T17:50:02.333679] [DEBUG] [LOCAL ] BWG: Primary data saved (12694 records). [2025-10-03T17:50:02.333873] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-03T17:50:02.333972] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BWG took 31.6s. Estimated remaining: 4h 34m 27s. Rate: 7.3 symbols/min [2025-10-03T17:50:02.395841] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-03T17:50:02.548728] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:02.558253] [DEBUG] [LOCAL ] BWSN: Loaded 5127 existing records from primary storage. [2025-10-03T17:50:02.558594] [INFO ] [MAIN ] BWSN: Loaded 5127 existing records. [2025-10-03T17:50:02.794251] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:02.794511] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-03T17:50:02.794592] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-03T17:50:02.794950] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-03T17:50:02.795035] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-03T17:50:03.125678] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:50:03.201621] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-03T17:50:03.208630] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:03.770087] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:50:03.990751] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-03T17:50:04.579758] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T17:50:04.790725] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-03T17:50:05.407525] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T17:50:05.590739] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-03T17:50:06.390702] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-03T17:50:06.820719] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T17:50:07.057949] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T17:50:07.190727] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-03T17:50:07.788562] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T17:50:07.990739] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-03T17:50:08.547637] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T17:50:08.790703] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-03T17:50:09.224816] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T17:50:09.590698] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-03T17:50:10.130784] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T17:50:10.390754] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-03T17:50:11.190695] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-03T17:50:11.952073] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:50:11.954339] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T17:50:11.962337] [INFO ] [REMOTE ] BWNB: Full fetch complete (5722 records). [2025-10-03T17:50:11.962881] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-03T17:50:11.997722] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-03T17:50:12.397281] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-03T17:50:12.397365] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-03T17:50:12.397553] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-03T17:50:12.397596] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-03T17:50:12.398169] [DEBUG] [LOCAL ] BWNB: Trimmed 5722 records to 4475 (keeping 200 days of data) [2025-10-03T17:50:12.427756] [DEBUG] [LOCAL ] BWNB: Primary data saved (4475 records). [2025-10-03T17:50:12.427900] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-03T17:50:12.427988] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWNB took 22.9s. Estimated remaining: 4h 34m 29s. Rate: 7.3 symbols/min [2025-10-03T17:50:12.617308] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:12.663026] [DEBUG] [LOCAL ] BWXT: Loaded 47232 existing records from primary storage. [2025-10-03T17:50:12.663352] [INFO ] [MAIN ] BWXT: Loaded 47232 existing records. [2025-10-03T17:50:12.779173] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T17:50:12.791989] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-03T17:50:12.865254] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:12.865439] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-03T17:50:12.865488] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-03T17:50:12.865789] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-03T17:50:12.865849] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-03T17:50:13.265164] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:13.590631] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-03T17:50:13.672820] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T17:50:14.314761] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T17:50:14.390743] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-03T17:50:15.190748] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-03T17:50:15.527184] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:50:15.529217] [INFO ] [REMOTE ] BWLP: Full fetch complete (48133 records). [2025-10-03T17:50:15.529315] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-03T17:50:15.947915] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-03T17:50:15.948007] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-03T17:50:15.948787] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-03T17:50:15.948859] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-03T17:50:15.951730] [DEBUG] [LOCAL ] BWLP: Trimmed 48133 records to 32876 (keeping 200 days of data) [2025-10-03T17:50:16.005786] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-03T17:50:16.163799] [DEBUG] [LOCAL ] BWLP: Primary data saved (32876 records). [2025-10-03T17:50:16.163957] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-03T17:50:16.165721] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWLP took 38.9s. Estimated remaining: 4h 33m 57s. Rate: 7.3 symbols/min [2025-10-03T17:50:16.351236] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:16.411940] [DEBUG] [LOCAL ] BX: Loaded 53877 existing records from primary storage. [2025-10-03T17:50:16.412292] [INFO ] [MAIN ] BX: Loaded 53877 existing records. [2025-10-03T17:50:16.602049] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:16.602268] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-03T17:50:16.602321] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-03T17:50:16.602594] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-03T17:50:16.602683] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-03T17:50:16.791819] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-03T17:50:16.945992] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T17:50:17.020295] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:17.126065] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T17:50:17.590754] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-03T17:50:17.599080] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T17:50:18.390711] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-03T17:50:19.190637] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-03T17:50:19.406688] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T17:50:19.973437] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T17:50:19.990699] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-03T17:50:20.790743] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-03T17:50:20.982690] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-03T17:50:21.590631] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-03T17:50:21.645030] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:50:21.673174] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T17:50:22.390719] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-03T17:50:22.723753] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T17:50:23.190727] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-03T17:50:23.990695] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-03T17:50:24.166830] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:50:24.790732] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-03T17:50:24.880570] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T17:50:25.105532] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T17:50:25.590750] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-03T17:50:26.223241] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T17:50:26.390456] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T17:50:26.390625] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-03T17:50:27.064922] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T17:50:27.190716] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-03T17:50:27.720448] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:50:27.990737] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-03T17:50:28.790741] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-03T17:50:29.590674] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-03T17:50:29.929371] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:50:30.150443] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T17:50:30.151620] [INFO ] [REMOTE ] BWMX: Full fetch complete (10053 records). [2025-10-03T17:50:30.151749] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-03T17:50:30.401569] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-03T17:50:30.609803] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-03T17:50:30.610013] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-03T17:50:30.610323] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-03T17:50:30.610399] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-03T17:50:30.637457] [DEBUG] [LOCAL ] BWMX: Trimmed 10053 records to 7749 (keeping 200 days of data) [2025-10-03T17:50:30.644283] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:50:30.705213] [DEBUG] [LOCAL ] BWMX: Primary data saved (7749 records). [2025-10-03T17:50:30.705360] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-03T17:50:30.705494] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWMX took 42.6s. Estimated remaining: 4h 34m 23s. Rate: 7.3 symbols/min [2025-10-03T17:50:30.894972] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:30.910451] [DEBUG] [LOCAL ] BXC: Loaded 13732 existing records from primary storage. [2025-10-03T17:50:30.910747] [INFO ] [MAIN ] BXC: Loaded 13732 existing records. [2025-10-03T17:50:31.120721] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:31.120995] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-03T17:50:31.121056] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-03T17:50:31.121234] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-03T17:50:31.121292] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-03T17:50:31.195874] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-03T17:50:31.548720] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:31.990638] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-03T17:50:32.477484] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T17:50:32.790731] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-03T17:50:32.847744] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T17:50:33.195383] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T17:50:33.196873] [INFO ] [REMOTE ] BWSN: Full fetch complete (6300 records). [2025-10-03T17:50:33.197001] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-03T17:50:33.591995] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-03T17:50:33.693249] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-03T17:50:33.693373] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-03T17:50:33.693766] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-03T17:50:33.693906] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-03T17:50:33.694773] [DEBUG] [LOCAL ] BWSN: Trimmed 6300 records to 5290 (keeping 200 days of data) [2025-10-03T17:50:33.734089] [DEBUG] [LOCAL ] BWSN: Primary data saved (5290 records). [2025-10-03T17:50:33.734263] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-03T17:50:33.734470] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWSN took 31.4s. Estimated remaining: 4h 33m 47s. Rate: 7.3 symbols/min [2025-10-03T17:50:33.947858] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-10-03T17:50:33.967264] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:34.025771] [DEBUG] [LOCAL ] BXMT: Loaded 47578 existing records from primary storage. [2025-10-03T17:50:34.026137] [INFO ] [MAIN ] BXMT: Loaded 47578 existing records. [2025-10-03T17:50:34.223036] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:34.223268] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-03T17:50:34.223318] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-03T17:50:34.223634] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-03T17:50:34.223751] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-03T17:50:34.395056] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-03T17:50:34.564912] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T17:50:34.651118] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:35.190704] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-03T17:50:35.977411] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T17:50:35.990627] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-03T17:50:36.296516] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T17:50:36.790706] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-03T17:50:36.854912] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T17:50:37.590730] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-03T17:50:38.390723] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-03T17:50:38.622338] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T17:50:38.675412] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:50:39.190719] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-03T17:50:39.990714] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-03T17:50:40.511200] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T17:50:40.790781] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-03T17:50:40.949430] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T17:50:41.068944] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T17:50:41.590793] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-03T17:50:42.390681] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-03T17:50:42.474582] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T17:50:42.657005] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T17:50:43.190714] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-03T17:50:43.990765] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-03T17:50:44.116119] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T17:50:44.790675] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-03T17:50:44.873102] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T17:50:44.876059] [INFO ] [REMOTE ] BWXT: Full fetch complete (67557 records). [2025-10-03T17:50:44.876183] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-03T17:50:45.237038] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T17:50:45.314399] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-03T17:50:45.314522] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-03T17:50:45.315449] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-03T17:50:45.315523] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-03T17:50:45.317512] [DEBUG] [LOCAL ] BWXT: Trimmed 67557 records to 47600 (keeping 200 days of data) [2025-10-03T17:50:45.590706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-03T17:50:45.660737] [DEBUG] [LOCAL ] BWXT: Primary data saved (47600 records). [2025-10-03T17:50:45.660929] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-03T17:50:45.661049] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BWXT took 33.2s. Estimated remaining: 4h 33m 58s. Rate: 7.3 symbols/min [2025-10-03T17:50:45.844701] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:45.867834] [DEBUG] [LOCAL ] BXMX: Loaded 19738 existing records from primary storage. [2025-10-03T17:50:45.868168] [INFO ] [MAIN ] BXMX: Loaded 19738 existing records. [2025-10-03T17:50:46.064770] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:46.065553] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-03T17:50:46.065617] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-03T17:50:46.066138] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-03T17:50:46.066202] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-03T17:50:46.390956] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-03T17:50:46.463598] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:46.499837] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T17:50:47.190748] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-03T17:50:47.374547] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:50:47.740326] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T17:50:47.990714] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-03T17:50:48.470719] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T17:50:48.790720] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-03T17:50:48.820609] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T17:50:49.590694] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-03T17:50:50.390721] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-03T17:50:50.869771] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T17:50:50.915179] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:50:51.190700] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-03T17:50:51.366750] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T17:50:51.990704] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-03T17:50:52.722093] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T17:50:52.723211] [INFO ] [REMOTE ] BXC: Full fetch complete (17952 records). [2025-10-03T17:50:52.723305] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-03T17:50:52.792758] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-03T17:50:53.036399] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T17:50:53.195537] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-03T17:50:53.195627] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-03T17:50:53.196051] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-03T17:50:53.196114] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-03T17:50:53.196721] [DEBUG] [LOCAL ] BXC: Trimmed 17952 records to 13793 (keeping 200 days of data) [2025-10-03T17:50:53.277635] [DEBUG] [LOCAL ] BXC: Primary data saved (13793 records). [2025-10-03T17:50:53.277811] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-03T17:50:53.277930] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BXC took 22.6s. Estimated remaining: 4h 33m 47s. Rate: 7.3 symbols/min [2025-10-03T17:50:53.458255] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:50:53.516368] [DEBUG] [LOCAL ] BXP: Loaded 50225 existing records from primary storage. [2025-10-03T17:50:53.516774] [INFO ] [MAIN ] BXP: Loaded 50225 existing records. [2025-10-03T17:50:53.597130] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-03T17:50:53.730735] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:50:53.731149] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-03T17:50:53.731218] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-03T17:50:53.731506] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-03T17:50:53.731564] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-03T17:50:54.119978] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:50:54.390712] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-03T17:50:54.719988] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T17:50:54.869042] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T17:50:55.190693] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-03T17:50:55.990633] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-03T17:50:56.143219] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:50:56.790692] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-03T17:50:56.954476] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T17:50:57.590698] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-03T17:50:58.095966] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T17:50:58.143869] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T17:50:58.390718] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-03T17:50:59.192981] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-03T17:50:59.199258] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:50:59.985829] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:50:59.996040] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-03T17:51:00.486759] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T17:51:00.790633] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-03T17:51:01.570192] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T17:51:01.590711] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-03T17:51:01.787235] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:51:02.390729] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-03T17:51:03.190677] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-03T17:51:03.322870] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T17:51:03.419405] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:51:03.990710] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-03T17:51:04.790709] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-03T17:51:04.820546] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:51:04.823998] [INFO ] [REMOTE ] BX: Full fetch complete (77408 records). [2025-10-03T17:51:04.824158] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-03T17:51:05.259308] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-03T17:51:05.259400] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-03T17:51:05.260225] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-03T17:51:05.260296] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-03T17:51:05.261954] [DEBUG] [LOCAL ] BX: Trimmed 77408 records to 54266 (keeping 200 days of data) [2025-10-03T17:51:05.607104] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-03T17:51:05.643204] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T17:51:05.682743] [DEBUG] [LOCAL ] BX: Primary data saved (54266 records). [2025-10-03T17:51:05.682911] [INFO ] [MAIN ] BX: Full history saved. [2025-10-03T17:51:05.683798] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BX took 49.5s. Estimated remaining: 4h 34m 1s. Rate: 7.3 symbols/min [2025-10-03T17:51:05.833900] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:51:05.889959] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:05.953107] [DEBUG] [LOCAL ] BXSL: Loaded 48025 existing records from primary storage. [2025-10-03T17:51:05.953457] [INFO ] [MAIN ] BXSL: Loaded 48025 existing records. [2025-10-03T17:51:06.147318] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:06.147619] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-03T17:51:06.147706] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-03T17:51:06.148012] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-03T17:51:06.148085] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-03T17:51:06.397898] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-03T17:51:06.543475] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:07.190703] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-03T17:51:07.539014] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T17:51:07.990706] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-03T17:51:08.118958] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:51:08.410028] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T17:51:08.790723] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-03T17:51:09.590729] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-03T17:51:09.726740] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:51:10.390689] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-03T17:51:10.542200] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:51:11.190710] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-03T17:51:11.203518] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T17:51:11.206123] [INFO ] [REMOTE ] BXMT: Full fetch complete (69673 records). [2025-10-03T17:51:11.206333] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-03T17:51:11.639573] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-03T17:51:11.639692] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-03T17:51:11.640546] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-03T17:51:11.640622] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-03T17:51:11.642312] [DEBUG] [LOCAL ] BXMT: Trimmed 69673 records to 47953 (keeping 200 days of data) [2025-10-03T17:51:11.955820] [DEBUG] [LOCAL ] BXMT: Primary data saved (47953 records). [2025-10-03T17:51:11.955972] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-03T17:51:11.957380] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BXMT took 38.2s. Estimated remaining: 4h 33m 43s. Rate: 7.3 symbols/min [2025-10-03T17:51:11.995568] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-03T17:51:12.160200] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:12.194213] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:51:12.223295] [DEBUG] [LOCAL ] BY: Loaded 21841 existing records from primary storage. [2025-10-03T17:51:12.223573] [INFO ] [MAIN ] BY: Loaded 21841 existing records. [2025-10-03T17:51:12.347384] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T17:51:12.433372] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:12.433665] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-03T17:51:12.433730] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-03T17:51:12.433979] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-03T17:51:12.434038] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-03T17:51:12.795847] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-03T17:51:12.836270] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:13.590671] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-03T17:51:13.763056] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:51:13.838258] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T17:51:14.390702] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-03T17:51:15.188379] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T17:51:15.192442] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-03T17:51:15.316801] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:51:15.318397] [INFO ] [REMOTE ] BXMX: Full fetch complete (29077 records). [2025-10-03T17:51:15.318476] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-03T17:51:15.717230] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-03T17:51:15.717314] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-03T17:51:15.717780] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-03T17:51:15.717847] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-03T17:51:15.719186] [DEBUG] [LOCAL ] BXMX: Trimmed 29077 records to 19909 (keeping 200 days of data) [2025-10-03T17:51:15.846134] [DEBUG] [LOCAL ] BXMX: Primary data saved (19909 records). [2025-10-03T17:51:15.846286] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-03T17:51:15.846407] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXMX took 30.2s. Estimated remaining: 4h 33m 11s. Rate: 7.3 symbols/min [2025-10-03T17:51:16.005481] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-03T17:51:16.043783] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:16.093591] [DEBUG] [LOCAL ] BYD: Loaded 45277 existing records from primary storage. [2025-10-03T17:51:16.093973] [INFO ] [MAIN ] BYD: Loaded 45277 existing records. [2025-10-03T17:51:16.311089] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:16.311322] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-03T17:51:16.311383] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-03T17:51:16.311704] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-03T17:51:16.311767] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-03T17:51:16.715233] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:16.790699] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-03T17:51:16.891403] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T17:51:17.448699] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:51:17.590696] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-03T17:51:18.390682] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-03T17:51:18.496743] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T17:51:18.937201] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:51:19.190738] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-03T17:51:19.990637] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-03T17:51:20.098045] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T17:51:20.442477] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T17:51:20.790637] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-03T17:51:21.111400] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T17:51:21.590728] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-03T17:51:22.390717] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-03T17:51:22.396110] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T17:51:23.190753] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-03T17:51:23.263358] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T17:51:23.463030] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T17:51:23.990776] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-03T17:51:24.800862] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-03T17:51:24.807735] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T17:51:24.830104] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:51:25.590705] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-03T17:51:26.390701] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-03T17:51:26.557360] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T17:51:26.638562] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T17:51:27.190716] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-03T17:51:27.990670] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-03T17:51:28.148027] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:51:28.150717] [INFO ] [REMOTE ] BXP: Full fetch complete (71614 records). [2025-10-03T17:51:28.150869] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-03T17:51:28.642831] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-03T17:51:28.643190] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-03T17:51:28.645639] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T17:51:28.644590] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-03T17:51:28.652512] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-03T17:51:28.655238] [DEBUG] [LOCAL ] BXP: Trimmed 71614 records to 50590 (keeping 200 days of data) [2025-10-03T17:51:28.790827] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-03T17:51:28.996395] [DEBUG] [LOCAL ] BXP: Primary data saved (50590 records). [2025-10-03T17:51:28.996564] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-03T17:51:28.996735] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXP took 35.7s. Estimated remaining: 4h 33m 29s. Rate: 7.3 symbols/min [2025-10-03T17:51:29.189698] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:29.189876] [DEBUG] [LOCAL ] BYM: No existing data file found in primary storage. [2025-10-03T17:51:29.189915] [WARN ] [MAIN ] BYM: No existing data found, performing full refresh instead. [2025-10-03T17:51:29.190082] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-03T17:51:29.190136] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-03T17:51:29.190181] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-03T17:51:29.190215] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-03T17:51:29.584540] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:29.590614] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-03T17:51:29.668352] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T17:51:29.932348] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T17:51:30.342436] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T17:51:30.390676] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-03T17:51:31.050012] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:51:31.190731] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-03T17:51:31.990769] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-03T17:51:32.744011] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T17:51:32.790668] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-03T17:51:33.590697] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-03T17:51:33.698944] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:51:33.989458] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T17:51:34.390760] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-03T17:51:34.865365] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T17:51:35.190712] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-03T17:51:35.990693] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-03T17:51:36.090913] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T17:51:36.474536] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T17:51:36.773200] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T17:51:36.790629] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-03T17:51:37.590768] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-03T17:51:37.765264] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:51:38.390768] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-03T17:51:39.189334] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-03T17:51:39.191669] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-03T17:51:39.476365] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T17:51:39.990725] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-03T17:51:40.693239] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:51:40.790707] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-03T17:51:40.861278] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T17:51:41.590773] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-03T17:51:42.381224] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T17:51:42.385288] [INFO ] [REMOTE ] BXSL: Full fetch complete (69490 records). [2025-10-03T17:51:42.385414] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-03T17:51:42.398133] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-03T17:51:42.579987] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T17:51:42.856231] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-03T17:51:42.856338] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-03T17:51:42.857733] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-03T17:51:42.857808] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-03T17:51:42.859477] [DEBUG] [LOCAL ] BXSL: Trimmed 69490 records to 48413 (keeping 200 days of data) [2025-10-03T17:51:43.173961] [DEBUG] [LOCAL ] BXSL: Primary data saved (48413 records). [2025-10-03T17:51:43.174143] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-03T17:51:43.174263] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 37.5s. Estimated remaining: 4h 33m 53s. Rate: 7.3 symbols/min [2025-10-03T17:51:43.197267] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-03T17:51:43.375598] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:43.412368] [DEBUG] [LOCAL ] BZH: Loaded 32621 existing records from primary storage. [2025-10-03T17:51:43.412816] [INFO ] [MAIN ] BZH: Loaded 32621 existing records. [2025-10-03T17:51:43.618590] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T17:51:43.702127] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:43.702368] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-03T17:51:43.702422] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-03T17:51:43.704375] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-03T17:51:43.704454] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-03T17:51:43.996244] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-03T17:51:44.092824] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:44.790711] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-03T17:51:45.134489] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:51:45.140039] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:51:45.151412] [INFO ] [REMOTE ] BY: Full fetch complete (29594 records). [2025-10-03T17:51:45.152328] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-03T17:51:45.543422] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-03T17:51:45.543560] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-03T17:51:45.544217] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-03T17:51:45.544287] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-03T17:51:45.545623] [DEBUG] [LOCAL ] BY: Trimmed 29594 records to 21972 (keeping 200 days of data) [2025-10-03T17:51:45.599751] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-03T17:51:45.692290] [DEBUG] [LOCAL ] BY: Primary data saved (21972 records). [2025-10-03T17:51:45.692481] [INFO ] [MAIN ] BY: Full history saved. [2025-10-03T17:51:45.692608] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 33.7s. Estimated remaining: 4h 33m 14s. Rate: 7.3 symbols/min [2025-10-03T17:51:45.874220] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:45.936931] [DEBUG] [LOCAL ] C: Loaded 54130 existing records from primary storage. [2025-10-03T17:51:45.937683] [INFO ] [MAIN ] C: Loaded 54130 existing records. [2025-10-03T17:51:46.132845] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:46.133370] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-03T17:51:46.133477] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-03T17:51:46.154074] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T17:51:46.160191] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-03T17:51:46.160977] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-03T17:51:46.393904] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-03T17:51:46.494271] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T17:51:46.559601] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:47.190776] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-03T17:51:47.990693] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-03T17:51:48.166966] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:51:48.790708] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-03T17:51:48.815023] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T17:51:48.855709] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T17:51:49.590709] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-03T17:51:49.821134] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T17:51:50.390691] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-03T17:51:50.411495] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T17:51:51.190753] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-03T17:51:51.990634] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-03T17:51:52.510447] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T17:51:52.702813] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T17:51:52.790766] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-03T17:51:53.470119] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:51:53.590673] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-03T17:51:54.390724] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-03T17:51:54.991164] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:51:55.045553] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-03T17:51:55.190697] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-03T17:51:55.526319] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T17:51:55.529404] [INFO ] [REMOTE ] BYD: Full fetch complete (65096 records). [2025-10-03T17:51:55.529591] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-03T17:51:55.976492] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-03T17:51:55.976585] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-03T17:51:55.977342] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-03T17:51:55.977432] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-03T17:51:55.979021] [DEBUG] [LOCAL ] BYD: Trimmed 65096 records to 45568 (keeping 200 days of data) [2025-10-03T17:51:56.034618] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-03T17:51:56.106853] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T17:51:56.277841] [DEBUG] [LOCAL ] BYD: Primary data saved (45568 records). [2025-10-03T17:51:56.278004] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-03T17:51:56.278109] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BYD took 40.4s. Estimated remaining: 4h 33m 18s. Rate: 7.3 symbols/min [2025-10-03T17:51:56.458943] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:51:56.480379] [DEBUG] [LOCAL ] CAAP: Loaded 20146 existing records from primary storage. [2025-10-03T17:51:56.480696] [INFO ] [MAIN ] CAAP: Loaded 20146 existing records. [2025-10-03T17:51:56.681119] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:51:56.681323] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-03T17:51:56.681371] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-03T17:51:56.681598] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-03T17:51:56.681697] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-03T17:51:56.790832] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-03T17:51:57.065223] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:51:57.584406] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T17:51:57.592252] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-03T17:51:58.390723] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-03T17:51:58.408017] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T17:51:58.743016] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T17:51:59.190737] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-03T17:51:59.542831] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T17:51:59.990718] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-03T17:52:00.562297] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:52:00.790701] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-03T17:52:01.005888] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T17:52:01.590735] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-03T17:52:02.390734] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-03T17:52:02.905170] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:52:03.052778] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-03T17:52:03.190663] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-03T17:52:03.201430] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T17:52:03.990701] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-03T17:52:04.790728] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-03T17:52:05.318522] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T17:52:05.481246] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-03T17:52:05.525625] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T17:52:05.590675] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-03T17:52:06.390711] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-03T17:52:06.658610] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T17:52:07.190727] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-03T17:52:07.990783] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-03T17:52:08.055232] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T17:52:08.056349] [INFO ] [REMOTE ] BYM: Full fetch complete (18044 records). [2025-10-03T17:52:08.056424] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-03T17:52:08.463910] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-03T17:52:08.464096] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-03T17:52:08.464482] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-03T17:52:08.464595] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-03T17:52:08.465746] [DEBUG] [LOCAL ] BYM: Trimmed 18044 records to 12190 (keeping 200 days of data) [2025-10-03T17:52:08.565181] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T17:52:08.598875] [DEBUG] [LOCAL ] BYM: Primary data saved (12190 records). [2025-10-03T17:52:08.599040] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-03T17:52:08.599140] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BYM took 39.6s. Estimated remaining: 4h 33m 32s. Rate: 7.3 symbols/min [2025-10-03T17:52:08.785851] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:08.790725] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-03T17:52:08.806857] [DEBUG] [LOCAL ] CABO: Loaded 17118 existing records from primary storage. [2025-10-03T17:52:08.807139] [INFO ] [MAIN ] CABO: Loaded 17118 existing records. [2025-10-03T17:52:09.014297] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:09.014575] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-03T17:52:09.014624] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-03T17:52:09.014943] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-03T17:52:09.015002] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-03T17:52:09.413597] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:09.493538] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T17:52:09.535539] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T17:52:09.590681] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-03T17:52:10.390675] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-03T17:52:10.992820] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T17:52:11.190706] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-03T17:52:11.281937] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T17:52:11.990717] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-03T17:52:12.781048] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T17:52:12.790613] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-03T17:52:13.415564] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-03T17:52:13.507495] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T17:52:13.590683] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-03T17:52:14.390705] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-03T17:52:14.611758] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T17:52:15.023187] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:52:15.190716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-03T17:52:15.990729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-03T17:52:16.158282] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T17:52:16.790711] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-03T17:52:17.590666] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-03T17:52:17.703739] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T17:52:18.350389] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T17:52:18.390692] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-03T17:52:18.626744] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T17:52:19.190736] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-03T17:52:19.521701] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T17:52:19.990721] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-03T17:52:20.740234] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T17:52:20.790758] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-03T17:52:21.345464] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T17:52:21.347488] [INFO ] [REMOTE ] BZH: Full fetch complete (46939 records). [2025-10-03T17:52:21.347625] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-03T17:52:21.595872] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-03T17:52:21.787913] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-03T17:52:21.788034] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-03T17:52:21.788839] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-03T17:52:21.788910] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-03T17:52:21.790354] [DEBUG] [LOCAL ] BZH: Trimmed 46939 records to 32801 (keeping 200 days of data) [2025-10-03T17:52:21.882604] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:52:21.885704] [INFO ] [REMOTE ] CAAP: Full fetch complete (27863 records). [2025-10-03T17:52:21.885825] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-03T17:52:22.338158] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-03T17:52:22.341459] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-03T17:52:22.342354] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-03T17:52:22.342442] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-03T17:52:22.348727] [DEBUG] [LOCAL ] CAAP: Trimmed 27863 records to 20340 (keeping 200 days of data) [2025-10-03T17:52:22.401396] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-03T17:52:22.527043] [DEBUG] [LOCAL ] BZH: Primary data saved (32801 records). [2025-10-03T17:52:22.528411] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-03T17:52:22.529055] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. BZH took 39.4s. Estimated remaining: 4h 33m 53s. Rate: 7.3 symbols/min [2025-10-03T17:52:22.736073] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:22.775856] [DEBUG] [LOCAL ] CACI: Loaded 24689 existing records from primary storage. [2025-10-03T17:52:22.776848] [INFO ] [MAIN ] CACI: Loaded 24689 existing records. [2025-10-03T17:52:22.776957] [DEBUG] [LOCAL ] CAAP: Primary data saved (20340 records). [2025-10-03T17:52:22.829364] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-03T17:52:22.847975] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. CAAP took 26.6s. Estimated remaining: 4h 33m 3s. Rate: 7.3 symbols/min [2025-10-03T17:52:23.092410] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:23.098028] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-03T17:52:23.098701] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-03T17:52:23.159143] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:52:23.154929] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-03T17:52:23.185893] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-03T17:52:23.195081] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-03T17:52:23.189706] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:23.570674] [DEBUG] [LOCAL ] CADE: Loaded 49221 existing records from primary storage. [2025-10-03T17:52:23.596630] [INFO ] [MAIN ] CADE: Loaded 49221 existing records. [2025-10-03T17:52:23.706576] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:23.830625] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:23.830934] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-03T17:52:23.830999] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-03T17:52:23.831300] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-03T17:52:23.831360] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-03T17:52:24.009327] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-03T17:52:24.234635] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:24.306941] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T17:52:24.536239] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T17:52:24.790690] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-03T17:52:25.245674] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T17:52:25.590729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-03T17:52:26.390698] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-03T17:52:26.560779] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T17:52:27.190691] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-03T17:52:27.229235] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:52:27.231892] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-03T17:52:27.232009] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-03T17:52:27.678129] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-03T17:52:27.678291] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-03T17:52:27.679350] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-03T17:52:27.679565] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-03T17:52:27.681326] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54520 (keeping 200 days of data) [2025-10-03T17:52:27.829559] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:52:28.014579] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-03T17:52:28.070826] [DEBUG] [LOCAL ] C: Primary data saved (54520 records). [2025-10-03T17:52:28.070961] [INFO ] [MAIN ] C: Full history saved. [2025-10-03T17:52:28.072312] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. C took 42.4s. Estimated remaining: 4h 32m 39s. Rate: 7.3 symbols/min [2025-10-03T17:52:28.256033] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:28.299873] [DEBUG] [LOCAL ] CAE: Loaded 39353 existing records from primary storage. [2025-10-03T17:52:28.300191] [INFO ] [MAIN ] CAE: Loaded 39353 existing records. [2025-10-03T17:52:28.506422] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:28.506879] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-03T17:52:28.506941] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-03T17:52:28.507465] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-03T17:52:28.507550] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-03T17:52:28.796892] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-03T17:52:28.935181] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:28.951444] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T17:52:28.989797] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:52:29.590734] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-03T17:52:30.011583] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:52:30.123104] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T17:52:30.390718] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-03T17:52:31.190750] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-03T17:52:31.924584] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T17:52:31.938476] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T17:52:31.939835] [INFO ] [REMOTE ] CABO: Full fetch complete (23128 records). [2025-10-03T17:52:31.939913] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-03T17:52:31.998783] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-03T17:52:32.368104] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-03T17:52:32.368200] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-03T17:52:32.368629] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-03T17:52:32.368734] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-03T17:52:32.369953] [DEBUG] [LOCAL ] CABO: Trimmed 23128 records to 17184 (keeping 200 days of data) [2025-10-03T17:52:32.484559] [DEBUG] [LOCAL ] CABO: Primary data saved (17184 records). [2025-10-03T17:52:32.484731] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-03T17:52:32.484850] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CABO took 23.9s. Estimated remaining: 4h 32m 11s. Rate: 7.3 symbols/min [2025-10-03T17:52:32.664088] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:32.670116] [DEBUG] [LOCAL ] CAF: Loaded 3421 existing records from primary storage. [2025-10-03T17:52:32.670286] [INFO ] [MAIN ] CAF: Loaded 3421 existing records. [2025-10-03T17:52:32.795754] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-03T17:52:32.867323] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:32.867585] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-03T17:52:32.867637] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-03T17:52:32.867877] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-03T17:52:32.867937] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-03T17:52:33.264538] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:33.590729] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-03T17:52:33.639526] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:52:34.397502] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-03T17:52:34.402779] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:52:34.822440] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T17:52:35.190700] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-03T17:52:35.310708] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T17:52:35.990707] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-03T17:52:36.716981] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T17:52:36.790687] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-03T17:52:37.590700] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-03T17:52:37.783441] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T17:52:37.842002] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:52:38.390699] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-03T17:52:38.669679] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:52:39.190708] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-03T17:52:39.990674] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-03T17:52:40.034665] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T17:52:40.580407] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T17:52:40.579307] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T17:52:40.790705] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-03T17:52:41.371521] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T17:52:41.590692] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-03T17:52:42.141340] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T17:52:42.390680] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-03T17:52:43.190627] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-03T17:52:43.429329] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:52:43.785824] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T17:52:43.990683] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-03T17:52:44.559216] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T17:52:44.790709] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-03T17:52:45.590698] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-03T17:52:45.928976] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T17:52:46.390683] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-03T17:52:47.015713] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T17:52:47.190692] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-03T17:52:47.226674] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T17:52:47.990691] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-03T17:52:48.142291] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T17:52:48.790683] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-03T17:52:49.590702] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-03T17:52:49.639771] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:52:49.874482] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T17:52:50.067498] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T17:52:50.390710] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-03T17:52:51.190679] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-03T17:52:51.239048] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:52:51.240477] [INFO ] [REMOTE ] CACI: Full fetch complete (38817 records). [2025-10-03T17:52:51.240578] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-03T17:52:51.639709] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-03T17:52:51.639812] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-03T17:52:51.640326] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-03T17:52:51.640371] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-03T17:52:51.641303] [DEBUG] [LOCAL ] CACI: Trimmed 38817 records to 24817 (keeping 200 days of data) [2025-10-03T17:52:51.790962] [DEBUG] [LOCAL ] CACI: Primary data saved (24817 records). [2025-10-03T17:52:51.791094] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-03T17:52:51.791179] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. CACI took 29.3s. Estimated remaining: 4h 33m 1s. Rate: 7.3 symbols/min [2025-10-03T17:52:51.965418] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:52:51.995786] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-03T17:52:52.019973] [DEBUG] [LOCAL ] CAG: Loaded 54053 existing records from primary storage. [2025-10-03T17:52:52.020322] [INFO ] [MAIN ] CAG: Loaded 54053 existing records. [2025-10-03T17:52:52.221513] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:52:52.221829] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-03T17:52:52.221882] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-03T17:52:52.222200] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-03T17:52:52.222300] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-03T17:52:52.706470] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:52:52.729972] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T17:52:52.790677] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-03T17:52:53.590685] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-03T17:52:53.854438] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T17:52:54.339310] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T17:52:54.390710] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-03T17:52:55.100730] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T17:52:55.190719] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-03T17:52:55.827398] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T17:52:55.990697] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-03T17:52:56.790711] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-03T17:52:56.834813] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:52:57.585613] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T17:52:57.594533] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-03T17:52:58.019544] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T17:52:58.390670] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-03T17:52:58.522994] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T17:52:59.190717] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-03T17:52:59.728746] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:52:59.990704] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-03T17:53:00.613829] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T17:53:00.790668] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-03T17:53:01.199595] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T17:53:01.590716] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-03T17:53:02.385131] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T17:53:02.393742] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-03T17:53:03.190625] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-03T17:53:03.299058] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:53:03.844441] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T17:53:03.847185] [INFO ] [REMOTE ] CADE: Full fetch complete (70013 records). [2025-10-03T17:53:03.847325] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-03T17:53:04.002665] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-03T17:53:04.274481] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-03T17:53:04.274603] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-03T17:53:04.275474] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-03T17:53:04.275535] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-03T17:53:04.277097] [DEBUG] [LOCAL ] CADE: Trimmed 70013 records to 49604 (keeping 200 days of data) [2025-10-03T17:53:04.387163] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T17:53:04.394581] [INFO ] [REMOTE ] CAE: Full fetch complete (56190 records). [2025-10-03T17:53:04.399161] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-03T17:53:04.800517] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-03T17:53:04.865002] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-03T17:53:04.865612] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-03T17:53:04.867018] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-03T17:53:04.867425] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-03T17:53:04.925486] [DEBUG] [LOCAL ] CAE: Trimmed 56190 records to 39676 (keeping 200 days of data) [2025-10-03T17:53:05.180405] [DEBUG] [LOCAL ] CADE: Primary data saved (49604 records). [2025-10-03T17:53:05.181180] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-03T17:53:05.181307] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CADE took 42.3s. Estimated remaining: 4h 33m 19s. Rate: 7.3 symbols/min [2025-10-03T17:53:05.475527] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:05.490797] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T17:53:05.497911] [INFO ] [REMOTE ] CAF: Full fetch complete (5597 records). [2025-10-03T17:53:05.503799] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-03T17:53:05.561931] [DEBUG] [LOCAL ] CAE: Primary data saved (39676 records). [2025-10-03T17:53:05.584716] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-03T17:53:05.603099] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CAE took 37.5s. Estimated remaining: 4h 32m 30s. Rate: 7.3 symbols/min [2025-10-03T17:53:06.005584] [DEBUG] [LOCAL ] CAH: Loaded 51794 existing records from primary storage. [2025-10-03T17:53:06.084910] [INFO ] [MAIN ] CAH: Loaded 51794 existing records. [2025-10-03T17:53:06.084782] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:06.355259] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-03T17:53:06.379780] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-03T17:53:06.380355] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-03T17:53:06.387715] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-03T17:53:06.418049] [DEBUG] [LOCAL ] CAF: Trimmed 5597 records to 3474 (keeping 200 days of data) [2025-10-03T17:53:06.403144] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:06.452670] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-03T17:53:06.453396] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-03T17:53:06.465666] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-03T17:53:06.472984] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-03T17:53:06.465488] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-10-03T17:53:06.497321] [DEBUG] [LOCAL ] CAF: Primary data saved (3474 records). [2025-10-03T17:53:06.540263] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-03T17:53:06.534354] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-03T17:53:06.569416] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CAF took 34.1s. Estimated remaining: 4h 31m 45s. Rate: 7.3 symbols/min [2025-10-03T17:53:06.577575] [DEBUG] [LOCAL ] CAL: Loaded 43440 existing records from primary storage. [2025-10-03T17:53:06.613113] [INFO ] [MAIN ] CAL: Loaded 43440 existing records. [2025-10-03T17:53:07.179373] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:07.263887] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:07.294241] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-03T17:53:07.330982] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-03T17:53:07.352383] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-03T17:53:07.389697] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-03T17:53:07.459020] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:07.479117] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-03T17:53:07.561671] [DEBUG] [LOCAL ] CALX: Loaded 38123 existing records from primary storage. [2025-10-03T17:53:07.582330] [INFO ] [MAIN ] CALX: Loaded 38123 existing records. [2025-10-03T17:53:07.991023] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:08.017353] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-03T17:53:08.036988] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-03T17:53:08.070420] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-03T17:53:08.076500] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:08.076902] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-03T17:53:08.076998] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-03T17:53:08.512929] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:08.513396] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-03T17:53:08.645067] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T17:53:08.790719] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-03T17:53:09.333216] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T17:53:09.600217] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-03T17:53:09.602885] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T17:53:09.872466] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T17:53:10.391411] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-03T17:53:10.394992] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T17:53:11.190727] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-03T17:53:11.368701] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T17:53:11.823391] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:53:11.990726] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-03T17:53:12.593614] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:53:12.790706] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-03T17:53:13.590707] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-03T17:53:13.905185] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T17:53:14.045835] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T17:53:14.390731] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-03T17:53:15.083614] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T17:53:15.190737] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-03T17:53:15.990748] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-03T17:53:16.567393] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T17:53:16.790713] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-03T17:53:16.951119] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T17:53:17.590723] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-03T17:53:17.749460] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T17:53:17.888295] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T17:53:18.390710] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-03T17:53:19.190698] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-03T17:53:19.388003] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T17:53:19.970289] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T17:53:19.990621] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-03T17:53:20.790727] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-03T17:53:21.149505] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:53:21.486473] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T17:53:21.590714] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-03T17:53:22.390632] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-03T17:53:22.495898] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T17:53:23.190707] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-03T17:53:23.461822] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T17:53:23.990703] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-03T17:53:24.378171] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T17:53:24.421797] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T17:53:24.790685] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-03T17:53:25.590729] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-03T17:53:25.841365] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:53:26.390707] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-03T17:53:26.652696] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-03T17:53:26.656637] [INFO ] [REMOTE ] CAG: Full fetch complete (77655 records). [2025-10-03T17:53:26.656878] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-03T17:53:27.108635] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-03T17:53:27.108979] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-03T17:53:27.110117] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-03T17:53:27.110202] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-03T17:53:27.140486] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T17:53:27.150571] [DEBUG] [LOCAL ] CAG: Trimmed 77655 records to 54443 (keeping 200 days of data) [2025-10-03T17:53:27.211197] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-03T17:53:27.520741] [DEBUG] [LOCAL ] CAG: Primary data saved (54443 records). [2025-10-03T17:53:27.520939] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-03T17:53:27.522958] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAG took 35.7s. Estimated remaining: 4h 32m 42s. Rate: 7.3 symbols/min [2025-10-03T17:53:27.783858] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:27.821689] [DEBUG] [LOCAL ] CANG: Loaded 27199 existing records from primary storage. [2025-10-03T17:53:27.822546] [INFO ] [MAIN ] CANG: Loaded 27199 existing records. [2025-10-03T17:53:27.992298] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-03T17:53:28.084494] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:28.085158] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-03T17:53:28.085361] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-03T17:53:28.086258] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-03T17:53:28.086341] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-03T17:53:28.640446] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-03T17:53:28.735560] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:28.770423] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:53:28.790720] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-03T17:53:29.459441] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T17:53:29.590699] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-03T17:53:30.237101] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T17:53:30.390708] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-03T17:53:30.782965] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T17:53:31.190723] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-03T17:53:31.990630] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-03T17:53:32.046860] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T17:53:32.790665] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-03T17:53:32.828443] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T17:53:33.384507] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T17:53:33.590795] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-03T17:53:34.390670] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-03T17:53:34.557198] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:53:35.151853] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T17:53:35.190728] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-03T17:53:35.834219] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T17:53:35.990688] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-03T17:53:36.725396] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:53:36.790633] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-03T17:53:37.203371] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T17:53:37.590707] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-03T17:53:38.055191] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T17:53:38.057748] [INFO ] [REMOTE ] CAL: Full fetch complete (61834 records). [2025-10-03T17:53:38.057857] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-03T17:53:38.393849] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-03T17:53:38.490475] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-03T17:53:38.490561] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-03T17:53:38.491270] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-03T17:53:38.491340] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-03T17:53:38.492707] [DEBUG] [LOCAL ] CAL: Trimmed 61834 records to 43747 (keeping 200 days of data) [2025-10-03T17:53:38.779585] [DEBUG] [LOCAL ] CAL: Primary data saved (43747 records). [2025-10-03T17:53:38.779746] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-03T17:53:38.779867] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAL took 33.2s. Estimated remaining: 4h 32m 49s. Rate: 7.3 symbols/min [2025-10-03T17:53:38.893417] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:53:38.921908] [INFO ] [REMOTE ] CALX: Full fetch complete (54000 records). [2025-10-03T17:53:38.945097] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-03T17:53:38.979393] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:39.118964] [DEBUG] [LOCAL ] CAPL: Loaded 5818 existing records from primary storage. [2025-10-03T17:53:39.140412] [INFO ] [MAIN ] CAPL: Loaded 5818 existing records. [2025-10-03T17:53:39.211452] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-03T17:53:39.530765] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:39.552442] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-03T17:53:39.583895] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-03T17:53:39.634144] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-03T17:53:39.634572] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-03T17:53:39.634609] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-03T17:53:39.634833] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-03T17:53:39.635599] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-03T17:53:39.641130] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-03T17:53:39.752111] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T17:53:39.776832] [DEBUG] [LOCAL ] CALX: Trimmed 54000 records to 38363 (keeping 200 days of data) [2025-10-03T17:53:40.001021] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-03T17:53:40.261632] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:40.318076] [DEBUG] [LOCAL ] CALX: Primary data saved (38363 records). [2025-10-03T17:53:40.318241] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-03T17:53:40.318407] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CALX took 33.7s. Estimated remaining: 4h 32m 6s. Rate: 7.3 symbols/min [2025-10-03T17:53:40.490770] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:40.547083] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-10-03T17:53:40.547455] [INFO ] [MAIN ] CARR: Loaded 53984 existing records. [2025-10-03T17:53:40.752361] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:40.752891] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-03T17:53:40.752967] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-03T17:53:40.753371] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-03T17:53:40.753434] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-03T17:53:40.797139] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-03T17:53:41.285116] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:41.309777] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T17:53:41.353726] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-03T17:53:41.590717] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-03T17:53:41.676008] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T17:53:42.390663] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-03T17:53:42.758927] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T17:53:43.114965] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T17:53:43.190676] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-03T17:53:43.990678] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-03T17:53:44.790692] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-03T17:53:44.817489] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T17:53:44.820153] [INFO ] [REMOTE ] CAH: Full fetch complete (74640 records). [2025-10-03T17:53:44.820265] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-03T17:53:45.281243] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-03T17:53:45.281332] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-03T17:53:45.282290] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-03T17:53:45.282360] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-03T17:53:45.283915] [DEBUG] [LOCAL ] CAH: Trimmed 74640 records to 52181 (keeping 200 days of data) [2025-10-03T17:53:45.596599] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-03T17:53:45.616604] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T17:53:45.632340] [DEBUG] [LOCAL ] CAH: Primary data saved (52181 records). [2025-10-03T17:53:45.632500] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-03T17:53:45.632612] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CAH took 40.5s. Estimated remaining: 4h 31m 43s. Rate: 7.3 symbols/min [2025-10-03T17:53:45.810805] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:45.851279] [DEBUG] [LOCAL ] CARS: Loaded 40093 existing records from primary storage. [2025-10-03T17:53:45.851731] [INFO ] [MAIN ] CARS: Loaded 40093 existing records. [2025-10-03T17:53:46.053271] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:46.053724] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-03T17:53:46.053820] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-03T17:53:46.054271] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-03T17:53:46.054412] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-03T17:53:46.252714] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-10-03T17:53:46.395784] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-03T17:53:46.514781] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:46.923936] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T17:53:47.185878] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T17:53:47.190601] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-03T17:53:47.949895] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:53:47.990684] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-03T17:53:48.790731] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-03T17:53:49.399216] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T17:53:49.593704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-03T17:53:49.598118] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:53:50.390629] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-03T17:53:50.966625] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T17:53:51.190827] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-03T17:53:51.190740] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T17:53:51.819822] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T17:53:51.990754] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-03T17:53:52.790730] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-03T17:53:53.430952] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T17:53:53.590718] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-03T17:53:54.151874] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T17:53:54.390692] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-03T17:53:54.846700] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T17:53:55.190620] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-03T17:53:55.286024] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T17:53:55.904749] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T17:53:55.990709] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-03T17:53:56.642340] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-03T17:53:56.790712] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-03T17:53:57.299825] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T17:53:57.300785] [INFO ] [REMOTE ] CAPL: Full fetch complete (8772 records). [2025-10-03T17:53:57.300870] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-03T17:53:57.595790] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-03T17:53:57.695543] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-03T17:53:57.695624] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-03T17:53:57.695873] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-03T17:53:57.695923] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-03T17:53:57.696353] [DEBUG] [LOCAL ] CAPL: Trimmed 8772 records to 5854 (keeping 200 days of data) [2025-10-03T17:53:57.733366] [DEBUG] [LOCAL ] CAPL: Primary data saved (5854 records). [2025-10-03T17:53:57.733480] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-03T17:53:57.733562] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CAPL took 19.0s. Estimated remaining: 4h 31m 54s. Rate: 7.3 symbols/min [2025-10-03T17:53:57.910374] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:53:57.964296] [DEBUG] [LOCAL ] CAT: Loaded 53308 existing records from primary storage. [2025-10-03T17:53:57.964623] [INFO ] [MAIN ] CAT: Loaded 53308 existing records. [2025-10-03T17:53:58.151616] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:53:58.151849] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-03T17:53:58.151898] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-03T17:53:58.152136] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-03T17:53:58.152195] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-03T17:53:58.401854] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-03T17:53:58.533683] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:53:59.136543] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T17:53:59.190733] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-03T17:53:59.990742] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-03T17:54:00.141244] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T17:54:00.790686] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-03T17:54:01.059382] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T17:54:01.151453] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T17:54:01.154624] [INFO ] [REMOTE ] CANG: Full fetch complete (40531 records). [2025-10-03T17:54:01.154753] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-03T17:54:01.579735] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-03T17:54:01.579854] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-03T17:54:01.580421] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-03T17:54:01.580485] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-03T17:54:01.581419] [DEBUG] [LOCAL ] CANG: Trimmed 40531 records to 27426 (keeping 200 days of data) [2025-10-03T17:54:01.625810] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-03T17:54:01.737375] [DEBUG] [LOCAL ] CANG: Primary data saved (27426 records). [2025-10-03T17:54:01.737528] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-03T17:54:01.737638] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CANG took 34.2s. Estimated remaining: 4h 31m 25s. Rate: 7.3 symbols/min [2025-10-03T17:54:01.928540] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:01.939523] [DEBUG] [LOCAL ] CATO: Loaded 7127 existing records from primary storage. [2025-10-03T17:54:01.939800] [INFO ] [MAIN ] CATO: Loaded 7127 existing records. [2025-10-03T17:54:02.172895] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:02.173481] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-03T17:54:02.173630] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-03T17:54:02.173971] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-03T17:54:02.174035] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-03T17:54:02.401312] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-03T17:54:02.493838] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T17:54:02.632861] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:03.190684] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-03T17:54:03.551275] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T17:54:03.872260] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T17:54:03.966752] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T17:54:03.990672] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-03T17:54:04.790695] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-03T17:54:05.453518] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T17:54:05.590689] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-03T17:54:06.390701] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-03T17:54:06.696109] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:54:07.190717] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-03T17:54:07.722817] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-03T17:54:07.780028] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T17:54:07.808345] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T17:54:07.990732] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-03T17:54:08.728749] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T17:54:08.790680] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-03T17:54:09.567570] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:54:09.590614] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-03T17:54:10.346941] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T17:54:10.390708] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-03T17:54:10.928895] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-03T17:54:11.190732] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-03T17:54:11.990737] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-03T17:54:12.774470] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T17:54:12.790631] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-03T17:54:13.590733] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-03T17:54:14.254751] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T17:54:14.363918] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-03T17:54:14.390722] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-03T17:54:15.190735] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-03T17:54:15.656843] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T17:54:15.923777] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T17:54:15.990731] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-03T17:54:16.019900] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T17:54:16.790693] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-03T17:54:17.590695] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-03T17:54:18.069463] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T17:54:18.088124] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T17:54:18.090501] [INFO ] [REMOTE ] CARS: Full fetch complete (55542 records). [2025-10-03T17:54:18.090851] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-03T17:54:18.399046] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-03T17:54:18.528800] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-03T17:54:18.528889] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-03T17:54:18.529528] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-03T17:54:18.529572] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-03T17:54:18.530905] [DEBUG] [LOCAL ] CARS: Trimmed 55542 records to 40377 (keeping 200 days of data) [2025-10-03T17:54:18.768100] [DEBUG] [LOCAL ] CARS: Primary data saved (40377 records). [2025-10-03T17:54:18.768265] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-03T17:54:18.768392] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CARS took 33.1s. Estimated remaining: 4h 32m 1s. Rate: 7.3 symbols/min [2025-10-03T17:54:18.956332] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:19.010928] [DEBUG] [LOCAL ] CAVA: Loaded 53942 existing records from primary storage. [2025-10-03T17:54:19.011328] [INFO ] [MAIN ] CAVA: Loaded 53942 existing records. [2025-10-03T17:54:19.124936] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T17:54:19.195756] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-03T17:54:19.231784] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:19.232328] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-03T17:54:19.232446] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-03T17:54:19.232984] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-03T17:54:19.233064] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-03T17:54:19.585723] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T17:54:19.684730] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:19.969851] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T17:54:19.990630] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-03T17:54:20.790740] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-03T17:54:21.590720] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-03T17:54:22.390715] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-03T17:54:23.174027] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-10-03T17:54:23.190606] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-03T17:54:23.499504] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (3.51 seconds). [2025-10-03T17:54:23.764866] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T17:54:23.990714] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-03T17:54:24.790724] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-03T17:54:25.374111] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T17:54:25.375097] [INFO ] [REMOTE ] CATO: Full fetch complete (11503 records). [2025-10-03T17:54:25.375191] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-03T17:54:25.856306] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-03T17:54:25.856511] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-03T17:54:25.856846] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-03T17:54:25.856974] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-03T17:54:25.857876] [DEBUG] [LOCAL ] CATO: Trimmed 11503 records to 7167 (keeping 200 days of data) [2025-10-03T17:54:25.935235] [DEBUG] [LOCAL ] CATO: Primary data saved (7167 records). [2025-10-03T17:54:25.936348] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-03T17:54:25.938469] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CATO took 24.2s. Estimated remaining: 4h 31m 47s. Rate: 7.3 symbols/min [2025-10-03T17:54:25.938252] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (3.55 seconds). [2025-10-03T17:54:25.990420] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-03T17:54:26.145102] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:26.216340] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T17:54:26.222514] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-10-03T17:54:26.280935] [DEBUG] [LOCAL ] CB: Loaded 50296 existing records from primary storage. [2025-10-03T17:54:26.281285] [INFO ] [MAIN ] CB: Loaded 50296 existing records. [2025-10-03T17:54:26.395780] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-03T17:54:26.483259] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:54:26.483764] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-03T17:54:26.483845] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-03T17:54:26.484181] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-03T17:54:26.484258] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-03T17:54:26.897818] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:27.190708] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-03T17:54:27.924596] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T17:54:27.990753] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-03T17:54:28.449675] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T17:54:28.790695] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-03T17:54:29.590705] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-03T17:54:30.148852] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T17:54:30.390758] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-03T17:54:31.230619] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-03T17:54:31.243609] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-03T17:54:31.300556] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T17:54:31.990692] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-03T17:54:32.100076] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T17:54:32.103244] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-03T17:54:32.103432] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-03T17:54:32.581458] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-03T17:54:32.581565] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-03T17:54:32.582637] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-03T17:54:32.582735] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-03T17:54:32.584317] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 54374 (keeping 200 days of data) [2025-10-03T17:54:32.933445] [DEBUG] [LOCAL ] CARR: Primary data saved (54374 records). [2025-10-03T17:54:32.933591] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-03T17:54:32.933715] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARR took 52.6s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-03T17:54:33.124622] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:54:33.124852] [DEBUG] [LOCAL ] CBAN: No existing data file found in primary storage. [2025-10-03T17:54:33.124909] [WARN ] [MAIN ] CBAN: No existing data found, performing full refresh instead. [2025-10-03T17:54:33.125021] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-03T17:54:33.125065] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-03T17:54:33.125108] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-03T17:54:33.125141] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-03T17:54:33.548144] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:54:33.548759] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-03T17:54:33.617591] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (6.43 seconds). [2025-10-03T17:54:33.619977] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-03T17:54:33.643229] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-03T17:54:34.151262] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T17:54:34.205406] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-03T17:54:34.390727] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-03T17:54:35.195888] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-03T17:54:35.210184] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T17:54:35.990708] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-03T17:54:36.084898] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T17:54:36.575413] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T17:54:36.790702] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-03T17:54:37.590704] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-03T17:54:38.390723] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-03T17:54:38.678197] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T17:54:39.052576] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-03T17:54:39.190712] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-03T17:54:39.633984] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-03T17:54:39.990712] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-03T17:54:40.790682] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-03T17:54:41.263215] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T17:54:41.590691] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-03T17:54:41.905069] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T17:54:41.907907] [INFO ] [REMOTE ] CAT: Full fetch complete (76686 records). [2025-10-03T17:54:41.908033] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-03T17:54:42.354178] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-03T17:54:42.354285] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-03T17:54:42.355144] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-03T17:54:42.355221] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-03T17:54:42.357011] [DEBUG] [LOCAL ] CAT: Trimmed 76686 records to 53696 (keeping 200 days of data) [2025-10-03T17:54:42.472133] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-10-03T17:54:42.478562] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-03T17:54:42.677080] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:54:42.800427] [DEBUG] [LOCAL ] CAT: Primary data saved (53696 records). [2025-10-03T17:54:42.800594] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-03T17:54:42.801438] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CAT took 45.1s. Estimated remaining: 4h 31m 32s. Rate: 7.3 symbols/min [2025-10-03T17:54:43.190689] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-03T17:54:43.278878] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T17:54:43.819853] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T17:54:43.990685] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-03T17:54:44.790675] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-03T17:54:45.256041] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:54:45.278601] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T17:54:45.590724] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-03T17:54:46.390730] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-03T17:54:47.101065] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-10-03T17:54:47.190699] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-03T17:54:48.445422] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-03T17:54:48.448796] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-03T17:54:49.021735] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T17:54:49.024751] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-03T17:54:49.258785] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T17:54:49.578859] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-03T17:54:49.590606] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-03T17:54:50.374611] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-10-03T17:54:50.393572] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-03T17:54:50.394527] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T17:54:51.190696] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-03T17:54:51.990722] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-03T17:54:52.063944] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:54:52.732087] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:54:52.790681] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-03T17:54:53.130474] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T17:54:53.133151] [INFO ] [REMOTE ] CAVA: Full fetch complete (77301 records). [2025-10-03T17:54:53.133274] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-03T17:54:53.444460] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T17:54:53.457278] [INFO ] [REMOTE ] CBAN: Full fetch complete (16135 records). [2025-10-03T17:54:53.473162] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-03T17:54:53.603406] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-03T17:54:53.702970] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-03T17:54:53.707571] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-03T17:54:53.708880] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-03T17:54:53.729945] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-03T17:54:53.788768] [DEBUG] [LOCAL ] CAVA: Trimmed 77301 records to 54332 (keeping 200 days of data) [2025-10-03T17:54:54.097282] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-03T17:54:54.097705] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-03T17:54:54.104581] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-03T17:54:54.105958] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-03T17:54:54.114962] [DEBUG] [LOCAL ] CBAN: Trimmed 16135 records to 10995 (keeping 200 days of data) [2025-10-03T17:54:54.300544] [DEBUG] [LOCAL ] CBAN: Primary data saved (10995 records). [2025-10-03T17:54:54.306606] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-03T17:54:54.314333] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CBAN took 21.4s. Estimated remaining: 4h 31m 40s. Rate: 7.3 symbols/min [2025-10-03T17:54:54.400549] [DEBUG] [LOCAL ] CAVA: Primary data saved (54332 records). [2025-10-03T17:54:54.400733] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-03T17:54:54.400832] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CAVA took 35.6s. Estimated remaining: 4h 30m 51s. Rate: 7.3 symbols/min [2025-10-03T17:54:55.622997] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T17:54:55.634885] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-03T17:54:57.325825] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T17:54:57.337281] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-03T17:54:59.127720] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T17:54:59.141331] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-03T17:55:00.901879] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T17:55:00.904378] [INFO ] [REMOTE ] CB: Full fetch complete (72638 records). [2025-10-03T17:55:00.904519] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-03T17:55:01.346276] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-03T17:55:01.346379] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-03T17:55:01.347355] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-03T17:55:01.347426] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-03T17:55:01.350681] [DEBUG] [LOCAL ] CB: Trimmed 72638 records to 50658 (keeping 200 days of data) [2025-10-03T17:55:01.705604] [DEBUG] [LOCAL ] CB: Primary data saved (50658 records). [2025-10-03T17:55:01.705777] [INFO ] [MAIN ] CB: Full history saved. [2025-10-03T17:55:01.706781] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CB took 35.8s. Estimated remaining: 4h 30m 39s. Rate: 7.3 symbols/min [2025-10-03T17:55:02.352367] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.452518] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.532793] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.570028] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:02.571043] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-03T17:55:02.571106] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-03T17:55:02.571198] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-03T17:55:02.571237] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-03T17:55:02.571279] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-03T17:55:02.571314] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-03T17:55:02.701690] [DEBUG] [LOCAL ] CBNA: Loaded 2927 existing records from primary storage. [2025-10-03T17:55:02.683141] [DEBUG] [LOCAL ] CBL: Loaded 16371 existing records from primary storage. [2025-10-03T17:55:02.702249] [INFO ] [MAIN ] CBNA: Loaded 2927 existing records. [2025-10-03T17:55:02.702363] [INFO ] [MAIN ] CBL: Loaded 16371 existing records. [2025-10-03T17:55:03.236102] [DEBUG] [LOCAL ] CBRE: Loaded 50924 existing records from primary storage. [2025-10-03T17:55:03.242639] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.279010] [INFO ] [MAIN ] CBRE: Loaded 50924 existing records. [2025-10-03T17:55:03.279205] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.299599] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-03T17:55:03.366151] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-03T17:55:03.395589] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.431966] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-03T17:55:03.426756] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.471176] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-03T17:55:03.528336] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-03T17:55:03.725967] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-03T17:55:03.724099] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:03.739035] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:03.739403] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-03T17:55:03.762218] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-03T17:55:03.797574] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-03T17:55:03.864193] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-03T17:55:03.900586] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-03T17:55:04.153201] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:55:04.209161] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-03T17:55:04.311245] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:55:04.448981] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-03T17:55:04.501616] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:55:04.566956] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.577449] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-03T17:55:04.614006] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-03T17:55:04.613918] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-03T17:55:04.644799] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-03T17:55:04.671931] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-03T17:55:04.693212] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBO took 2.9s. Estimated remaining: 4h 30m 4s. Rate: 7.3 symbols/min [2025-10-03T17:55:04.726854] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.732350] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-03T17:55:04.927503] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:04.930743] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-03T17:55:05.005786] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:05.042287] [DEBUG] [LOCAL ] CBT: Loaded 31073 existing records from primary storage. [2025-10-03T17:55:05.042565] [INFO ] [MAIN ] CBT: Loaded 31073 existing records. [2025-10-03T17:55:05.231166] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:05.231390] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-03T17:55:05.231439] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-03T17:55:05.232418] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-03T17:55:05.232478] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-03T17:55:05.546707] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:55:05.570422] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-03T17:55:05.643820] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:05.644152] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-03T17:55:06.026449] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:55:06.031866] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-03T17:55:06.296521] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T17:55:06.298519] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-03T17:55:06.722311] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T17:55:06.724163] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-03T17:55:06.813941] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T17:55:06.825945] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-03T17:55:06.914505] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:55:06.922430] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-03T17:55:07.051538] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T17:55:07.053609] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-03T17:55:07.069389] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T17:55:07.074826] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-03T17:55:07.626010] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T17:55:07.627909] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-03T17:55:08.074820] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T17:55:08.079556] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-03T17:55:08.257981] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:55:08.293189] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:55:08.294785] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T17:55:08.790639] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-03T17:55:09.089447] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:55:09.590728] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-03T17:55:10.243303] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T17:55:10.390764] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-03T17:55:11.190628] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-03T17:55:11.239692] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T17:55:11.440697] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T17:55:11.990718] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-03T17:55:12.189110] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T17:55:12.790726] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-03T17:55:13.346212] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T17:55:13.411573] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T17:55:13.590762] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-03T17:55:13.973618] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-03T17:55:14.390727] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-03T17:55:15.190733] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-03T17:55:15.835002] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T17:55:15.939622] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T17:55:15.990695] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-03T17:55:16.790717] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-03T17:55:17.549348] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T17:55:17.590715] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-03T17:55:18.390691] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-03T17:55:18.849787] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T17:55:18.881038] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T17:55:19.190629] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-03T17:55:19.492908] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T17:55:19.990722] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-03T17:55:20.485432] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-03T17:55:20.525710] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T17:55:20.790715] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-03T17:55:21.590689] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-03T17:55:21.740391] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T17:55:22.390711] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-03T17:55:23.190631] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-03T17:55:23.325882] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T17:55:23.670029] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:55:23.847956] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T17:55:23.990702] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-03T17:55:24.790728] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-03T17:55:25.590717] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-03T17:55:25.735070] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T17:55:25.766352] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T17:55:26.390711] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-03T17:55:26.553063] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T17:55:26.555055] [INFO ] [REMOTE ] CBT: Full fetch complete (45681 records). [2025-10-03T17:55:26.555179] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-03T17:55:26.941454] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T17:55:26.960110] [INFO ] [REMOTE ] CBNA: Full fetch complete (4561 records). [2025-10-03T17:55:26.994621] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-03T17:55:26.997204] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-03T17:55:26.997486] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-03T17:55:27.046949] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-03T17:55:27.077535] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-03T17:55:27.135079] [DEBUG] [LOCAL ] CBT: Trimmed 45681 records to 31248 (keeping 200 days of data) [2025-10-03T17:55:27.196733] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-03T17:55:27.524779] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-03T17:55:27.529374] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-03T17:55:27.534474] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-03T17:55:27.539687] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-03T17:55:27.542253] [DEBUG] [LOCAL ] CBNA: Trimmed 4561 records to 2938 (keeping 200 days of data) [2025-10-03T17:55:27.621333] [DEBUG] [LOCAL ] CBNA: Primary data saved (2938 records). [2025-10-03T17:55:27.626341] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-03T17:55:27.629044] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBNA took 25.9s. Estimated remaining: 4h 31m 8s. Rate: 7.3 symbols/min [2025-10-03T17:55:27.753746] [DEBUG] [LOCAL ] CBT: Primary data saved (31248 records). [2025-10-03T17:55:27.760318] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-03T17:55:27.765604] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBT took 23.0s. Estimated remaining: 4h 30m 20s. Rate: 7.3 symbols/min [2025-10-03T17:55:27.912559] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:27.999904] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-03T17:55:28.046820] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:28.047153] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-03T17:55:28.047212] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-03T17:55:28.047338] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-03T17:55:28.047383] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-03T17:55:28.047535] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-03T17:55:28.047589] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-03T17:55:28.172111] [DEBUG] [LOCAL ] CBU: Loaded 22817 existing records from primary storage. [2025-10-03T17:55:28.183853] [INFO ] [MAIN ] CBU: Loaded 22817 existing records. [2025-10-03T17:55:28.351025] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T17:55:28.673218] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:28.678145] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:28.678980] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-03T17:55:28.679050] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-03T17:55:28.683624] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-03T17:55:28.683733] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-03T17:55:28.793673] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-03T17:55:29.067740] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:29.590629] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-03T17:55:29.708437] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T17:55:29.724176] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T17:55:29.726203] [INFO ] [REMOTE ] CBL: Full fetch complete (25450 records). [2025-10-03T17:55:29.726301] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-03T17:55:30.146224] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-03T17:55:30.146327] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-03T17:55:30.146850] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-03T17:55:30.146919] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-03T17:55:30.147680] [DEBUG] [LOCAL ] CBL: Trimmed 25450 records to 16471 (keeping 200 days of data) [2025-10-03T17:55:30.249592] [DEBUG] [LOCAL ] CBL: Primary data saved (16471 records). [2025-10-03T17:55:30.249778] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-03T17:55:30.249872] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CBL took 28.5s. Estimated remaining: 4h 29m 44s. Rate: 7.3 symbols/min [2025-10-03T17:55:30.398635] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-03T17:55:30.433620] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:30.475966] [DEBUG] [LOCAL ] CBZ: Loaded 33974 existing records from primary storage. [2025-10-03T17:55:30.476246] [INFO ] [MAIN ] CBZ: Loaded 33974 existing records. [2025-10-03T17:55:30.670242] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:30.670457] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-03T17:55:30.670506] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-03T17:55:30.671508] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-03T17:55:30.671583] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-03T17:55:30.903716] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T17:55:31.104553] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:31.190676] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-03T17:55:31.392598] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:55:31.392979] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-03T17:55:31.393075] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:55:31.393126] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-03T17:55:31.393194] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:55:31.393269] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-03T17:55:31.393335] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-03T17:55:31.393373] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-03T17:55:31.393429] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-03T17:55:31.393539] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBX took 3.6s. Estimated remaining: 4h 29m 1s. Rate: 7.3 symbols/min [2025-10-03T17:55:31.582425] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:31.644783] [DEBUG] [LOCAL ] CC: Loaded 53386 existing records from primary storage. [2025-10-03T17:55:31.645115] [INFO ] [MAIN ] CC: Loaded 53386 existing records. [2025-10-03T17:55:31.847637] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:31.847891] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-03T17:55:31.847941] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-03T17:55:31.848181] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-03T17:55:31.848239] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-03T17:55:31.996672] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-03T17:55:32.260863] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:32.296721] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T17:55:32.790722] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-03T17:55:33.249888] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T17:55:33.590723] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-03T17:55:34.175258] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T17:55:34.344683] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T17:55:34.390713] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-03T17:55:35.190716] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-03T17:55:35.458963] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T17:55:35.990734] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-03T17:55:36.790635] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-03T17:55:36.921002] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T17:55:37.182075] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-03T17:55:37.590691] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-03T17:55:38.142146] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:55:38.390738] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-03T17:55:38.597261] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T17:55:39.190686] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-03T17:55:39.938984] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T17:55:39.941881] [INFO ] [REMOTE ] CBRE: Full fetch complete (73906 records). [2025-10-03T17:55:39.942010] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-03T17:55:40.000136] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-03T17:55:40.419218] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-03T17:55:40.419327] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-03T17:55:40.420265] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-03T17:55:40.420343] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-03T17:55:40.422133] [DEBUG] [LOCAL ] CBRE: Trimmed 73906 records to 51279 (keeping 200 days of data) [2025-10-03T17:55:40.703305] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T17:55:40.792378] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-03T17:55:40.802979] [DEBUG] [LOCAL ] CBRE: Primary data saved (51279 records). [2025-10-03T17:55:40.803263] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-03T17:55:40.803391] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBRE took 39.1s. Estimated remaining: 4h 28m 59s. Rate: 7.3 symbols/min [2025-10-03T17:55:40.987907] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:41.045378] [DEBUG] [LOCAL ] CCI: Loaded 53529 existing records from primary storage. [2025-10-03T17:55:41.045787] [INFO ] [MAIN ] CCI: Loaded 53529 existing records. [2025-10-03T17:55:41.235091] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:55:41.235382] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-03T17:55:41.236371] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-03T17:55:41.236691] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-03T17:55:41.236751] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-03T17:55:41.595850] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-03T17:55:41.639666] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:41.744070] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:55:42.145040] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T17:55:42.390725] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-03T17:55:42.805512] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T17:55:43.190733] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-03T17:55:43.990725] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-03T17:55:44.026632] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T17:55:44.790747] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-03T17:55:45.216230] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:55:45.386032] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T17:55:45.590749] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-03T17:55:46.370829] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T17:55:46.390635] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-03T17:55:46.505260] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T17:55:47.190756] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-03T17:55:47.990665] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-03T17:55:48.159835] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T17:55:48.401239] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-03T17:55:48.790778] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-03T17:55:49.336280] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T17:55:49.440408] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T17:55:49.590718] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-03T17:55:50.390693] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-03T17:55:51.190635] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-03T17:55:51.405386] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T17:55:51.430824] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:55:51.990701] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-03T17:55:52.753930] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T17:55:52.790707] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-03T17:55:53.590688] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-03T17:55:53.843830] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T17:55:54.057387] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T17:55:54.059394] [INFO ] [REMOTE ] CBZ: Full fetch complete (45594 records). [2025-10-03T17:55:54.059478] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-03T17:55:54.395926] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-03T17:55:54.492574] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-03T17:55:54.492714] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-03T17:55:54.493697] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-03T17:55:54.493772] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-03T17:55:54.500192] [DEBUG] [LOCAL ] CBZ: Trimmed 45594 records to 34222 (keeping 200 days of data) [2025-10-03T17:55:54.722781] [DEBUG] [LOCAL ] CBZ: Primary data saved (34222 records). [2025-10-03T17:55:54.722942] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-03T17:55:54.723086] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBZ took 24.5s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-03T17:55:54.911447] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:55:54.911683] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-03T17:55:54.911740] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-03T17:55:54.911882] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-03T17:55:54.911936] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-03T17:55:54.912005] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-03T17:55:54.912051] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-03T17:55:55.201736] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-03T17:55:55.305484] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:55:55.478326] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:55:55.522786] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-03T17:55:55.990746] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-03T17:55:56.709423] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T17:55:56.790739] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-03T17:55:57.590639] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-03T17:55:57.732122] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T17:55:57.914865] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T17:55:57.966720] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T17:55:58.390742] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-03T17:55:59.190703] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-03T17:55:59.630149] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T17:55:59.990717] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-03T17:56:00.413216] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T17:56:00.790730] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-03T17:56:01.118125] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T17:56:01.590701] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-03T17:56:01.878460] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-03T17:56:02.173846] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T17:56:02.390752] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-03T17:56:03.190680] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-03T17:56:03.626719] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T17:56:03.990715] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-03T17:56:04.298640] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T17:56:04.790686] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-03T17:56:05.590634] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-03T17:56:05.757164] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:56:06.390742] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-03T17:56:06.733581] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T17:56:06.783339] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T17:56:06.855172] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T17:56:07.190730] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-03T17:56:07.990713] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-03T17:56:08.462968] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T17:56:08.790689] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-03T17:56:08.999038] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:56:09.135995] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-03T17:56:09.590684] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-03T17:56:10.078941] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T17:56:10.390732] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-03T17:56:10.821685] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T17:56:11.190709] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-03T17:56:11.538719] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T17:56:11.539700] [INFO ] [REMOTE ] CCIA: Full fetch complete (2073 records). [2025-10-03T17:56:11.539810] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-03T17:56:11.764400] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T17:56:11.764670] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T17:56:11.764746] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T17:56:11.764822] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-03T17:56:11.764926] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-03T17:56:11.764983] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-03T17:56:11.765044] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-03T17:56:11.765132] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CCIA took 17.0s. Estimated remaining: 4h 29m 52s. Rate: 7.3 symbols/min [2025-10-03T17:56:11.945292] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:11.963221] [DEBUG] [LOCAL ] CCIF: Loaded 15844 existing records from primary storage. [2025-10-03T17:56:11.963482] [INFO ] [MAIN ] CCIF: Loaded 15844 existing records. [2025-10-03T17:56:11.995886] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-03T17:56:12.160942] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:12.161195] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-03T17:56:12.161283] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-03T17:56:12.161714] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-03T17:56:12.161775] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-03T17:56:12.541015] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:12.790749] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-03T17:56:13.590729] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-03T17:56:13.619231] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T17:56:13.626107] [INFO ] [REMOTE ] CC: Full fetch complete (75660 records). [2025-10-03T17:56:13.626272] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-03T17:56:13.787188] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T17:56:14.131385] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-03T17:56:14.131480] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-03T17:56:14.132457] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-03T17:56:14.132543] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-03T17:56:14.134310] [DEBUG] [LOCAL ] CC: Trimmed 75660 records to 53769 (keeping 200 days of data) [2025-10-03T17:56:14.391175] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-03T17:56:14.490300] [DEBUG] [LOCAL ] CC: Primary data saved (53769 records). [2025-10-03T17:56:14.490461] [INFO ] [MAIN ] CC: Full history saved. [2025-10-03T17:56:14.490574] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CC took 43.1s. Estimated remaining: 4h 29m 18s. Rate: 7.3 symbols/min [2025-10-03T17:56:14.680695] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:14.685020] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T17:56:14.686930] [INFO ] [REMOTE ] CBU: Full fetch complete (32368 records). [2025-10-03T17:56:14.687035] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-03T17:56:15.063404] [DEBUG] [LOCAL ] CCJ: Loaded 54063 existing records from primary storage. [2025-10-03T17:56:15.079172] [INFO ] [MAIN ] CCJ: Loaded 54063 existing records. [2025-10-03T17:56:15.231602] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-03T17:56:15.194039] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-03T17:56:15.242081] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-03T17:56:15.247995] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-03T17:56:15.269223] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-03T17:56:15.290311] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T17:56:15.379494] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:15.379604] [DEBUG] [LOCAL ] CBU: Trimmed 32368 records to 23000 (keeping 200 days of data) [2025-10-03T17:56:15.379923] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-03T17:56:15.379999] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-03T17:56:15.381814] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-03T17:56:15.381892] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-03T17:56:15.927089] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:15.960737] [DEBUG] [LOCAL ] CBU: Primary data saved (23000 records). [2025-10-03T17:56:15.960866] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-03T17:56:15.960947] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CBU took 48.3s. Estimated remaining: 4h 28m 37s. Rate: 7.3 symbols/min [2025-10-03T17:56:15.994752] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-03T17:56:16.143616] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:16.191745] [DEBUG] [LOCAL ] CCK: Loaded 46518 existing records from primary storage. [2025-10-03T17:56:16.192104] [INFO ] [MAIN ] CCK: Loaded 46518 existing records. [2025-10-03T17:56:16.382194] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:16.382414] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-03T17:56:16.382463] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-03T17:56:16.383811] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-03T17:56:16.383875] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-03T17:56:16.748042] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T17:56:16.794888] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-03T17:56:16.818150] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:17.012939] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T17:56:17.590698] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-03T17:56:18.390738] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-03T17:56:19.060883] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-03T17:56:19.190723] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-03T17:56:19.328937] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T17:56:19.990732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-03T17:56:20.328462] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T17:56:20.790666] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-03T17:56:21.032527] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:56:21.503566] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T17:56:21.574724] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T17:56:21.590698] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-03T17:56:22.390736] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-03T17:56:23.203501] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-03T17:56:23.210576] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T17:56:23.988280] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:56:23.997866] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-03T17:56:24.254272] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:56:24.790727] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-03T17:56:25.590702] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-03T17:56:25.819632] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T17:56:26.390703] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-03T17:56:26.701437] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T17:56:27.185102] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T17:56:27.198949] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-03T17:56:27.227233] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T17:56:27.990696] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-03T17:56:28.790673] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-03T17:56:29.160757] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T17:56:29.590687] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-03T17:56:29.820117] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T17:56:30.194757] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T17:56:30.307166] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T17:56:30.313090] [INFO ] [REMOTE ] CCI: Full fetch complete (76997 records). [2025-10-03T17:56:30.313244] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-03T17:56:30.395717] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-03T17:56:30.791726] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-03T17:56:30.791832] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-03T17:56:30.792946] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-03T17:56:30.793018] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-03T17:56:30.794628] [DEBUG] [LOCAL ] CCI: Trimmed 76997 records to 53918 (keeping 200 days of data) [2025-10-03T17:56:31.155140] [DEBUG] [LOCAL ] CCI: Primary data saved (53918 records). [2025-10-03T17:56:31.155291] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-03T17:56:31.157908] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CCI took 50.4s. Estimated remaining: 4h 29m 2s. Rate: 7.3 symbols/min [2025-10-03T17:56:31.195740] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-03T17:56:31.365553] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:31.426703] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-10-03T17:56:31.427321] [INFO ] [MAIN ] CCL: Loaded 54190 existing records. [2025-10-03T17:56:31.639756] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:31.640032] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-03T17:56:31.640113] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-03T17:56:31.641702] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-03T17:56:31.641768] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-03T17:56:31.995752] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-03T17:56:32.081503] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:32.363785] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T17:56:32.436690] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T17:56:32.790702] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-03T17:56:33.590632] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-03T17:56:33.757842] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:56:33.790610] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T17:56:34.390694] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-03T17:56:35.190682] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-03T17:56:35.619052] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T17:56:35.894759] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T17:56:35.990671] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-03T17:56:36.790699] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-03T17:56:37.305929] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T17:56:37.590691] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-03T17:56:37.784283] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-10-03T17:56:38.390732] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-03T17:56:38.720006] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T17:56:38.919444] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T17:56:39.190684] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-03T17:56:39.990634] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-03T17:56:40.037572] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T17:56:40.038799] [INFO ] [REMOTE ] CCIF: Full fetch complete (21918 records). [2025-10-03T17:56:40.038883] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-03T17:56:40.363802] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T17:56:40.489583] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-03T17:56:40.489687] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-03T17:56:40.490136] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-03T17:56:40.490201] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-03T17:56:40.490872] [DEBUG] [LOCAL ] CCIF: Trimmed 21918 records to 15916 (keeping 200 days of data) [2025-10-03T17:56:40.585599] [DEBUG] [LOCAL ] CCIF: Primary data saved (15916 records). [2025-10-03T17:56:40.585805] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-03T17:56:40.585913] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CCIF took 28.8s. Estimated remaining: 4h 28m 59s. Rate: 7.3 symbols/min [2025-10-03T17:56:40.773621] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:40.790707] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-03T17:56:40.823556] [DEBUG] [LOCAL ] CCO: Loaded 48249 existing records from primary storage. [2025-10-03T17:56:40.823914] [INFO ] [MAIN ] CCO: Loaded 48249 existing records. [2025-10-03T17:56:41.030191] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:41.030454] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-03T17:56:41.030514] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-03T17:56:41.031707] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-03T17:56:41.031775] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-03T17:56:41.435176] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:41.590723] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-03T17:56:42.239249] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T17:56:42.390671] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-03T17:56:42.508124] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T17:56:43.190706] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-03T17:56:43.957250] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-10-03T17:56:43.990675] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-03T17:56:44.188394] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T17:56:44.623100] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T17:56:44.625483] [INFO ] [REMOTE ] CCK: Full fetch complete (67611 records). [2025-10-03T17:56:44.625675] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-03T17:56:44.814284] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-03T17:56:45.052962] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-03T17:56:45.053065] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-03T17:56:45.054005] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-03T17:56:45.054083] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-03T17:56:45.055695] [DEBUG] [LOCAL ] CCK: Trimmed 67611 records to 46844 (keeping 200 days of data) [2025-10-03T17:56:45.353996] [DEBUG] [LOCAL ] CCK: Primary data saved (46844 records). [2025-10-03T17:56:45.354133] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-03T17:56:45.354226] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCK took 29.4s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-03T17:56:45.534962] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:45.544462] [DEBUG] [LOCAL ] CCRD: Loaded 9134 existing records from primary storage. [2025-10-03T17:56:45.544814] [INFO ] [MAIN ] CCRD: Loaded 9134 existing records. [2025-10-03T17:56:45.601020] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-03T17:56:45.743628] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:45.744196] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-03T17:56:45.744266] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-03T17:56:45.744824] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-03T17:56:45.744898] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-03T17:56:46.131570] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:46.168495] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-03T17:56:46.390698] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-03T17:56:46.566440] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T17:56:47.063491] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-03T17:56:47.190680] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-03T17:56:47.990637] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-03T17:56:48.114824] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T17:56:48.648116] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T17:56:48.790729] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-03T17:56:49.590706] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-03T17:56:50.246294] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-03T17:56:50.390740] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-03T17:56:50.442866] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-03T17:56:50.866390] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T17:56:50.865594] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T17:56:51.190721] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-03T17:56:51.990738] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-03T17:56:52.790739] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-03T17:56:53.519200] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T17:56:53.590705] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-03T17:56:54.061243] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-03T17:56:54.064175] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-10-03T17:56:54.064368] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-03T17:56:54.204783] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T17:56:54.396028] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-03T17:56:54.521615] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:56:54.606062] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-03T17:56:54.606186] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-03T17:56:54.607191] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-03T17:56:54.607300] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-03T17:56:54.609378] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 54453 (keeping 200 days of data) [2025-10-03T17:56:54.949546] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T17:56:54.969693] [DEBUG] [LOCAL ] CCJ: Primary data saved (54453 records). [2025-10-03T17:56:54.969882] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-03T17:56:54.969982] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCJ took 40.5s. Estimated remaining: 4h 28m 33s. Rate: 7.3 symbols/min [2025-10-03T17:56:55.159237] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:56:55.190889] [DEBUG] [LOCAL ] CCS: Loaded 30685 existing records from primary storage. [2025-10-03T17:56:55.191010] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-03T17:56:55.192577] [INFO ] [MAIN ] CCS: Loaded 30685 existing records. [2025-10-03T17:56:55.386083] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:56:55.386302] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-03T17:56:55.386351] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-03T17:56:55.387266] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-03T17:56:55.387330] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-03T17:56:55.764966] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:56:55.990721] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-03T17:56:56.664481] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:56:56.790713] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-03T17:56:57.595616] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-03T17:56:57.601921] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-03T17:56:57.919749] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:56:58.390737] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-03T17:56:58.888456] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T17:56:59.190671] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-03T17:56:59.789446] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T17:56:59.977884] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:56:59.990669] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-03T17:57:00.790690] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-03T17:57:00.892965] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T17:57:01.590693] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-03T17:57:02.390702] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-03T17:57:02.991155] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T17:57:03.190673] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-03T17:57:03.211869] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T17:57:03.327669] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-03T17:57:03.990695] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-03T17:57:04.790691] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-03T17:57:04.812894] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T17:57:04.813883] [INFO ] [REMOTE ] CCRD: Full fetch complete (11844 records). [2025-10-03T17:57:04.813965] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-03T17:57:05.110972] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:57:05.273464] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-03T17:57:05.273543] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-03T17:57:05.273855] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-03T17:57:05.273918] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-03T17:57:05.274462] [DEBUG] [LOCAL ] CCRD: Trimmed 11844 records to 9165 (keeping 200 days of data) [2025-10-03T17:57:05.331248] [DEBUG] [LOCAL ] CCRD: Primary data saved (9165 records). [2025-10-03T17:57:05.331413] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-03T17:57:05.331506] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCRD took 20.0s. Estimated remaining: 4h 28m 35s. Rate: 7.3 symbols/min [2025-10-03T17:57:05.521347] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:05.521562] [DEBUG] [LOCAL ] CCU: No existing data file found in primary storage. [2025-10-03T17:57:05.521618] [WARN ] [MAIN ] CCU: No existing data found, performing full refresh instead. [2025-10-03T17:57:05.521760] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-03T17:57:05.521803] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-03T17:57:05.521844] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-03T17:57:05.521876] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-03T17:57:05.595866] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-03T17:57:05.919221] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:06.390728] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-03T17:57:07.049606] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-10-03T17:57:07.192467] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-03T17:57:07.205937] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:57:07.617331] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T17:57:07.990702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-03T17:57:08.514149] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T17:57:08.599796] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T17:57:08.790686] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-03T17:57:09.590731] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-03T17:57:09.937722] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T17:57:10.390694] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-03T17:57:11.190703] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-03T17:57:11.671911] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T17:57:11.990638] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-03T17:57:12.216449] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-03T17:57:12.790685] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-03T17:57:12.842678] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T17:57:13.073086] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:57:13.590702] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-03T17:57:14.151621] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T17:57:14.390714] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-03T17:57:14.828028] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T17:57:15.190724] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-03T17:57:15.508959] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T17:57:15.990728] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-03T17:57:16.488033] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T17:57:16.790725] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-03T17:57:17.590702] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-03T17:57:18.090405] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-03T17:57:18.093465] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-03T17:57:18.093613] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-03T17:57:18.396031] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-03T17:57:18.490436] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:57:18.609098] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-03T17:57:18.609280] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-03T17:57:18.610321] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-03T17:57:18.610444] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-03T17:57:18.612451] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54580 (keeping 200 days of data) [2025-10-03T17:57:18.723869] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T17:57:18.985750] [DEBUG] [LOCAL ] CCL: Primary data saved (54580 records). [2025-10-03T17:57:18.985910] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-03T17:57:18.987148] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCL took 47.8s. Estimated remaining: 4h 28m 52s. Rate: 7.3 symbols/min [2025-10-03T17:57:19.182950] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:19.183198] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-03T17:57:19.183257] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-03T17:57:19.183375] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-03T17:57:19.183425] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-03T17:57:19.183473] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-03T17:57:19.183508] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-03T17:57:19.196756] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-03T17:57:19.609013] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:19.875530] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T17:57:19.990719] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-03T17:57:20.732940] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T17:57:20.790705] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-03T17:57:21.067538] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T17:57:21.590743] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-03T17:57:22.399831] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-03T17:57:22.421095] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T17:57:22.810608] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-10-03T17:57:22.813818] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T17:57:23.190705] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-03T17:57:23.990702] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-03T17:57:24.466919] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T17:57:24.790700] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-03T17:57:25.047148] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T17:57:25.590696] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-03T17:57:25.911812] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T17:57:25.913420] [INFO ] [REMOTE ] CCS: Full fetch complete (45009 records). [2025-10-03T17:57:25.913513] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-03T17:57:26.316713] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-03T17:57:26.316852] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-03T17:57:26.317475] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-03T17:57:26.317522] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-03T17:57:26.318719] [DEBUG] [LOCAL ] CCS: Trimmed 45009 records to 30853 (keeping 200 days of data) [2025-10-03T17:57:26.408062] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-03T17:57:26.514579] [DEBUG] [LOCAL ] CCS: Primary data saved (30853 records). [2025-10-03T17:57:26.514756] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-03T17:57:26.514854] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCS took 31.5s. Estimated remaining: 4h 28m 40s. Rate: 7.3 symbols/min [2025-10-03T17:57:26.707914] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:26.703469] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-03T17:57:26.763282] [DEBUG] [LOCAL ] CDE: Loaded 54032 existing records from primary storage. [2025-10-03T17:57:26.763625] [INFO ] [MAIN ] CDE: Loaded 54032 existing records. [2025-10-03T17:57:26.961906] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:26.962231] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-03T17:57:26.962306] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-03T17:57:26.963981] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-03T17:57:26.964048] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-03T17:57:27.207739] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-03T17:57:27.209869] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T17:57:27.429968] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:27.558141] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T17:57:27.990695] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-03T17:57:28.790692] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-03T17:57:29.389139] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T17:57:29.394435] [INFO ] [REMOTE ] CCO: Full fetch complete (66798 records). [2025-10-03T17:57:29.394634] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-03T17:57:29.604844] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-03T17:57:29.839008] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-03T17:57:29.838831] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T17:57:29.839207] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-03T17:57:29.844195] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-03T17:57:29.844717] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-03T17:57:29.846798] [DEBUG] [LOCAL ] CCO: Trimmed 66798 records to 48625 (keeping 200 days of data) [2025-10-03T17:57:29.904821] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-03T17:57:30.143956] [DEBUG] [LOCAL ] CCO: Primary data saved (48625 records). [2025-10-03T17:57:30.144095] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-03T17:57:30.146351] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCO took 49.6s. Estimated remaining: 4h 28m 10s. Rate: 7.3 symbols/min [2025-10-03T17:57:30.331876] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:30.345675] [DEBUG] [LOCAL ] CDLR: Loaded 9932 existing records from primary storage. [2025-10-03T17:57:30.345942] [INFO ] [MAIN ] CDLR: Loaded 9932 existing records. [2025-10-03T17:57:30.395881] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-03T17:57:30.539339] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:30.539630] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-03T17:57:30.539721] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-03T17:57:30.540355] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-03T17:57:30.540602] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-03T17:57:30.939968] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:31.190693] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-03T17:57:31.502752] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T17:57:31.504282] [INFO ] [REMOTE ] CCU: Full fetch complete (32901 records). [2025-10-03T17:57:31.504389] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-03T17:57:31.592377] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-03T17:57:31.932752] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-03T17:57:31.932834] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-03T17:57:31.933312] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-03T17:57:31.933375] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-03T17:57:31.934869] [DEBUG] [LOCAL ] CCU: Trimmed 32901 records to 23444 (keeping 200 days of data) [2025-10-03T17:57:31.992488] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-03T17:57:32.083511] [DEBUG] [LOCAL ] CCU: Primary data saved (23444 records). [2025-10-03T17:57:32.083671] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-03T17:57:32.083767] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCU took 26.8s. Estimated remaining: 4h 27m 33s. Rate: 7.3 symbols/min [2025-10-03T17:57:32.267320] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-03T17:57:32.268934] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:32.314606] [DEBUG] [LOCAL ] CDP: Loaded 42936 existing records from primary storage. [2025-10-03T17:57:32.314974] [INFO ] [MAIN ] CDP: Loaded 42936 existing records. [2025-10-03T17:57:32.507689] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:32.507945] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-03T17:57:32.508003] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-03T17:57:32.509455] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-03T17:57:32.509517] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-03T17:57:32.795858] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-03T17:57:32.880963] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:33.120715] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:57:33.121059] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-03T17:57:33.121168] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:57:33.121270] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-03T17:57:33.121342] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:57:33.121419] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-03T17:57:33.121535] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-03T17:57:33.121613] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-03T17:57:33.121727] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-03T17:57:33.121823] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCZ took 14.1s. Estimated remaining: 4h 26m 51s. Rate: 7.3 symbols/min [2025-10-03T17:57:33.308495] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:33.338756] [DEBUG] [LOCAL ] CDRE: Loaded 25140 existing records from primary storage. [2025-10-03T17:57:33.339088] [INFO ] [MAIN ] CDRE: Loaded 25140 existing records. [2025-10-03T17:57:33.541031] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:33.541284] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-03T17:57:33.541333] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-03T17:57:33.542247] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-03T17:57:33.542333] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-03T17:57:33.595821] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-03T17:57:33.937663] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:34.390720] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-03T17:57:35.190767] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-03T17:57:35.223753] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T17:57:35.487219] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T17:57:35.990711] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-03T17:57:36.800037] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-03T17:57:36.802849] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T17:57:37.590722] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-03T17:57:37.906740] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T17:57:38.157315] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T17:57:38.218579] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T17:57:38.390696] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-03T17:57:39.190713] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-03T17:57:39.772913] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T17:57:39.990685] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-03T17:57:40.237098] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T17:57:40.790631] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-03T17:57:41.108047] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:57:41.590699] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-03T17:57:42.390620] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-03T17:57:42.545914] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T17:57:42.678397] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T17:57:43.190699] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-03T17:57:43.334315] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T17:57:43.990702] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-03T17:57:44.666866] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T17:57:44.790635] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-03T17:57:45.101354] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:57:45.590707] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-03T17:57:45.631051] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T17:57:46.390674] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-03T17:57:46.737512] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T17:57:47.063323] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T17:57:47.190716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-03T17:57:47.866456] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T17:57:47.990691] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-03T17:57:48.790699] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-03T17:57:49.590688] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-03T17:57:49.629799] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T17:57:50.380776] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T17:57:50.390608] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-03T17:57:50.803034] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T17:57:51.190688] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-03T17:57:51.206326] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T17:57:51.990719] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-03T17:57:52.603050] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:57:52.729898] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T17:57:52.790690] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-03T17:57:53.536410] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T17:57:53.537616] [INFO ] [REMOTE ] CDLR: Full fetch complete (13387 records). [2025-10-03T17:57:53.537751] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-03T17:57:53.596452] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-03T17:57:53.943118] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-03T17:57:53.943203] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-03T17:57:53.943565] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-03T17:57:53.943612] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-03T17:57:53.944217] [DEBUG] [LOCAL ] CDLR: Trimmed 13387 records to 10028 (keeping 200 days of data) [2025-10-03T17:57:54.012382] [DEBUG] [LOCAL ] CDLR: Primary data saved (10028 records). [2025-10-03T17:57:54.012544] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-03T17:57:54.012669] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CDLR took 23.9s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:57:54.194440] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:57:54.252615] [DEBUG] [LOCAL ] CE: Loaded 51874 existing records from primary storage. [2025-10-03T17:57:54.253009] [INFO ] [MAIN ] CE: Loaded 51874 existing records. [2025-10-03T17:57:54.395856] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-03T17:57:54.451881] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:57:54.452217] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-03T17:57:54.452275] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-03T17:57:54.453809] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-03T17:57:54.453873] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-03T17:57:54.844079] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:57:55.190761] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-03T17:57:55.252309] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T17:57:55.597871] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T17:57:55.990729] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-03T17:57:56.790629] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-03T17:57:57.148936] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T17:57:57.590696] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-03T17:57:57.805981] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T17:57:58.301451] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T17:57:58.390687] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-03T17:57:58.584134] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T17:57:59.190670] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-03T17:57:59.482526] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T17:57:59.990724] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-03T17:58:00.790636] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-03T17:58:01.168976] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T17:58:01.219864] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T17:58:01.590743] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-03T17:58:02.390706] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-03T17:58:02.596568] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T17:58:03.190703] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-03T17:58:03.377821] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:58:03.379418] [INFO ] [REMOTE ] CDRE: Full fetch complete (35123 records). [2025-10-03T17:58:03.379507] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-03T17:58:03.861355] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-03T17:58:03.861724] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-03T17:58:03.862932] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-03T17:58:03.863047] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-03T17:58:03.864602] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T17:58:03.878592] [DEBUG] [LOCAL ] CDRE: Trimmed 35123 records to 25295 (keeping 200 days of data) [2025-10-03T17:58:03.991326] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-03T17:58:04.046528] [DEBUG] [LOCAL ] CDRE: Primary data saved (25295 records). [2025-10-03T17:58:04.046715] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-03T17:58:04.046817] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CDRE took 30.9s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:58:04.230822] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:04.238918] [DEBUG] [LOCAL ] CEE: Loaded 5968 existing records from primary storage. [2025-10-03T17:58:04.239168] [INFO ] [MAIN ] CEE: Loaded 5968 existing records. [2025-10-03T17:58:04.440150] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:04.440441] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-03T17:58:04.440699] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-03T17:58:04.441148] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-03T17:58:04.441210] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-03T17:58:04.797669] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T17:58:04.796019] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-03T17:58:04.870771] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:05.590622] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-03T17:58:05.776605] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T17:58:06.390735] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-03T17:58:06.870423] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T17:58:07.021092] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T17:58:07.118094] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T17:58:07.190686] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-03T17:58:07.990730] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-03T17:58:08.563711] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-03T17:58:08.790727] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-03T17:58:09.410437] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T17:58:09.590715] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-03T17:58:10.390710] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-03T17:58:10.492739] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T17:58:11.190731] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-03T17:58:11.235580] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T17:58:11.489541] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T17:58:11.990685] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-03T17:58:12.790724] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-03T17:58:13.332430] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-03T17:58:13.335408] [INFO ] [REMOTE ] CDE: Full fetch complete (77584 records). [2025-10-03T17:58:13.335536] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-03T17:58:13.592448] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-03T17:58:13.780952] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-03T17:58:13.781112] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-03T17:58:13.782119] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-03T17:58:13.782251] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-03T17:58:13.784179] [DEBUG] [LOCAL ] CDE: Trimmed 77584 records to 54422 (keeping 200 days of data) [2025-10-03T17:58:13.958807] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T17:58:14.211953] [DEBUG] [LOCAL ] CDE: Primary data saved (54422 records). [2025-10-03T17:58:14.212179] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-03T17:58:14.212288] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDE took 47.7s. Estimated remaining: 4h 27m 42s. Rate: 7.3 symbols/min [2025-10-03T17:58:14.400171] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-03T17:58:14.432804] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T17:58:14.437896] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:14.475970] [DEBUG] [LOCAL ] CEPU: Loaded 26149 existing records from primary storage. [2025-10-03T17:58:14.476264] [INFO ] [MAIN ] CEPU: Loaded 26149 existing records. [2025-10-03T17:58:14.601324] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T17:58:14.695127] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:14.695370] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-03T17:58:14.695420] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-03T17:58:14.696184] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-03T17:58:14.696246] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-03T17:58:15.102476] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:15.190676] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-03T17:58:15.990665] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-03T17:58:16.236333] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T17:58:16.404215] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T17:58:16.683780] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T17:58:16.790695] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-03T17:58:17.590726] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-03T17:58:18.108908] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T17:58:18.390683] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-03T17:58:18.633748] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T17:58:19.190689] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-03T17:58:19.491350] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T17:58:19.990680] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-03T17:58:20.790634] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-03T17:58:20.858597] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T17:58:21.096937] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T17:58:21.165077] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T17:58:21.590689] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-03T17:58:21.955012] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-03T17:58:22.390702] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-03T17:58:23.190687] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-03T17:58:23.990674] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-03T17:58:24.196989] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:58:24.297069] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T17:58:24.790731] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-03T17:58:25.593120] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-03T17:58:25.885506] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T17:58:26.038796] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T17:58:26.051092] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T17:58:26.390684] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-03T17:58:27.148911] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T17:58:27.190679] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-03T17:58:27.990688] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-03T17:58:28.378036] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T17:58:28.380790] [INFO ] [REMOTE ] CDP: Full fetch complete (61914 records). [2025-10-03T17:58:28.380958] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-03T17:58:28.795792] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-03T17:58:28.819991] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-03T17:58:28.820099] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-03T17:58:28.820974] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-03T17:58:28.821153] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-03T17:58:28.822709] [DEBUG] [LOCAL ] CDP: Trimmed 61914 records to 43241 (keeping 200 days of data) [2025-10-03T17:58:29.115340] [DEBUG] [LOCAL ] CDP: Primary data saved (43241 records). [2025-10-03T17:58:29.115514] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-03T17:58:29.115672] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDP took 57.0s. Estimated remaining: 4h 28m 5s. Rate: 7.3 symbols/min [2025-10-03T17:58:29.301762] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T17:58:29.319281] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:29.379057] [DEBUG] [LOCAL ] CF: Loaded 52560 existing records from primary storage. [2025-10-03T17:58:29.380060] [INFO ] [MAIN ] CF: Loaded 52560 existing records. [2025-10-03T17:58:29.566131] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:29.566569] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-03T17:58:29.566692] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-03T17:58:29.568912] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-03T17:58:29.568979] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-03T17:58:29.601058] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-03T17:58:29.943869] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:30.390688] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-03T17:58:30.611217] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T17:58:30.719620] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T17:58:31.190708] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-03T17:58:31.990707] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-03T17:58:32.178141] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-03T17:58:32.225806] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:58:32.559490] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T17:58:32.560358] [INFO ] [REMOTE ] CEE: Full fetch complete (10183 records). [2025-10-03T17:58:32.560452] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-03T17:58:32.795847] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-03T17:58:32.969199] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-03T17:58:32.969286] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-03T17:58:32.969668] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-03T17:58:32.969732] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-03T17:58:32.970385] [DEBUG] [LOCAL ] CEE: Trimmed 10183 records to 5980 (keeping 200 days of data) [2025-10-03T17:58:33.007007] [DEBUG] [LOCAL ] CEE: Primary data saved (5980 records). [2025-10-03T17:58:33.007174] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-03T17:58:33.007272] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CEE took 29.0s. Estimated remaining: 4h 27m 36s. Rate: 7.3 symbols/min [2025-10-03T17:58:33.195209] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:33.256439] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-10-03T17:58:33.256844] [INFO ] [MAIN ] CFG: Loaded 54014 existing records. [2025-10-03T17:58:33.451756] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:33.451970] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-03T17:58:33.452052] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-03T17:58:33.453660] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-03T17:58:33.453730] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-03T17:58:33.604898] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-03T17:58:33.853901] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:34.175708] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:58:34.390727] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-03T17:58:34.967729] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T17:58:35.190703] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-03T17:58:35.990675] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-03T17:58:36.415878] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T17:58:36.416175] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T17:58:36.431575] [INFO ] [REMOTE ] CEPU: Full fetch complete (39601 records). [2025-10-03T17:58:36.431776] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-03T17:58:36.795797] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-03T17:58:36.840365] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-03T17:58:36.840459] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-03T17:58:36.841111] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-03T17:58:36.841180] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-03T17:58:36.842289] [DEBUG] [LOCAL ] CEPU: Trimmed 39601 records to 26369 (keeping 200 days of data) [2025-10-03T17:58:36.999143] [DEBUG] [LOCAL ] CEPU: Primary data saved (26369 records). [2025-10-03T17:58:36.999289] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-03T17:58:36.999375] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CEPU took 22.8s. Estimated remaining: 4h 27m 9s. Rate: 7.3 symbols/min [2025-10-03T17:58:37.188087] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:37.188288] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-03T17:58:37.188328] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-03T17:58:37.188467] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-03T17:58:37.188547] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-03T17:58:37.188601] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-03T17:58:37.188667] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-03T17:58:37.587400] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:37.590621] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-03T17:58:37.790765] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T17:58:37.794271] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-03T17:58:37.795049] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T17:58:37.796297] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:58:37.796516] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-03T17:58:37.807844] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T17:58:37.807933] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-03T17:58:37.808184] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-03T17:58:37.808236] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-03T17:58:37.808298] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-03T17:58:37.808386] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CFND took 0.8s. Estimated remaining: 4h 26m 27s. Rate: 7.3 symbols/min [2025-10-03T17:58:37.991850] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:38.026502] [DEBUG] [LOCAL ] CFR: Loaded 33393 existing records from primary storage. [2025-10-03T17:58:38.026811] [INFO ] [MAIN ] CFR: Loaded 33393 existing records. [2025-10-03T17:58:38.211455] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:58:38.211690] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-03T17:58:38.211748] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-03T17:58:38.212955] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-03T17:58:38.213017] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-03T17:58:38.395819] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-03T17:58:38.596804] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:38.634425] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T17:58:39.190674] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-03T17:58:39.990664] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-03T17:58:40.137459] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T17:58:40.140200] [INFO ] [REMOTE ] CE: Full fetch complete (74821 records). [2025-10-03T17:58:40.140325] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-03T17:58:40.572271] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-03T17:58:40.572441] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-03T17:58:40.573476] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-03T17:58:40.573567] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-03T17:58:40.592208] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T17:58:40.599729] [DEBUG] [LOCAL ] CE: Trimmed 74821 records to 52243 (keeping 200 days of data) [2025-10-03T17:58:40.795067] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-03T17:58:40.934942] [DEBUG] [LOCAL ] CE: Primary data saved (52243 records). [2025-10-03T17:58:40.935121] [INFO ] [MAIN ] CE: Full history saved. [2025-10-03T17:58:40.935926] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CE took 46.9s. Estimated remaining: 4h 25m 55s. Rate: 7.3 symbols/min [2025-10-03T17:58:41.129865] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:58:41.130043] [DEBUG] [LOCAL ] CGAU: No existing data file found in primary storage. [2025-10-03T17:58:41.130081] [WARN ] [MAIN ] CGAU: No existing data found, performing full refresh instead. [2025-10-03T17:58:41.130210] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-03T17:58:41.130253] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-03T17:58:41.130295] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-03T17:58:41.130329] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-03T17:58:41.552869] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:58:41.590676] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-03T17:58:41.718333] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T17:58:42.395755] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-03T17:58:42.417763] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:58:42.971971] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T17:58:43.190675] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-03T17:58:43.990713] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-03T17:58:44.144350] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T17:58:44.790751] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-03T17:58:45.027717] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T17:58:45.288741] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T17:58:45.590737] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-03T17:58:46.060246] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T17:58:46.390707] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-03T17:58:47.190638] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-03T17:58:47.469076] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T17:58:47.925630] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T17:58:47.990713] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-03T17:58:48.624005] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T17:58:48.790685] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-03T17:58:49.590694] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-03T17:58:49.740758] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T17:58:50.258978] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T17:58:50.390690] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-03T17:58:51.190680] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-03T17:58:51.339176] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T17:58:51.990681] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-03T17:58:52.030486] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T17:58:52.282460] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T17:58:52.790695] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-03T17:58:53.590698] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-03T17:58:53.696034] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T17:58:53.842501] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T17:58:54.390726] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-03T17:58:55.190682] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-03T17:58:55.399783] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:58:55.442096] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T17:58:55.990739] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-03T17:58:56.790681] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-03T17:58:56.962898] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T17:58:57.479884] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T17:58:57.590670] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-03T17:58:58.224793] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T17:58:58.390710] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-03T17:58:59.067083] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T17:58:59.190692] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-03T17:58:59.990631] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-03T17:59:00.203312] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:59:00.790720] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-03T17:59:00.838056] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T17:59:00.842479] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-03T17:59:00.842768] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-03T17:59:01.539142] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-03T17:59:01.549480] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T17:59:01.548111] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-03T17:59:01.557791] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-03T17:59:01.558870] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-03T17:59:01.561047] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54404 (keeping 200 days of data) [2025-10-03T17:59:01.632333] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-03T17:59:01.951289] [DEBUG] [LOCAL ] CFG: Primary data saved (54404 records). [2025-10-03T17:59:01.951448] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-03T17:59:01.952442] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CFG took 28.9s. Estimated remaining: 4h 26m 45s. Rate: 7.3 symbols/min [2025-10-03T17:59:02.134789] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:02.139027] [DEBUG] [LOCAL ] CGV: Loaded 1408 existing records from primary storage. [2025-10-03T17:59:02.139187] [INFO ] [MAIN ] CGV: Loaded 1408 existing records. [2025-10-03T17:59:02.333900] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:02.334295] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-03T17:59:02.334409] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-03T17:59:02.334920] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-03T17:59:02.335068] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-03T17:59:02.398553] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-03T17:59:02.673572] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T17:59:02.794599] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:02.812397] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T17:59:03.190675] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-03T17:59:03.755102] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T17:59:03.990690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-03T17:59:04.513368] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-03T17:59:04.790667] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-03T17:59:05.078088] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T17:59:05.590737] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-03T17:59:06.002301] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T17:59:06.040786] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-03T17:59:06.390702] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-03T17:59:07.190680] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-03T17:59:07.813044] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T17:59:07.990691] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-03T17:59:08.565927] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T17:59:08.568723] [INFO ] [REMOTE ] CF: Full fetch complete (75262 records). [2025-10-03T17:59:08.568864] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-03T17:59:08.795924] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-03T17:59:09.010390] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-03T17:59:09.010498] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-03T17:59:09.011519] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-03T17:59:09.011603] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-03T17:59:09.013405] [DEBUG] [LOCAL ] CF: Trimmed 75262 records to 52917 (keeping 200 days of data) [2025-10-03T17:59:09.268532] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T17:59:09.389542] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T17:59:09.396272] [DEBUG] [LOCAL ] CF: Primary data saved (52917 records). [2025-10-03T17:59:09.396408] [INFO ] [MAIN ] CF: Full history saved. [2025-10-03T17:59:09.396493] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CF took 40.3s. Estimated remaining: 4h 26m 33s. Rate: 7.3 symbols/min [2025-10-03T17:59:09.584475] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:09.584671] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-03T17:59:09.584730] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-03T17:59:09.584880] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-03T17:59:09.584925] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-03T17:59:09.584969] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-03T17:59:09.585004] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-03T17:59:09.596090] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-03T17:59:09.971477] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:10.107928] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T17:59:10.390701] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-03T17:59:10.747279] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T17:59:11.190675] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-03T17:59:11.525411] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-03T17:59:11.990700] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-03T17:59:12.790698] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-03T17:59:13.190610] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T17:59:13.590699] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-03T17:59:14.390684] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-03T17:59:14.710333] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T17:59:14.919933] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-03T17:59:14.942097] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T17:59:15.190690] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-03T17:59:15.673191] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T17:59:15.990707] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-03T17:59:16.790700] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-03T17:59:17.137426] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T17:59:17.590621] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-03T17:59:17.773370] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T17:59:18.390685] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-03T17:59:18.907543] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T17:59:19.095253] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T17:59:19.190727] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-03T17:59:19.990679] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-03T17:59:20.366528] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T17:59:20.790691] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-03T17:59:21.058166] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T17:59:21.060134] [INFO ] [REMOTE ] CFR: Full fetch complete (48528 records). [2025-10-03T17:59:21.060256] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-03T17:59:21.228914] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T17:59:21.479049] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-03T17:59:21.479132] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-03T17:59:21.479776] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-03T17:59:21.479852] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-03T17:59:21.481093] [DEBUG] [LOCAL ] CFR: Trimmed 48528 records to 33593 (keeping 200 days of data) [2025-10-03T17:59:21.594713] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-03T17:59:21.713475] [DEBUG] [LOCAL ] CFR: Primary data saved (33593 records). [2025-10-03T17:59:21.713662] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-03T17:59:21.713773] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFR took 43.9s. Estimated remaining: 4h 26m 43s. Rate: 7.3 symbols/min [2025-10-03T17:59:21.895832] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:21.946771] [DEBUG] [LOCAL ] CHD: Loaded 52490 existing records from primary storage. [2025-10-03T17:59:21.947133] [INFO ] [MAIN ] CHD: Loaded 52490 existing records. [2025-10-03T17:59:22.149200] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:22.149448] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-03T17:59:22.149500] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-03T17:59:22.151181] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-03T17:59:22.151243] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-03T17:59:22.401548] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-03T17:59:22.537902] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:22.961008] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T17:59:22.961964] [INFO ] [REMOTE ] CGV: Full fetch complete (2275 records). [2025-10-03T17:59:22.962076] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-03T17:59:23.204920] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-03T17:59:23.237441] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T17:59:23.293569] [INFO ] [REMOTE ] CGAU: Full fetch complete (61011 records). [2025-10-03T17:59:23.311747] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-03T17:59:23.560089] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-03T17:59:23.584852] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-03T17:59:23.599403] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-03T17:59:23.641046] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-03T17:59:23.711133] [DEBUG] [LOCAL ] CGV: Trimmed 2275 records to 1411 (keeping 200 days of data) [2025-10-03T17:59:23.796978] [DEBUG] [LOCAL ] CGV: Primary data saved (1411 records). [2025-10-03T17:59:23.816759] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-03T17:59:23.853276] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CGV took 21.9s. Estimated remaining: 4h 26m 7s. Rate: 7.3 symbols/min [2025-10-03T17:59:23.861832] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-03T17:59:23.904559] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-03T17:59:23.934120] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-03T17:59:23.945545] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-03T17:59:23.991821] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-03T17:59:24.045886] [DEBUG] [LOCAL ] CGAU: Trimmed 61011 records to 43455 (keeping 200 days of data) [2025-10-03T17:59:24.049872] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:24.159539] [DEBUG] [LOCAL ] CHE: Loaded 15178 existing records from primary storage. [2025-10-03T17:59:24.162371] [INFO ] [MAIN ] CHE: Loaded 15178 existing records. [2025-10-03T17:59:24.380084] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:24.383753] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-03T17:59:24.383835] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-03T17:59:24.385192] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-03T17:59:24.385299] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-03T17:59:24.964830] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:24.968543] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-03T17:59:24.970735] [DEBUG] [LOCAL ] CGAU: Primary data saved (43455 records). [2025-10-03T17:59:24.972166] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-03T17:59:24.972426] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 44.0s. Estimated remaining: 4h 25m 27s. Rate: 7.3 symbols/min [2025-10-03T17:59:25.167705] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:25.198825] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T17:59:25.248914] [DEBUG] [LOCAL ] CHGG: Loaded 47996 existing records from primary storage. [2025-10-03T17:59:25.249323] [INFO ] [MAIN ] CHGG: Loaded 47996 existing records. [2025-10-03T17:59:25.465753] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:25.466204] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-03T17:59:25.467450] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T17:59:25.466684] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-03T17:59:25.473889] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-03T17:59:25.474084] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-03T17:59:25.590634] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-03T17:59:25.896384] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:25.898578] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T17:59:26.390628] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-03T17:59:26.492606] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T17:59:27.190685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-03T17:59:27.796409] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T17:59:27.990698] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-03T17:59:28.790720] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-03T17:59:29.028135] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T17:59:29.069119] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T17:59:29.590718] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-03T17:59:29.828630] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T17:59:30.390710] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-03T17:59:31.195793] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-03T17:59:31.214264] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T17:59:31.662160] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T17:59:31.990698] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-03T17:59:32.799235] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-03T17:59:32.818204] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T17:59:32.957573] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T17:59:33.590725] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-03T17:59:33.671212] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T17:59:34.390723] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-03T17:59:34.569670] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T17:59:35.190714] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-03T17:59:35.990704] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-03T17:59:36.174751] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T17:59:36.789469] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T17:59:36.798892] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-03T17:59:36.980229] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T17:59:36.981702] [INFO ] [REMOTE ] CHCT: Full fetch complete (34928 records). [2025-10-03T17:59:36.981785] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-03T17:59:37.402690] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-03T17:59:37.402812] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-03T17:59:37.403370] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-03T17:59:37.403453] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-03T17:59:37.404633] [DEBUG] [LOCAL ] CHCT: Trimmed 34928 records to 24161 (keeping 200 days of data) [2025-10-03T17:59:37.565808] [DEBUG] [LOCAL ] CHCT: Primary data saved (24161 records). [2025-10-03T17:59:37.565957] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-03T17:59:37.566051] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CHCT took 28.2s. Estimated remaining: 4h 25m 39s. Rate: 7.3 symbols/min [2025-10-03T17:59:37.603516] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-03T17:59:37.782630] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:37.819135] [DEBUG] [LOCAL ] CHH: Loaded 32209 existing records from primary storage. [2025-10-03T17:59:37.819446] [INFO ] [MAIN ] CHH: Loaded 32209 existing records. [2025-10-03T17:59:38.017481] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:38.017728] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-03T17:59:38.017815] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-03T17:59:38.018131] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-03T17:59:38.018190] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-03T17:59:38.391149] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-03T17:59:38.426305] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:38.723432] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T17:59:39.190639] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-03T17:59:39.473451] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T17:59:39.631492] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T17:59:39.990722] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-03T17:59:40.790685] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-03T17:59:40.992175] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T17:59:41.005744] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T17:59:41.590686] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-03T17:59:42.356428] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T17:59:42.390626] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-03T17:59:42.755174] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T17:59:43.190696] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-03T17:59:43.797040] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T17:59:43.990694] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-03T17:59:44.522818] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T17:59:44.790711] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-03T17:59:45.590718] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-03T17:59:45.951041] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T17:59:46.390637] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-03T17:59:46.701299] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T17:59:46.778582] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T17:59:47.190637] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-03T17:59:47.419545] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T17:59:47.990716] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-03T17:59:48.790736] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-03T17:59:49.003929] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T17:59:49.482348] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T17:59:49.568378] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T17:59:49.590684] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-03T17:59:50.390763] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-03T17:59:51.190712] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-03T17:59:51.461865] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T17:59:51.990676] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-03T17:59:52.278807] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T17:59:52.312959] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T17:59:52.790727] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-03T17:59:53.602292] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-03T17:59:53.638689] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T17:59:54.390708] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-03T17:59:54.562398] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T17:59:54.608315] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T17:59:55.190697] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-03T17:59:55.990740] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-03T17:59:56.201806] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T17:59:56.313785] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T17:59:56.790716] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-03T17:59:57.361884] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T17:59:57.590782] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-03T17:59:58.390702] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-03T17:59:58.489282] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T17:59:58.490781] [INFO ] [REMOTE ] CHE: Full fetch complete (20121 records). [2025-10-03T17:59:58.490884] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-03T17:59:58.848398] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T17:59:58.980342] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-03T17:59:58.980429] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-03T17:59:58.980844] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-03T17:59:58.980910] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-03T17:59:58.981539] [DEBUG] [LOCAL ] CHE: Trimmed 20121 records to 15300 (keeping 200 days of data) [2025-10-03T17:59:59.082610] [DEBUG] [LOCAL ] CHE: Primary data saved (15300 records). [2025-10-03T17:59:59.082781] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-03T17:59:59.082917] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CHE took 35.2s. Estimated remaining: 4h 26m 29s. Rate: 7.3 symbols/min [2025-10-03T17:59:59.195830] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-03T17:59:59.271525] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T17:59:59.296259] [DEBUG] [LOCAL ] CHMI: Loaded 22017 existing records from primary storage. [2025-10-03T17:59:59.296554] [INFO ] [MAIN ] CHMI: Loaded 22017 existing records. [2025-10-03T17:59:59.491816] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T17:59:59.492079] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-03T17:59:59.492134] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-03T17:59:59.492376] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-03T17:59:59.492442] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-03T17:59:59.890759] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T17:59:59.990723] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-03T18:00:00.017215] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:00:00.020007] [INFO ] [REMOTE ] CHGG: Full fetch complete (70444 records). [2025-10-03T18:00:00.020169] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-03T18:00:00.438245] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-03T18:00:00.438340] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-03T18:00:00.439292] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-03T18:00:00.439368] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-03T18:00:00.441079] [DEBUG] [LOCAL ] CHGG: Trimmed 70444 records to 48372 (keeping 200 days of data) [2025-10-03T18:00:00.748978] [DEBUG] [LOCAL ] CHGG: Primary data saved (48372 records). [2025-10-03T18:00:00.749200] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-03T18:00:00.750191] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHGG took 35.8s. Estimated remaining: 4h 25m 52s. Rate: 7.3 symbols/min [2025-10-03T18:00:00.798971] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:00:00.792081] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-03T18:00:00.827440] [INFO ] [REMOTE ] CHD: Full fetch complete (74413 records). [2025-10-03T18:00:00.851721] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-03T18:00:01.084509] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:01.178542] [DEBUG] [LOCAL ] CHN: Loaded 4849 existing records from primary storage. [2025-10-03T18:00:01.202126] [INFO ] [MAIN ] CHN: Loaded 4849 existing records. [2025-10-03T18:00:01.652499] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:00:01.721534] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:01.721782] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-03T18:00:01.722046] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-03T18:00:01.722176] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-03T18:00:01.722127] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-03T18:00:01.723447] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-03T18:00:01.729900] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-03T18:00:01.723382] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-03T18:00:01.730199] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-03T18:00:01.729757] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-03T18:00:01.848715] [DEBUG] [LOCAL ] CHD: Trimmed 74413 records to 52856 (keeping 200 days of data) [2025-10-03T18:00:02.303280] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:02.347059] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T18:00:02.424706] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-03T18:00:02.588136] [DEBUG] [LOCAL ] CHD: Primary data saved (52856 records). [2025-10-03T18:00:02.588316] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-03T18:00:02.588410] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHD took 40.9s. Estimated remaining: 4h 25m 15s. Rate: 7.3 symbols/min [2025-10-03T18:00:03.117884] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:00:03.190712] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-03T18:00:03.990722] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-03T18:00:04.029716] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T18:00:04.666296] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T18:00:04.790682] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-03T18:00:05.112045] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:00:05.590698] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-03T18:00:06.152829] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:00:06.192705] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:00:06.390724] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-03T18:00:07.190703] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-03T18:00:07.856720] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:00:07.990774] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-03T18:00:08.346957] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:00:08.430084] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:00:08.790740] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-03T18:00:09.385157] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T18:00:09.590732] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-03T18:00:10.390701] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-03T18:00:10.924800] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T18:00:11.102116] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T18:00:11.190706] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-03T18:00:11.990699] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-03T18:00:12.494455] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:00:12.624420] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:00:12.790696] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-03T18:00:13.590742] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-03T18:00:13.980148] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:00:13.982091] [INFO ] [REMOTE ] CHH: Full fetch complete (46744 records). [2025-10-03T18:00:13.982179] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-03T18:00:14.309707] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T18:00:14.395880] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-03T18:00:14.454239] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-03T18:00:14.454336] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-03T18:00:14.455872] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-03T18:00:14.455972] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-03T18:00:14.458092] [DEBUG] [LOCAL ] CHH: Trimmed 46744 records to 32481 (keeping 200 days of data) [2025-10-03T18:00:14.691538] [DEBUG] [LOCAL ] CHH: Primary data saved (32481 records). [2025-10-03T18:00:14.691723] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-03T18:00:14.691909] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHH took 37.1s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-03T18:00:15.013433] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:00:15.190705] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-03T18:00:15.834826] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:00:15.990739] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-03T18:00:16.657306] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:00:16.790702] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-03T18:00:17.590713] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-03T18:00:17.920740] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:00:18.121333] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T18:00:18.122343] [INFO ] [REMOTE ] CHN: Full fetch complete (7434 records). [2025-10-03T18:00:18.122439] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-03T18:00:18.397091] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-03T18:00:18.526958] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-03T18:00:18.527048] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-03T18:00:18.527287] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-03T18:00:18.527329] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-03T18:00:18.527857] [DEBUG] [LOCAL ] CHN: Trimmed 7434 records to 4866 (keeping 200 days of data) [2025-10-03T18:00:18.558280] [DEBUG] [LOCAL ] CHN: Primary data saved (4866 records). [2025-10-03T18:00:18.558443] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-03T18:00:18.558595] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHN took 17.8s. Estimated remaining: 4h 24m 57s. Rate: 7.3 symbols/min [2025-10-03T18:00:19.720941] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:00:19.726462] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-03T18:00:20.755588] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:00:20.760856] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-03T18:00:21.855383] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:00:21.861523] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-03T18:00:22.994501] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T18:00:22.995882] [INFO ] [REMOTE ] CHMI: Full fetch complete (31836 records). [2025-10-03T18:00:22.995958] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-03T18:00:23.423941] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-03T18:00:23.424038] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-03T18:00:23.424562] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-03T18:00:23.424662] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-03T18:00:23.425617] [DEBUG] [LOCAL ] CHMI: Trimmed 31836 records to 22168 (keeping 200 days of data) [2025-10-03T18:00:23.567257] [DEBUG] [LOCAL ] CHMI: Primary data saved (22168 records). [2025-10-03T18:00:23.567401] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-03T18:00:23.567500] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHMI took 24.5s. Estimated remaining: 4h 24m 34s. Rate: 7.3 symbols/min [2025-10-03T18:00:24.221568] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.347497] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.435832] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.437748] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:24.437893] [DEBUG] [LOCAL ] CHPT: No existing data file found in primary storage. [2025-10-03T18:00:24.438030] [WARN ] [MAIN ] CHPT: No existing data found, performing full refresh instead. [2025-10-03T18:00:24.438940] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-03T18:00:24.438991] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-03T18:00:24.439037] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-03T18:00:24.439071] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-03T18:00:24.581762] [DEBUG] [LOCAL ] CHT: Loaded 19829 existing records from primary storage. [2025-10-03T18:00:24.609796] [INFO ] [MAIN ] CHT: Loaded 19829 existing records. [2025-10-03T18:00:25.054526] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-10-03T18:00:25.158099] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.122071] [INFO ] [MAIN ] CHWY: Loaded 54044 existing records. [2025-10-03T18:00:25.213623] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.179891] [DEBUG] [LOCAL ] CI: Loaded 50086 existing records from primary storage. [2025-10-03T18:00:25.229237] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-03T18:00:25.291756] [INFO ] [MAIN ] CI: Loaded 50086 existing records. [2025-10-03T18:00:25.354942] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:25.372259] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-03T18:00:25.382790] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-03T18:00:25.428281] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-03T18:00:25.626390] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.721715] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.759479] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-03T18:00:25.774550] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:25.821377] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-03T18:00:25.821496] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-03T18:00:25.855918] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-03T18:00:25.885706] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-03T18:00:25.875743] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-03T18:00:25.908797] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-03T18:00:26.352760] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.425968] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-03T18:00:26.962273] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.971844] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-03T18:00:26.971284] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:26.973281] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-03T18:00:27.662943] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:00:27.668201] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-03T18:00:27.848061] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:00:27.859921] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-03T18:00:28.320204] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:00:28.324324] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-03T18:00:28.865584] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:00:28.877737] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-03T18:00:29.043083] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T18:00:29.048308] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-03T18:00:29.370908] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-10-03T18:00:29.382604] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-03T18:00:30.065755] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:00:30.071585] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-03T18:00:30.178889] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-03T18:00:30.390615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-03T18:00:30.741004] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T18:00:31.190673] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-03T18:00:31.263534] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:00:31.290122] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T18:00:31.990721] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-03T18:00:32.670635] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-10-03T18:00:32.790615] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-03T18:00:33.000442] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:00:33.182514] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T18:00:33.590691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-03T18:00:34.390614] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-03T18:00:34.893960] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T18:00:35.190717] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-03T18:00:35.429693] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:00:35.453895] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:00:35.990744] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-03T18:00:36.790756] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-03T18:00:36.854909] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:00:36.957445] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T18:00:37.590712] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-03T18:00:38.390734] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-03T18:00:39.190744] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-03T18:00:39.392555] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:00:39.617388] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-03T18:00:39.990709] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-03T18:00:40.502713] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:00:40.548928] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:00:40.790698] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-03T18:00:41.590738] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-03T18:00:42.043155] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T18:00:42.070989] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T18:00:42.390721] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-03T18:00:43.190724] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-03T18:00:43.780500] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-10-03T18:00:43.824628] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T18:00:43.990686] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-03T18:00:44.790631] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-03T18:00:45.160140] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:00:45.590702] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-03T18:00:45.881814] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:00:45.885185] [INFO ] [REMOTE ] CHT: Full fetch complete (27489 records). [2025-10-03T18:00:45.885265] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-03T18:00:46.316523] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-03T18:00:46.316714] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-03T18:00:46.317201] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-03T18:00:46.317282] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-03T18:00:46.328609] [DEBUG] [LOCAL ] CHT: Trimmed 27489 records to 19918 (keeping 200 days of data) [2025-10-03T18:00:46.349676] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-03T18:00:46.398706] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-03T18:00:46.482271] [DEBUG] [LOCAL ] CHT: Primary data saved (19918 records). [2025-10-03T18:00:46.482419] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-03T18:00:46.482505] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CHT took 22.9s. Estimated remaining: 4h 25m 30s. Rate: 7.3 symbols/min [2025-10-03T18:00:46.670304] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:46.688293] [DEBUG] [LOCAL ] CIA: Loaded 17134 existing records from primary storage. [2025-10-03T18:00:46.688596] [INFO ] [MAIN ] CIA: Loaded 17134 existing records. [2025-10-03T18:00:46.899324] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:00:46.899586] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-03T18:00:46.899679] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-03T18:00:46.899928] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-03T18:00:46.900004] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-03T18:00:47.196779] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-03T18:00:47.341099] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:47.379513] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:00:47.990629] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-03T18:00:48.443040] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T18:00:48.790706] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-03T18:00:49.590756] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-03T18:00:49.954803] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T18:00:50.390681] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-03T18:00:50.475533] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:00:50.589989] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:00:51.190691] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-03T18:00:51.505956] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (4.31 seconds). [2025-10-03T18:00:51.990718] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-03T18:00:52.468328] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T18:00:52.724098] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:00:52.790696] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-03T18:00:53.590712] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-03T18:00:53.653411] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:00:54.360232] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:00:54.363105] [INFO ] [REMOTE ] CI: Full fetch complete (72362 records). [2025-10-03T18:00:54.363260] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-03T18:00:54.395783] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-03T18:00:54.794456] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-03T18:00:54.794547] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-03T18:00:54.795362] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-03T18:00:54.795431] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-03T18:00:54.796950] [DEBUG] [LOCAL ] CI: Trimmed 72362 records to 50475 (keeping 200 days of data) [2025-10-03T18:00:55.137505] [DEBUG] [LOCAL ] CI: Primary data saved (50475 records). [2025-10-03T18:00:55.137667] [INFO ] [MAIN ] CI: Full history saved. [2025-10-03T18:00:55.139066] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CI took 31.5s. Estimated remaining: 4h 25m 24s. Rate: 7.3 symbols/min [2025-10-03T18:00:55.195774] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-03T18:00:55.344005] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:00:55.344270] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-03T18:00:55.344347] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-03T18:00:55.344561] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-03T18:00:55.344609] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-03T18:00:55.344694] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-03T18:00:55.344748] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-03T18:00:55.444250] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:00:55.761275] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:00:55.796866] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T18:00:55.990730] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-03T18:00:56.790635] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-03T18:00:56.971349] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:00:57.041885] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T18:00:57.590758] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-03T18:00:57.757739] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:00:58.390728] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-03T18:00:58.961338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:00:59.190693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-03T18:00:59.723370] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T18:00:59.725850] [INFO ] [REMOTE ] CHPT: Full fetch complete (72573 records). [2025-10-03T18:00:59.725990] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-03T18:00:59.996594] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-03T18:01:00.203185] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-03T18:01:00.203327] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-03T18:01:00.204435] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-03T18:01:00.204512] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-03T18:01:00.211956] [DEBUG] [LOCAL ] CHPT: Trimmed 72573 records to 49254 (keeping 200 days of data) [2025-10-03T18:01:00.528325] [DEBUG] [LOCAL ] CHPT: Primary data saved (49254 records). [2025-10-03T18:01:00.528510] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-03T18:01:00.528669] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHPT took 37.0s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-03T18:01:00.722212] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:00.722446] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-03T18:01:00.722510] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-03T18:01:00.722685] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-03T18:01:00.722757] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-03T18:01:00.722830] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-03T18:01:00.722869] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-03T18:01:00.801018] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-03T18:01:01.150524] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:01.233900] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:01:01.278781] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T18:01:01.590693] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-03T18:01:02.390762] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-03T18:01:02.934294] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-03T18:01:03.190722] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-03T18:01:03.234374] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T18:01:03.237241] [INFO ] [REMOTE ] CHWY: Full fetch complete (77633 records). [2025-10-03T18:01:03.237410] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-03T18:01:03.420356] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:01:03.724592] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-03T18:01:03.724946] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-03T18:01:03.726315] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-03T18:01:03.726388] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-03T18:01:03.728711] [DEBUG] [LOCAL ] CHWY: Trimmed 77633 records to 54434 (keeping 200 days of data) [2025-10-03T18:01:03.991004] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-03T18:01:04.179594] [DEBUG] [LOCAL ] CHWY: Primary data saved (54434 records). [2025-10-03T18:01:04.179855] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-03T18:01:04.179981] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHWY took 40.6s. Estimated remaining: 4h 24m 35s. Rate: 7.3 symbols/min [2025-10-03T18:01:04.472059] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:04.472465] [DEBUG] [LOCAL ] CIEN: No existing data file found in primary storage. [2025-10-03T18:01:04.472698] [WARN ] [MAIN ] CIEN: No existing data found, performing full refresh instead. [2025-10-03T18:01:04.472943] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-03T18:01:04.473010] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-03T18:01:04.473084] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-03T18:01:04.473144] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-03T18:01:04.795787] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-03T18:01:04.817682] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:01:05.016753] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:05.590731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-03T18:01:05.808767] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:01:06.390691] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-03T18:01:07.139404] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-10-03T18:01:07.163984] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T18:01:07.190631] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-03T18:01:07.990743] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-03T18:01:08.579511] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:01:08.790708] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-03T18:01:09.590697] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-03T18:01:11.491587] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:01:11.507414] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-03T18:01:11.537087] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (5.15 seconds). [2025-10-03T18:01:11.543409] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-03T18:01:12.559986] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:01:12.565286] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-03T18:01:13.189370] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T18:01:13.201270] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-03T18:01:14.195271] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (7.00 seconds). [2025-10-03T18:01:14.202719] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-03T18:01:14.822139] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (6.03 seconds). [2025-10-03T18:01:14.823476] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-03T18:01:14.922610] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:01:15.190713] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-03T18:01:15.285165] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-03T18:01:15.305985] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T18:01:15.990692] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-03T18:01:16.792335] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T18:01:16.792183] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-03T18:01:16.994468] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:01:17.595768] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-03T18:01:17.602964] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (5.04 seconds). [2025-10-03T18:01:17.715822] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:01:18.091856] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T18:01:18.390697] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-03T18:01:19.190699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-03T18:01:19.401939] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:01:19.990726] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-03T18:01:20.735406] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:01:20.736580] [INFO ] [REMOTE ] CIA: Full fetch complete (23474 records). [2025-10-03T18:01:20.736715] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-03T18:01:20.737299] [FATAL] [VALIDATOR ] CIA: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:01:20.737386] [FATAL] [MAIN ] CIA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:01:20.737432] [WARN ] [MAIN ] CIA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:01:20.737472] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-03T18:01:20.737543] [DEBUG] [LOCAL ] CIA: No primary data file found to delete. [2025-10-03T18:01:20.737600] [INFO ] [LOCAL ] CIA: Starting deletion of derivative data. [2025-10-03T18:01:20.738093] [DEBUG] [LOCAL ] CIA: Deleted derivative data file. [2025-10-03T18:01:20.738224] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CIA took 34.3s. Estimated remaining: 4h 25m 3s. Rate: 7.3 symbols/min [2025-10-03T18:01:20.795928] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-03T18:01:20.935285] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:20.942688] [DEBUG] [LOCAL ] CIF: Loaded 4220 existing records from primary storage. [2025-10-03T18:01:20.942916] [INFO ] [MAIN ] CIF: Loaded 4220 existing records. [2025-10-03T18:01:21.189253] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:21.189823] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-03T18:01:21.192291] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:01:21.190380] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-03T18:01:21.204306] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-03T18:01:21.204891] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-03T18:01:21.324824] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-03T18:01:21.599578] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-03T18:01:21.622739] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:22.024681] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T18:01:22.390741] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-03T18:01:23.153118] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T18:01:23.190626] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-03T18:01:23.787338] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:01:23.990750] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-03T18:01:24.258100] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-03T18:01:24.790745] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-03T18:01:25.590704] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-03T18:01:25.927925] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T18:01:26.390693] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-03T18:01:26.577589] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:01:26.785909] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T18:01:26.786579] [INFO ] [REMOTE ] CICB: Full fetch complete (2045 records). [2025-10-03T18:01:26.786675] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-03T18:01:27.063777] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T18:01:27.064032] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:01:27.064125] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:01:27.064223] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-03T18:01:27.064309] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-03T18:01:27.064350] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-03T18:01:27.064393] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-03T18:01:27.064452] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CICB took 26.5s. Estimated remaining: 4h 24m 46s. Rate: 7.3 symbols/min [2025-10-03T18:01:27.195855] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-03T18:01:27.246231] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:27.246403] [DEBUG] [LOCAL ] CIG: No existing data file found in primary storage. [2025-10-03T18:01:27.246507] [WARN ] [MAIN ] CIG: No existing data found, performing full refresh instead. [2025-10-03T18:01:27.246627] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-03T18:01:27.246706] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-03T18:01:27.246763] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-03T18:01:27.246801] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-03T18:01:27.658121] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:27.805372] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T18:01:27.990689] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-03T18:01:28.701961] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-03T18:01:28.790697] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-03T18:01:29.590725] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-03T18:01:30.257967] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T18:01:30.390733] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-03T18:01:31.190769] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-03T18:01:31.820426] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (3.03 seconds). [2025-10-03T18:01:31.990700] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-03T18:01:32.223408] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:01:32.790727] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-03T18:01:33.346198] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:01:33.590724] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-03T18:01:34.018622] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-10-03T18:01:34.084217] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:01:34.390732] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-03T18:01:35.190634] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-03T18:01:35.317454] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:01:35.708310] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:01:35.990700] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-03T18:01:36.297577] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:01:36.299400] [INFO ] [REMOTE ] CIB: Full fetch complete (44576 records). [2025-10-03T18:01:36.299492] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-03T18:01:36.730366] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-03T18:01:36.730486] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-03T18:01:36.731143] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-03T18:01:36.731212] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-03T18:01:36.732517] [DEBUG] [LOCAL ] CIB: Trimmed 44576 records to 31243 (keeping 200 days of data) [2025-10-03T18:01:36.810387] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-03T18:01:36.956991] [DEBUG] [LOCAL ] CIB: Primary data saved (31243 records). [2025-10-03T18:01:36.957153] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-03T18:01:36.957237] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CIB took 41.8s. Estimated remaining: 4h 24m 45s. Rate: 7.3 symbols/min [2025-10-03T18:01:37.147763] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:37.147962] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-10-03T18:01:37.148120] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-10-03T18:01:37.148250] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-03T18:01:37.148294] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-03T18:01:37.148340] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-03T18:01:37.148375] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-03T18:01:37.566711] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:37.590715] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-03T18:01:38.107153] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T18:01:38.390638] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-03T18:01:38.649522] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:01:39.190733] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-03T18:01:39.750553] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T18:01:39.927702] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:01:39.990727] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-03T18:01:40.790706] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-03T18:01:41.432853] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:01:41.478891] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T18:01:41.534795] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (4.72 seconds). [2025-10-03T18:01:41.590737] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-03T18:01:42.390725] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-03T18:01:42.556395] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:01:43.190730] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-03T18:01:43.819710] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:01:43.990693] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-03T18:01:44.168368] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:01:44.790720] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-03T18:01:45.446329] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T18:01:45.590706] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-03T18:01:46.211238] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:01:46.212028] [INFO ] [REMOTE ] CIF: Full fetch complete (6604 records). [2025-10-03T18:01:46.212100] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-03T18:01:46.397206] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-03T18:01:46.623070] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-03T18:01:46.623190] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-03T18:01:46.623456] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-03T18:01:46.623523] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-03T18:01:46.624051] [DEBUG] [LOCAL ] CIF: Trimmed 6604 records to 4246 (keeping 200 days of data) [2025-10-03T18:01:46.650975] [DEBUG] [LOCAL ] CIF: Primary data saved (4246 records). [2025-10-03T18:01:46.651130] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-03T18:01:46.651220] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CIF took 25.9s. Estimated remaining: 4h 24m 43s. Rate: 7.3 symbols/min [2025-10-03T18:01:46.830565] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:46.874474] [DEBUG] [LOCAL ] CIM: Loaded 37813 existing records from primary storage. [2025-10-03T18:01:46.874805] [INFO ] [MAIN ] CIM: Loaded 37813 existing records. [2025-10-03T18:01:47.081473] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:47.081779] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-03T18:01:47.081835] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-03T18:01:47.082227] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-03T18:01:47.082292] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-03T18:01:47.192817] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-03T18:01:47.488353] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:47.585458] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T18:01:47.990726] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-03T18:01:48.270589] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (4.28 seconds). [2025-10-03T18:01:48.790706] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-03T18:01:49.227592] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:01:49.272624] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T18:01:49.590744] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-03T18:01:49.998206] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-03T18:01:50.251637] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T18:01:50.390732] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-03T18:01:51.190663] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-03T18:01:51.990701] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-03T18:01:52.061140] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T18:01:52.790704] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-03T18:01:52.843680] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:01:53.074226] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T18:01:53.077813] [INFO ] [REMOTE ] CIEN: Full fetch complete (75568 records). [2025-10-03T18:01:53.077988] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-03T18:01:53.512971] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-03T18:01:53.513087] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-03T18:01:53.514692] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-03T18:01:53.514768] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-03T18:01:53.516517] [DEBUG] [LOCAL ] CIEN: Trimmed 75568 records to 52838 (keeping 200 days of data) [2025-10-03T18:01:53.602599] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-03T18:01:53.839708] [DEBUG] [LOCAL ] CIEN: Primary data saved (52838 records). [2025-10-03T18:01:53.839862] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-03T18:01:53.839963] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CIEN took 49.7s. Estimated remaining: 4h 24m 30s. Rate: 7.3 symbols/min [2025-10-03T18:01:54.044957] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:01:54.051077] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-10-03T18:01:54.051349] [INFO ] [MAIN ] CIMN: Loaded 2697 existing records. [2025-10-03T18:01:54.263818] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:01:54.264102] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-03T18:01:54.264212] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-03T18:01:54.264582] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-03T18:01:54.264685] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-03T18:01:54.398776] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-03T18:01:54.626970] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:01:54.713760] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:01:54.770979] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:01:55.190733] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-03T18:01:55.605780] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T18:01:55.990702] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-03T18:01:56.096361] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:01:56.467937] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:01:56.790735] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-03T18:01:57.590957] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-03T18:01:57.739245] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:01:58.390709] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-03T18:01:59.190758] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-03T18:01:59.347044] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:01:59.558024] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-03T18:01:59.664217] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T18:01:59.990724] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-03T18:02:00.790740] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-03T18:02:01.270044] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T18:02:01.418956] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:02:01.420376] [INFO ] [REMOTE ] CII: Full fetch complete (23037 records). [2025-10-03T18:02:01.420501] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-03T18:02:01.595488] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-03T18:02:01.859619] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-03T18:02:01.859744] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-03T18:02:01.860244] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-03T18:02:01.860311] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-03T18:02:01.861074] [DEBUG] [LOCAL ] CII: Trimmed 23037 records to 15458 (keeping 200 days of data) [2025-10-03T18:02:01.961776] [DEBUG] [LOCAL ] CII: Primary data saved (15458 records). [2025-10-03T18:02:01.962058] [INFO ] [MAIN ] CII: Full history saved. [2025-10-03T18:02:01.962183] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CII took 25.0s. Estimated remaining: 4h 24m 21s. Rate: 7.3 symbols/min [2025-10-03T18:02:02.207917] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:02.208153] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-03T18:02:02.208213] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-03T18:02:02.208379] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-03T18:02:02.208431] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-03T18:02:02.208507] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-03T18:02:02.208566] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-03T18:02:02.395830] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-03T18:02:02.650853] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:02.750690] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-03T18:02:03.190699] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-03T18:02:03.990726] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-03T18:02:04.062471] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:02:04.293121] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:02:04.352203] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-03T18:02:04.790695] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-03T18:02:05.257201] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:02:05.590693] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-03T18:02:06.390691] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-03T18:02:06.483823] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T18:02:07.190709] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-03T18:02:07.682600] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-03T18:02:07.767783] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:02:07.770461] [INFO ] [REMOTE ] CIG: Full fetch complete (61245 records). [2025-10-03T18:02:07.770587] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-03T18:02:07.997362] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-03T18:02:08.228160] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-03T18:02:08.228263] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-03T18:02:08.229063] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-03T18:02:08.229133] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-03T18:02:08.230600] [DEBUG] [LOCAL ] CIG: Trimmed 61245 records to 44526 (keeping 200 days of data) [2025-10-03T18:02:08.500748] [DEBUG] [LOCAL ] CIG: Primary data saved (44526 records). [2025-10-03T18:02:08.500899] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-03T18:02:08.500979] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CIG took 41.4s. Estimated remaining: 4h 24m 5s. Rate: 7.3 symbols/min [2025-10-03T18:02:08.699204] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:08.699445] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-03T18:02:08.699504] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-03T18:02:08.699730] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-03T18:02:08.699817] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-03T18:02:08.699879] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-03T18:02:08.699915] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-03T18:02:08.795793] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-03T18:02:09.093891] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:09.294246] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T18:02:09.590696] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-03T18:02:09.717223] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:02:10.074866] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:02:10.390685] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-03T18:02:10.832839] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:02:11.190690] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-03T18:02:11.829359] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:02:11.990681] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-03T18:02:12.626196] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T18:02:12.627152] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-10-03T18:02:12.627253] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-03T18:02:12.795721] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-03T18:02:13.039814] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-03T18:02:13.039908] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-03T18:02:13.040078] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-03T18:02:13.040149] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-03T18:02:13.040552] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2714 (keeping 200 days of data) [2025-10-03T18:02:13.058493] [DEBUG] [LOCAL ] CIMN: Primary data saved (2714 records). [2025-10-03T18:02:13.058579] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-03T18:02:13.058698] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIMN took 19.2s. Estimated remaining: 4h 23m 41s. Rate: 7.3 symbols/min [2025-10-03T18:02:13.106580] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:02:13.162090] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-03T18:02:13.173882] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:02:13.179796] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-03T18:02:13.179929] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:02:13.200526] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-03T18:02:13.225309] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-03T18:02:13.232240] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-03T18:02:13.250452] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:13.250788] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-03T18:02:13.251257] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CIMP took 4.8s. Estimated remaining: 4h 22m 59s. Rate: 7.3 symbols/min [2025-10-03T18:02:13.452184] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:13.452777] [DEBUG] [LOCAL ] CINT: Loaded 18940 existing records from primary storage. [2025-10-03T18:02:13.453266] [INFO ] [MAIN ] CINT: Loaded 18940 existing records. [2025-10-03T18:02:13.593437] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-03T18:02:13.634319] [DEBUG] [LOCAL ] CIO: Loaded 20557 existing records from primary storage. [2025-10-03T18:02:13.676324] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:13.677107] [INFO ] [MAIN ] CIO: Loaded 20557 existing records. [2025-10-03T18:02:13.677434] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-03T18:02:13.682748] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-03T18:02:13.696466] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-03T18:02:13.702137] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-03T18:02:14.191715] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:14.239800] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-03T18:02:14.242836] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-03T18:02:14.249006] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-03T18:02:14.259290] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-03T18:02:14.395760] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-03T18:02:14.402731] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:14.656604] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:02:14.739333] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:15.190717] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-03T18:02:15.979309] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:02:15.990608] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-03T18:02:16.204489] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:02:16.790690] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-03T18:02:17.461596] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:02:17.590710] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-03T18:02:17.715554] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T18:02:18.390730] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-03T18:02:18.860438] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:02:19.190710] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-03T18:02:19.649145] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:02:19.990706] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-03T18:02:20.790733] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-03T18:02:20.858985] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:02:21.136495] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:02:21.590678] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-03T18:02:21.750736] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T18:02:22.365130] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:02:22.390664] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-03T18:02:23.190697] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-03T18:02:23.254242] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T18:02:23.629117] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T18:02:23.990714] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-03T18:02:24.790722] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-03T18:02:24.954032] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:02:25.140663] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:02:25.590739] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-03T18:02:26.046094] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-03T18:02:26.390720] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-03T18:02:27.030486] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:02:27.190691] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-03T18:02:27.990681] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-03T18:02:28.287994] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T18:02:28.790718] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-03T18:02:29.341968] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T18:02:29.593487] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-03T18:02:29.595359] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T18:02:30.390725] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-03T18:02:30.985134] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T18:02:31.190732] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-03T18:02:31.255446] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:02:31.990687] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-03T18:02:32.051754] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T18:02:32.790706] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-03T18:02:33.009443] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:02:33.590757] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-03T18:02:34.139046] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:02:34.390720] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-03T18:02:34.798993] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T18:02:35.163116] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:02:35.190730] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-03T18:02:35.936089] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:02:35.937047] [INFO ] [REMOTE ] CIMO: Full fetch complete (5337 records). [2025-10-03T18:02:35.937123] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-03T18:02:35.999164] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-03T18:02:36.145161] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:02:36.145425] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:02:36.145499] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:02:36.145573] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-03T18:02:36.145660] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-03T18:02:36.145722] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-03T18:02:36.145789] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-03T18:02:36.145899] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIMO took 34.2s. Estimated remaining: 4h 23m 53s. Rate: 7.3 symbols/min [2025-10-03T18:02:36.338792] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:36.380372] [DEBUG] [LOCAL ] CION: Loaded 29036 existing records from primary storage. [2025-10-03T18:02:36.380721] [INFO ] [MAIN ] CION: Loaded 29036 existing records. [2025-10-03T18:02:36.616805] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:36.617057] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-03T18:02:36.617109] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-03T18:02:36.617956] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-10-03T18:02:36.618019] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-03T18:02:36.794717] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-03T18:02:37.052061] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:37.064849] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:02:37.590714] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-03T18:02:38.097339] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:02:38.390700] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-03T18:02:39.190699] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-03T18:02:39.429128] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T18:02:39.602561] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T18:02:39.990732] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-03T18:02:40.070348] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:02:40.790715] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-03T18:02:41.359570] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:02:41.362371] [INFO ] [REMOTE ] CIM: Full fetch complete (54996 records). [2025-10-03T18:02:41.362540] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-03T18:02:41.598104] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-03T18:02:41.810083] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-03T18:02:41.810709] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:02:41.816024] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-03T18:02:41.817558] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-03T18:02:41.817733] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-03T18:02:41.819538] [DEBUG] [LOCAL ] CIM: Trimmed 54996 records to 38123 (keeping 200 days of data) [2025-10-03T18:02:42.114163] [DEBUG] [LOCAL ] CIM: Primary data saved (38123 records). [2025-10-03T18:02:42.114333] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-03T18:02:42.114494] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIM took 55.5s. Estimated remaining: 4h 23m 35s. Rate: 7.3 symbols/min [2025-10-03T18:02:42.301384] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:42.361815] [DEBUG] [LOCAL ] CIVI: Loaded 52985 existing records from primary storage. [2025-10-03T18:02:42.362176] [INFO ] [MAIN ] CIVI: Loaded 52985 existing records. [2025-10-03T18:02:42.399209] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-03T18:02:42.586098] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:42.586325] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-03T18:02:42.586377] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-03T18:02:42.588085] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-03T18:02:42.588148] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-03T18:02:42.686331] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:02:42.717037] [INFO ] [REMOTE ] CIO: Full fetch complete (29204 records). [2025-10-03T18:02:42.717199] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-03T18:02:43.197429] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-03T18:02:43.374968] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:43.469739] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-03T18:02:43.469861] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-03T18:02:43.470345] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-03T18:02:43.470422] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-03T18:02:43.471745] [DEBUG] [LOCAL ] CIO: Trimmed 29204 records to 20752 (keeping 200 days of data) [2025-10-03T18:02:43.579578] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T18:02:43.626802] [DEBUG] [LOCAL ] CIO: Primary data saved (20752 records). [2025-10-03T18:02:43.626938] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-03T18:02:43.627039] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CIO took 30.4s. Estimated remaining: 4h 22m 58s. Rate: 7.3 symbols/min [2025-10-03T18:02:43.833934] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:43.834128] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-03T18:02:43.834167] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-03T18:02:43.834282] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-03T18:02:43.834324] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-03T18:02:43.834365] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-03T18:02:43.834397] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-03T18:02:43.995832] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-03T18:02:44.247808] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:44.496682] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:02:44.790613] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-03T18:02:45.189691] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T18:02:45.590726] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-03T18:02:46.390731] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-03T18:02:46.671899] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:02:47.011967] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T18:02:47.190673] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-03T18:02:47.413364] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T18:02:47.415992] [INFO ] [REMOTE ] CINT: Full fetch complete (26784 records). [2025-10-03T18:02:47.416138] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-03T18:02:47.847039] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-03T18:02:47.847152] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-03T18:02:47.847678] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-03T18:02:47.847745] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-03T18:02:47.848758] [DEBUG] [LOCAL ] CINT: Trimmed 26784 records to 19081 (keeping 200 days of data) [2025-10-03T18:02:47.966922] [DEBUG] [LOCAL ] CINT: Primary data saved (19081 records). [2025-10-03T18:02:47.967078] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-03T18:02:47.967169] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CINT took 34.9s. Estimated remaining: 4h 22m 34s. Rate: 7.3 symbols/min [2025-10-03T18:02:48.002102] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-03T18:02:48.190270] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:02:48.236883] [DEBUG] [LOCAL ] CLB: Loaded 33203 existing records from primary storage. [2025-10-03T18:02:48.237227] [INFO ] [MAIN ] CLB: Loaded 33203 existing records. [2025-10-03T18:02:48.447008] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:02:48.447261] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-03T18:02:48.447329] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-03T18:02:48.448474] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-03T18:02:48.448568] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-03T18:02:48.804692] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-03T18:02:48.852885] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:02:49.581149] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:02:49.593404] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-03T18:02:49.854710] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-10-03T18:02:50.390669] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-03T18:02:50.523276] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:02:50.875545] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T18:02:51.190677] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-03T18:02:51.566386] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T18:02:51.990732] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-03T18:02:52.790635] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-03T18:02:52.907843] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:02:53.285314] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:02:53.590720] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-03T18:02:54.111154] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:02:54.390732] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-03T18:02:54.763196] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:02:55.190728] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-03T18:02:55.959950] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:02:55.990688] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-03T18:02:56.411309] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:02:56.790697] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-03T18:02:57.590706] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-03T18:02:57.725115] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:02:58.390742] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-03T18:02:58.504278] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T18:02:58.942354] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T18:02:59.190897] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-03T18:02:59.990939] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-03T18:03:00.245431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:03:00.790695] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-03T18:03:01.160893] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T18:03:01.590747] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-03T18:03:01.815510] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:03:02.390703] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-03T18:03:02.502960] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:03:03.190770] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-03T18:03:03.377837] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:03:03.707526] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:03:03.990690] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-03T18:03:04.275403] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:03:04.790685] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-03T18:03:04.835766] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:03:05.590711] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-03T18:03:06.076456] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:03:06.390683] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-03T18:03:07.190678] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-03T18:03:07.360563] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T18:03:07.469152] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T18:03:07.470755] [INFO ] [REMOTE ] CION: Full fetch complete (40944 records). [2025-10-03T18:03:07.470883] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-03T18:03:07.921850] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-03T18:03:07.921949] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-03T18:03:07.922626] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-03T18:03:07.922842] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-03T18:03:07.924090] [DEBUG] [LOCAL ] CION: Trimmed 40944 records to 29192 (keeping 200 days of data) [2025-10-03T18:03:08.015271] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-03T18:03:08.117364] [DEBUG] [LOCAL ] CION: Primary data saved (29192 records). [2025-10-03T18:03:08.117519] [INFO ] [MAIN ] CION: Full history saved. [2025-10-03T18:03:08.117611] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CION took 32.0s. Estimated remaining: 4h 23m 15s. Rate: 7.3 symbols/min [2025-10-03T18:03:08.319350] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:08.334710] [DEBUG] [LOCAL ] CLCO: Loaded 12817 existing records from primary storage. [2025-10-03T18:03:08.334955] [INFO ] [MAIN ] CLCO: Loaded 12817 existing records. [2025-10-03T18:03:08.545069] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:08.545789] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-03T18:03:08.545908] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-03T18:03:08.546274] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-03T18:03:08.567984] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-03T18:03:08.575278] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:03:08.795752] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-03T18:03:08.985865] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:09.590620] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-03T18:03:09.927186] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T18:03:10.281963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T18:03:10.390729] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-03T18:03:10.488329] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:03:11.190719] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-03T18:03:11.990664] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-03T18:03:12.041806] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:03:12.790730] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-03T18:03:13.002139] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T18:03:13.487362] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T18:03:13.529943] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:03:13.590737] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-03T18:03:14.390735] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-03T18:03:14.693435] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:03:14.695446] [INFO ] [REMOTE ] CLB: Full fetch complete (46745 records). [2025-10-03T18:03:14.695552] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-03T18:03:15.129696] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-03T18:03:15.129797] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-03T18:03:15.130386] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-03T18:03:15.130430] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-03T18:03:15.131620] [DEBUG] [LOCAL ] CLB: Trimmed 46745 records to 33416 (keeping 200 days of data) [2025-10-03T18:03:15.197118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-03T18:03:15.363199] [DEBUG] [LOCAL ] CLB: Primary data saved (33416 records). [2025-10-03T18:03:15.363354] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-03T18:03:15.363443] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CLB took 27.4s. Estimated remaining: 4h 23m 3s. Rate: 7.3 symbols/min [2025-10-03T18:03:15.556755] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:15.585808] [DEBUG] [LOCAL ] CLDT: Loaded 25578 existing records from primary storage. [2025-10-03T18:03:15.586116] [INFO ] [MAIN ] CLDT: Loaded 25578 existing records. [2025-10-03T18:03:15.814664] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:15.815055] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-03T18:03:15.815113] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-03T18:03:15.815365] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-03T18:03:15.815424] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-03T18:03:15.995782] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-03T18:03:16.250293] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:16.317631] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:03:16.790621] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-03T18:03:17.158863] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T18:03:17.284297] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T18:03:17.590730] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-03T18:03:18.390709] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-03T18:03:18.542372] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:03:19.190703] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-03T18:03:19.597622] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:03:19.634628] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:03:19.990792] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-03T18:03:20.417613] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:03:20.790793] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-03T18:03:21.590701] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-03T18:03:21.757477] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T18:03:21.897877] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:03:22.390714] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-03T18:03:22.721587] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:03:23.190735] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-03T18:03:23.990678] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-03T18:03:24.088980] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T18:03:24.465876] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:03:24.469430] [INFO ] [REMOTE ] CIVI: Full fetch complete (75717 records). [2025-10-03T18:03:24.469676] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-03T18:03:24.799937] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-03T18:03:24.967565] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-03T18:03:24.967756] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-03T18:03:24.968732] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-03T18:03:24.968806] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-03T18:03:24.970447] [DEBUG] [LOCAL ] CIVI: Trimmed 75717 records to 53365 (keeping 200 days of data) [2025-10-03T18:03:25.323354] [DEBUG] [LOCAL ] CIVI: Primary data saved (53365 records). [2025-10-03T18:03:25.323511] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-03T18:03:25.323599] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CIVI took 43.2s. Estimated remaining: 4h 23m 1s. Rate: 7.3 symbols/min [2025-10-03T18:03:25.517027] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:25.531813] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T18:03:25.581729] [DEBUG] [LOCAL ] CLF: Loaded 54131 existing records from primary storage. [2025-10-03T18:03:25.582094] [INFO ] [MAIN ] CLF: Loaded 54131 existing records. [2025-10-03T18:03:25.595883] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-03T18:03:25.782753] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:25.783075] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-03T18:03:25.783149] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-03T18:03:25.783499] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-03T18:03:25.783578] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-03T18:03:26.219854] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:26.220893] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-03T18:03:26.226556] [INFO ] [REMOTE ] CL: Full fetch complete (77619 records). [2025-10-03T18:03:26.226724] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-03T18:03:26.399029] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-03T18:03:26.723303] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-03T18:03:26.723464] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-03T18:03:26.724389] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-03T18:03:26.724459] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-03T18:03:26.726425] [DEBUG] [LOCAL ] CL: Trimmed 77619 records to 54425 (keeping 200 days of data) [2025-10-03T18:03:27.095360] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:03:27.135730] [DEBUG] [LOCAL ] CL: Primary data saved (54425 records). [2025-10-03T18:03:27.135893] [INFO ] [MAIN ] CL: Full history saved. [2025-10-03T18:03:27.136016] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CL took 43.5s. Estimated remaining: 4h 22m 27s. Rate: 7.3 symbols/min [2025-10-03T18:03:27.199463] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-03T18:03:27.385862] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:27.416725] [DEBUG] [LOCAL ] CLH: Loaded 28009 existing records from primary storage. [2025-10-03T18:03:27.417077] [INFO ] [MAIN ] CLH: Loaded 28009 existing records. [2025-10-03T18:03:27.625866] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:27.626099] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-03T18:03:27.626149] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-03T18:03:27.626400] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-03T18:03:27.626459] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-03T18:03:27.997598] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-03T18:03:28.034888] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:28.181693] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:03:28.704595] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-03T18:03:28.790722] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-03T18:03:29.439225] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:03:29.590733] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-03T18:03:30.151941] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:03:30.390701] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-03T18:03:31.190737] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-03T18:03:31.284400] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-03T18:03:31.557798] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T18:03:31.990749] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-03T18:03:32.081777] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T18:03:32.790729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-03T18:03:33.590682] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-03T18:03:33.803835] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:03:34.123133] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-10-03T18:03:34.390744] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-03T18:03:34.737146] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T18:03:35.190716] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-03T18:03:35.536679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T18:03:35.990713] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-03T18:03:36.790634] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-03T18:03:37.115741] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:03:37.310672] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:03:37.356872] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T18:03:37.590729] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-03T18:03:38.276065] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:03:38.277567] [INFO ] [REMOTE ] CLCO: Full fetch complete (22773 records). [2025-10-03T18:03:38.277723] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-03T18:03:38.398738] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-03T18:03:38.703724] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-03T18:03:38.703825] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-03T18:03:38.704295] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-03T18:03:38.704361] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-03T18:03:38.705184] [DEBUG] [LOCAL ] CLCO: Trimmed 22773 records to 13025 (keeping 200 days of data) [2025-10-03T18:03:38.783083] [DEBUG] [LOCAL ] CLCO: Primary data saved (13025 records). [2025-10-03T18:03:38.783243] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-03T18:03:38.783378] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 30.7s. Estimated remaining: 4h 22m 32s. Rate: 7.3 symbols/min [2025-10-03T18:03:38.965834] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:38.966050] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-03T18:03:38.966106] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-03T18:03:38.966267] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-03T18:03:38.966322] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-03T18:03:38.966391] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-03T18:03:38.966428] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-03T18:03:39.198459] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-03T18:03:39.350770] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:39.887034] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:03:39.990738] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-03T18:03:40.332901] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T18:03:40.790706] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-03T18:03:41.590731] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-03T18:03:41.874431] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:03:42.270298] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T18:03:42.390756] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-03T18:03:42.864600] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:03:43.190721] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-03T18:03:43.921169] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T18:03:43.990685] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-03T18:03:44.790729] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-03T18:03:45.013482] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:03:45.257004] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T18:03:45.590684] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-03T18:03:45.992349] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:03:46.390691] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-03T18:03:47.190740] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-03T18:03:47.350539] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T18:03:47.352273] [INFO ] [REMOTE ] CLDT: Full fetch complete (37115 records). [2025-10-03T18:03:47.352358] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-03T18:03:47.773135] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-03T18:03:47.773338] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-03T18:03:47.773885] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-03T18:03:47.773978] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-03T18:03:47.775329] [DEBUG] [LOCAL ] CLDT: Trimmed 37115 records to 25759 (keeping 200 days of data) [2025-10-03T18:03:47.856392] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-10-03T18:03:47.981233] [DEBUG] [LOCAL ] CLDT: Primary data saved (25759 records). [2025-10-03T18:03:47.981407] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-03T18:03:47.981510] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 32.6s. Estimated remaining: 4h 22m 28s. Rate: 7.3 symbols/min [2025-10-03T18:03:47.995842] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-03T18:03:48.183665] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:48.183879] [DEBUG] [LOCAL ] CLS: No existing data file found in primary storage. [2025-10-03T18:03:48.183948] [WARN ] [MAIN ] CLS: No existing data found, performing full refresh instead. [2025-10-03T18:03:48.184066] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-03T18:03:48.184111] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-03T18:03:48.184155] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-03T18:03:48.184189] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-03T18:03:48.516964] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:03:48.601473] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:48.790717] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-03T18:03:48.838164] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:03:49.590711] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-03T18:03:50.390739] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-03T18:03:50.784633] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T18:03:50.909391] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:03:51.176983] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:03:51.190622] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-03T18:03:51.990698] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-03T18:03:52.124009] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:03:52.790684] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-03T18:03:53.157679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:03:53.590712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-03T18:03:54.390690] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-03T18:03:54.809369] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:03:54.910045] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:03:55.190665] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-03T18:03:55.990712] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-03T18:03:56.790703] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-03T18:03:56.847681] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-03T18:03:57.189717] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:03:57.191938] [INFO ] [REMOTE ] CLH: Full fetch complete (41874 records). [2025-10-03T18:03:57.192021] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-03T18:03:57.591780] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-03T18:03:57.639630] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-03T18:03:57.664507] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-03T18:03:57.668159] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-03T18:03:57.668381] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-03T18:03:57.674263] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T18:03:57.672451] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-03T18:03:57.690157] [DEBUG] [LOCAL ] CLH: Trimmed 41874 records to 28188 (keeping 200 days of data) [2025-10-03T18:03:57.871497] [DEBUG] [LOCAL ] CLH: Primary data saved (28188 records). [2025-10-03T18:03:57.871637] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-03T18:03:57.871781] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLH took 30.7s. Estimated remaining: 4h 22m 26s. Rate: 7.3 symbols/min [2025-10-03T18:03:58.052697] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:03:58.104741] [DEBUG] [LOCAL ] CLVT: Loaded 52342 existing records from primary storage. [2025-10-03T18:03:58.105077] [INFO ] [MAIN ] CLVT: Loaded 52342 existing records. [2025-10-03T18:03:58.307205] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:03:58.307502] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-03T18:03:58.307567] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-03T18:03:58.307909] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-03T18:03:58.307986] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-03T18:03:58.395826] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-03T18:03:58.720273] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:03:59.190706] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-03T18:03:59.694775] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T18:03:59.990692] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-03T18:04:00.790705] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-03T18:04:01.077179] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-03T18:04:01.143456] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:04:01.563016] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:04:01.590683] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-03T18:04:02.093275] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T18:04:02.390683] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-03T18:04:03.190701] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-03T18:04:03.990749] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-03T18:04:04.039993] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T18:04:04.094946] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:04:04.094638] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-03T18:04:04.790689] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-03T18:04:05.590701] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-03T18:04:05.672492] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:04:05.699570] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:04:05.701953] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-10-03T18:04:05.702078] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-03T18:04:05.703114] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:04:05.703277] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:04:05.703359] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:04:05.703464] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-03T18:04:05.703535] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-10-03T18:04:05.703574] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-10-03T18:04:05.703909] [DEBUG] [LOCAL ] CLF: Deleted derivative data file. [2025-10-03T18:04:05.704010] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLF took 40.4s. Estimated remaining: 4h 22m 16s. Rate: 7.3 symbols/min [2025-10-03T18:04:05.895182] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:05.918673] [DEBUG] [LOCAL ] CLW: Loaded 21887 existing records from primary storage. [2025-10-03T18:04:05.918981] [INFO ] [MAIN ] CLW: Loaded 21887 existing records. [2025-10-03T18:04:06.119567] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:06.119830] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-03T18:04:06.119885] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-03T18:04:06.120103] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-03T18:04:06.120167] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-03T18:04:06.396282] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-03T18:04:06.498000] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:07.190705] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-03T18:04:07.287387] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T18:04:07.844175] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-03T18:04:07.990754] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-03T18:04:08.790719] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-03T18:04:08.851237] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:04:09.537834] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T18:04:09.590691] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-03T18:04:10.390721] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-03T18:04:10.719356] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T18:04:10.899346] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T18:04:11.155883] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T18:04:11.190704] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-03T18:04:11.990683] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-03T18:04:12.362602] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:04:12.549917] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T18:04:12.550919] [INFO ] [REMOTE ] CLPR: Full fetch complete (17538 records). [2025-10-03T18:04:12.551024] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-03T18:04:12.791694] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-03T18:04:12.960875] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-03T18:04:12.960992] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-03T18:04:12.961536] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-03T18:04:12.961579] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-03T18:04:12.962232] [DEBUG] [LOCAL ] CLPR: Trimmed 17538 records to 11502 (keeping 200 days of data) [2025-10-03T18:04:13.043328] [DEBUG] [LOCAL ] CLPR: Primary data saved (11502 records). [2025-10-03T18:04:13.043560] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-03T18:04:13.043690] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 34.3s. Estimated remaining: 4h 22m 4s. Rate: 7.3 symbols/min [2025-10-03T18:04:13.215750] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:13.294924] [DEBUG] [LOCAL ] CLX: Loaded 51852 existing records from primary storage. [2025-10-03T18:04:13.295442] [INFO ] [MAIN ] CLX: Loaded 51852 existing records. [2025-10-03T18:04:13.479966] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:13.480293] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-03T18:04:13.480347] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-03T18:04:13.480725] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-03T18:04:13.480787] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-03T18:04:13.595862] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-03T18:04:13.856183] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:14.390706] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-03T18:04:14.735443] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:04:14.762174] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-03T18:04:15.190735] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-03T18:04:15.990768] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-03T18:04:16.677829] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T18:04:16.790637] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-03T18:04:16.962965] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:04:17.590723] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-03T18:04:17.815856] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:04:18.390719] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-03T18:04:19.190698] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-03T18:04:19.470150] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:04:19.557796] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-10-03T18:04:19.990727] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-03T18:04:20.022147] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:04:20.511288] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T18:04:20.790738] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-03T18:04:21.590724] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-03T18:04:22.390665] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-03T18:04:22.499987] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T18:04:22.546500] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T18:04:22.573636] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T18:04:23.190734] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-03T18:04:23.990704] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-03T18:04:24.134829] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T18:04:24.790735] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-03T18:04:25.287105] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T18:04:25.590737] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-03T18:04:25.788346] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T18:04:25.964627] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T18:04:25.967735] [INFO ] [REMOTE ] CLS: Full fetch complete (77457 records). [2025-10-03T18:04:25.967882] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-03T18:04:26.395952] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-03T18:04:26.399907] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-03T18:04:26.399985] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-03T18:04:26.401925] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-03T18:04:26.402091] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-03T18:04:26.403969] [DEBUG] [LOCAL ] CLS: Trimmed 77457 records to 54389 (keeping 200 days of data) [2025-10-03T18:04:26.759011] [DEBUG] [LOCAL ] CLS: Primary data saved (54389 records). [2025-10-03T18:04:26.759161] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-03T18:04:26.759252] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLS took 38.8s. Estimated remaining: 4h 22m 18s. Rate: 7.3 symbols/min [2025-10-03T18:04:26.941041] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:26.995357] [DEBUG] [LOCAL ] CM: Loaded 48929 existing records from primary storage. [2025-10-03T18:04:26.996035] [INFO ] [MAIN ] CM: Loaded 48929 existing records. [2025-10-03T18:04:27.197251] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:27.193542] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-03T18:04:27.197708] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-03T18:04:27.198925] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-03T18:04:27.199277] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-03T18:04:27.199459] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-03T18:04:27.409799] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:04:27.637914] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:27.990696] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-03T18:04:28.229621] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:04:28.352360] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T18:04:28.790714] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-03T18:04:29.590697] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-03T18:04:29.752377] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:04:29.866124] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:04:30.390712] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-03T18:04:31.190639] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-03T18:04:31.252504] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:04:31.863583] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:04:31.990701] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-03T18:04:32.419012] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:04:32.790717] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-03T18:04:33.457546] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T18:04:33.460388] [INFO ] [REMOTE ] CLVT: Full fetch complete (75240 records). [2025-10-03T18:04:33.460795] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-03T18:04:33.595777] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-03T18:04:33.901302] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-03T18:04:33.901396] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-03T18:04:33.902325] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-03T18:04:33.902408] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-03T18:04:33.904075] [DEBUG] [LOCAL ] CLVT: Trimmed 75240 records to 52720 (keeping 200 days of data) [2025-10-03T18:04:34.216021] [DEBUG] [LOCAL ] CLVT: Primary data saved (52720 records). [2025-10-03T18:04:34.216187] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-03T18:04:34.216298] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLVT took 36.3s. Estimated remaining: 4h 22m 7s. Rate: 7.3 symbols/min [2025-10-03T18:04:34.403043] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-03T18:04:34.432076] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:34.433422] [DEBUG] [LOCAL ] CMA: No existing data file found in primary storage. [2025-10-03T18:04:34.433538] [WARN ] [MAIN ] CMA: No existing data found, performing full refresh instead. [2025-10-03T18:04:34.433688] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-03T18:04:34.433745] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-03T18:04:34.433792] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-03T18:04:34.433857] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-03T18:04:34.545710] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:04:34.580129] [INFO ] [REMOTE ] CLW: Full fetch complete (34750 records). [2025-10-03T18:04:34.613318] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-03T18:04:34.663085] [FATAL] [VALIDATOR ] CLW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:04:34.700013] [FATAL] [MAIN ] CLW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:04:34.713587] [WARN ] [MAIN ] CLW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:04:34.737235] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-03T18:04:34.756002] [DEBUG] [LOCAL ] CLW: No primary data file found to delete. [2025-10-03T18:04:34.764970] [INFO ] [LOCAL ] CLW: Starting deletion of derivative data. [2025-10-03T18:04:34.778923] [DEBUG] [LOCAL ] CLW: Deleted derivative data file. [2025-10-03T18:04:34.784460] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLW took 29.1s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-03T18:04:34.922183] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:35.067157] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-03T18:04:35.108883] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:35.135432] [DEBUG] [LOCAL ] CMBT: Loaded 23828 existing records from primary storage. [2025-10-03T18:04:35.135806] [INFO ] [MAIN ] CMBT: Loaded 23828 existing records. [2025-10-03T18:04:35.195869] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-03T18:04:35.363105] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:35.363332] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-03T18:04:35.363381] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-03T18:04:35.363755] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-03T18:04:35.363834] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-03T18:04:35.778444] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:35.990747] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-03T18:04:36.123857] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:04:36.790621] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-03T18:04:37.054781] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T18:04:37.590685] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-03T18:04:37.632484] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:04:38.351840] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:04:38.390729] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-03T18:04:39.190727] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-03T18:04:39.309069] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:04:39.990735] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-03T18:04:40.379901] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:04:40.790697] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-03T18:04:40.900289] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:04:41.035012] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T18:04:41.590719] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-03T18:04:42.390693] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-03T18:04:42.599787] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:04:43.036168] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T18:04:43.190697] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-03T18:04:43.281315] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:04:43.990721] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-03T18:04:44.790665] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-03T18:04:44.886726] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:04:45.121819] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:04:45.590735] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-03T18:04:46.230980] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:04:46.390709] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-03T18:04:46.712082] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T18:04:47.190700] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-03T18:04:47.990667] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-03T18:04:48.123045] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:04:48.284590] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T18:04:48.790719] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-03T18:04:49.590706] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-03T18:04:49.660857] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:04:50.390629] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-03T18:04:50.537195] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T18:04:50.540077] [INFO ] [REMOTE ] CLX: Full fetch complete (73123 records). [2025-10-03T18:04:50.540202] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-03T18:04:50.841442] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T18:04:51.128722] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-03T18:04:51.128900] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-03T18:04:51.130354] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-03T18:04:51.130458] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-03T18:04:51.132958] [DEBUG] [LOCAL ] CLX: Trimmed 73123 records to 52222 (keeping 200 days of data) [2025-10-03T18:04:51.228031] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-03T18:04:51.630574] [DEBUG] [LOCAL ] CLX: Primary data saved (52222 records). [2025-10-03T18:04:51.630983] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-03T18:04:51.634118] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLX took 38.6s. Estimated remaining: 4h 21m 54s. Rate: 7.3 symbols/min [2025-10-03T18:04:51.867558] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:04:51.941373] [DEBUG] [LOCAL ] CMC: Loaded 45898 existing records from primary storage. [2025-10-03T18:04:51.942048] [INFO ] [MAIN ] CMC: Loaded 45898 existing records. [2025-10-03T18:04:51.994168] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-03T18:04:52.207160] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:04:52.207528] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-03T18:04:52.207773] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-03T18:04:52.223445] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-03T18:04:52.237538] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:04:52.236107] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-03T18:04:52.452427] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:04:52.664393] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:04:52.790688] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-03T18:04:53.519714] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:04:53.590683] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-03T18:04:54.390730] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-03T18:04:54.641718] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:04:54.998624] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T18:04:55.190694] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-03T18:04:55.826774] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:04:55.990680] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-03T18:04:56.790694] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-03T18:04:56.948426] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T18:04:57.575846] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:04:57.590675] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-03T18:04:58.390722] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-03T18:04:58.686699] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T18:04:59.190750] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-03T18:04:59.366154] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T18:04:59.990743] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-03T18:05:00.057766] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:05:00.755414] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:05:00.790634] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-03T18:05:01.590619] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-03T18:05:01.665347] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:05:02.077463] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T18:05:02.080218] [INFO ] [REMOTE ] CM: Full fetch complete (69457 records). [2025-10-03T18:05:02.080376] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-03T18:05:02.395845] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-03T18:05:02.525074] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-03T18:05:02.525170] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-03T18:05:02.525999] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-03T18:05:02.526098] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-03T18:05:02.527598] [DEBUG] [LOCAL ] CM: Trimmed 69457 records to 49298 (keeping 200 days of data) [2025-10-03T18:05:02.853269] [DEBUG] [LOCAL ] CM: Primary data saved (49298 records). [2025-10-03T18:05:02.853445] [INFO ] [MAIN ] CM: Full history saved. [2025-10-03T18:05:02.857401] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CM took 36.1s. Estimated remaining: 4h 21m 57s. Rate: 7.2 symbols/min [2025-10-03T18:05:03.063529] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:03.073108] [DEBUG] [LOCAL ] CMCM: Loaded 4758 existing records from primary storage. [2025-10-03T18:05:03.073344] [INFO ] [MAIN ] CMCM: Loaded 4758 existing records. [2025-10-03T18:05:03.191081] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-03T18:05:03.279199] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:03.279509] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-03T18:05:03.279707] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-03T18:05:03.280008] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-03T18:05:03.280127] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-03T18:05:03.548924] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T18:05:03.699697] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:03.978822] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:05:03.990744] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-03T18:05:04.790624] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-03T18:05:05.072371] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T18:05:05.075430] [INFO ] [REMOTE ] CMBT: Full fetch complete (30776 records). [2025-10-03T18:05:05.075555] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-03T18:05:05.492991] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-03T18:05:05.493171] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-03T18:05:05.493721] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-03T18:05:05.493900] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-03T18:05:05.495465] [DEBUG] [LOCAL ] CMBT: Trimmed 30776 records to 24208 (keeping 200 days of data) [2025-10-03T18:05:05.597155] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-03T18:05:05.680694] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:05:05.720718] [DEBUG] [LOCAL ] CMBT: Primary data saved (24208 records). [2025-10-03T18:05:05.721036] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-03T18:05:05.721228] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMBT took 30.9s. Estimated remaining: 4h 21m 27s. Rate: 7.3 symbols/min [2025-10-03T18:05:05.801047] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:05:05.926304] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:05.926541] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-03T18:05:05.926587] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-03T18:05:05.926752] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-03T18:05:05.926809] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-03T18:05:05.926910] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-03T18:05:05.926971] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-03T18:05:06.322703] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:06.390738] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-03T18:05:06.598739] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:05:06.599141] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-03T18:05:06.599226] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:05:06.599281] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-03T18:05:06.599349] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:05:06.599423] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-03T18:05:06.599492] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-03T18:05:06.599531] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-03T18:05:06.599591] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-03T18:05:06.599705] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMDB took 0.9s. Estimated remaining: 4h 20m 49s. Rate: 7.3 symbols/min [2025-10-03T18:05:06.781198] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:06.843920] [DEBUG] [LOCAL ] CMG: Loaded 54111 existing records from primary storage. [2025-10-03T18:05:06.844307] [INFO ] [MAIN ] CMG: Loaded 54111 existing records. [2025-10-03T18:05:07.035793] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:07.036012] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-03T18:05:07.036062] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-03T18:05:07.036338] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-03T18:05:07.036399] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-03T18:05:07.201124] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-03T18:05:07.432407] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:07.466639] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:05:07.990780] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-03T18:05:08.738241] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T18:05:08.790703] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-03T18:05:09.305059] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T18:05:09.590678] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-03T18:05:09.806467] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:05:10.390700] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-03T18:05:11.093613] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:05:11.190697] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-03T18:05:11.907591] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:05:11.910135] [INFO ] [REMOTE ] CMA: Full fetch complete (73090 records). [2025-10-03T18:05:11.910269] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-03T18:05:11.995795] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-03T18:05:12.342975] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-03T18:05:12.343085] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-03T18:05:12.343959] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-03T18:05:12.344029] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-03T18:05:12.345571] [DEBUG] [LOCAL ] CMA: Trimmed 73090 records to 50603 (keeping 200 days of data) [2025-10-03T18:05:12.682146] [DEBUG] [LOCAL ] CMA: Primary data saved (50603 records). [2025-10-03T18:05:12.687838] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-03T18:05:12.689096] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CMA took 38.5s. Estimated remaining: 4h 20m 33s. Rate: 7.3 symbols/min [2025-10-03T18:05:12.688830] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T18:05:12.795777] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-03T18:05:12.891992] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:12.935915] [DEBUG] [LOCAL ] CMI: Loaded 42060 existing records from primary storage. [2025-10-03T18:05:12.936283] [INFO ] [MAIN ] CMI: Loaded 42060 existing records. [2025-10-03T18:05:13.142046] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:13.167433] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-03T18:05:13.170343] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-03T18:05:13.171104] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-03T18:05:13.172405] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-03T18:05:13.172316] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-03T18:05:13.584778] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:13.590700] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-03T18:05:14.390721] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-03T18:05:15.076970] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:05:15.190325] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:05:15.201223] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-03T18:05:15.990668] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-03T18:05:16.107335] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:05:16.140367] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T18:05:16.790723] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-03T18:05:17.590782] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-03T18:05:17.810080] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:05:18.367065] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:05:18.390718] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-03T18:05:19.190723] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-03T18:05:19.710616] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:05:19.814205] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:05:19.853428] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:05:19.990734] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-03T18:05:20.790737] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-03T18:05:21.590713] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-03T18:05:21.741604] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:05:22.106620] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T18:05:22.390708] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-03T18:05:22.854197] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T18:05:22.940896] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T18:05:23.190725] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-03T18:05:23.990722] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-03T18:05:24.769705] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:05:24.790638] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-03T18:05:25.590775] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-03T18:05:26.081466] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T18:05:26.177474] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:05:26.180260] [INFO ] [REMOTE ] CMC: Full fetch complete (66943 records). [2025-10-03T18:05:26.180390] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-03T18:05:26.391838] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-03T18:05:26.511805] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:05:26.652938] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-03T18:05:26.653033] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-03T18:05:26.653920] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-03T18:05:26.653997] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-03T18:05:26.655628] [DEBUG] [LOCAL ] CMC: Trimmed 66943 records to 46192 (keeping 200 days of data) [2025-10-03T18:05:26.958317] [DEBUG] [LOCAL ] CMC: Primary data saved (46192 records). [2025-10-03T18:05:26.958490] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-03T18:05:26.961023] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMC took 35.3s. Estimated remaining: 4h 20m 48s. Rate: 7.3 symbols/min [2025-10-03T18:05:27.182777] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:27.190729] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-03T18:05:27.223797] [DEBUG] [LOCAL ] CMP: Loaded 36460 existing records from primary storage. [2025-10-03T18:05:27.224125] [INFO ] [MAIN ] CMP: Loaded 36460 existing records. [2025-10-03T18:05:27.454749] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:27.454985] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-03T18:05:27.455061] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-03T18:05:27.455318] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-03T18:05:27.455406] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-03T18:05:27.916572] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:27.990746] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-03T18:05:28.615912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:05:28.619094] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-03T18:05:28.790718] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-03T18:05:29.166778] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:05:29.590714] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-03T18:05:30.390674] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-03T18:05:30.893870] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-03T18:05:31.190693] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-03T18:05:31.228970] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:05:31.990672] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-03T18:05:32.078135] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T18:05:32.790684] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-03T18:05:33.130241] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-03T18:05:33.307429] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:05:33.399570] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:05:33.590736] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-03T18:05:34.390744] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-03T18:05:35.190741] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-03T18:05:35.930959] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:05:35.935003] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T18:05:35.935155] [INFO ] [REMOTE ] CMCM: Full fetch complete (6969 records). [2025-10-03T18:05:35.949178] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-03T18:05:36.007936] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-03T18:05:36.085904] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:05:36.416249] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-03T18:05:36.416670] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-03T18:05:36.416926] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-03T18:05:36.416987] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-03T18:05:36.417427] [DEBUG] [LOCAL ] CMCM: Trimmed 6969 records to 4794 (keeping 200 days of data) [2025-10-03T18:05:36.449782] [DEBUG] [LOCAL ] CMCM: Primary data saved (4794 records). [2025-10-03T18:05:36.449928] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-03T18:05:36.450043] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMCM took 33.6s. Estimated remaining: 4h 20m 45s. Rate: 7.3 symbols/min [2025-10-03T18:05:36.638490] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:05:36.698760] [DEBUG] [LOCAL ] CMPO: Loaded 39512 existing records from primary storage. [2025-10-03T18:05:36.699102] [INFO ] [MAIN ] CMPO: Loaded 39512 existing records. [2025-10-03T18:05:36.796705] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-03T18:05:36.899881] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:05:36.900215] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-03T18:05:36.900306] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-03T18:05:36.900886] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-03T18:05:36.900946] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-03T18:05:37.288337] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:05:37.590744] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-03T18:05:38.390735] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-03T18:05:38.448440] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:05:38.539340] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-03T18:05:39.190693] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-03T18:05:39.348143] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:05:39.840618] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:05:39.990705] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-03T18:05:40.553592] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:05:40.790716] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-03T18:05:41.438202] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:05:41.590702] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-03T18:05:42.390694] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-03T18:05:43.024701] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:05:43.027994] [INFO ] [REMOTE ] CMI: Full fetch complete (60093 records). [2025-10-03T18:05:43.028134] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-03T18:05:43.192689] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-03T18:05:43.324923] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T18:05:43.611741] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-03T18:05:43.611846] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-03T18:05:43.612735] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-03T18:05:43.612827] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-03T18:05:43.616957] [DEBUG] [LOCAL ] CMI: Trimmed 60093 records to 42360 (keeping 200 days of data) [2025-10-03T18:05:43.938897] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:05:43.991082] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-03T18:05:44.031914] [DEBUG] [LOCAL ] CMI: Primary data saved (42360 records). [2025-10-03T18:05:44.032078] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-03T18:05:44.032188] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMI took 31.3s. Estimated remaining: 4h 20m 34s. Rate: 7.3 symbols/min [2025-10-03T18:05:44.732702] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:05:44.790737] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-03T18:05:45.439874] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:05:45.590696] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-03T18:05:46.290400] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:05:46.390702] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-03T18:05:47.190703] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-03T18:05:47.856821] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T18:05:47.859833] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-03T18:05:47.860034] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-03T18:05:48.323015] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:05:48.369987] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-03T18:05:48.370632] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-03T18:05:48.372295] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-03T18:05:48.372476] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-03T18:05:48.371118] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-03T18:05:48.375439] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54501 (keeping 200 days of data) [2025-10-03T18:05:48.717828] [DEBUG] [LOCAL ] CMG: Primary data saved (54501 records). [2025-10-03T18:05:48.718064] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-03T18:05:48.718214] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMG took 42.1s. Estimated remaining: 4h 20m 12s. Rate: 7.3 symbols/min [2025-10-03T18:05:49.023850] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:05:49.033862] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-03T18:05:49.889764] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:05:49.899073] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-03T18:05:50.614314] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:05:50.625260] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-03T18:05:51.482708] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:05:51.492818] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-03T18:05:52.107411] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:05:52.120861] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-03T18:05:52.781594] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:05:52.790620] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-03T18:05:53.567808] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T18:05:53.590621] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-03T18:05:54.078595] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:05:54.390690] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-03T18:05:54.683930] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T18:05:55.190701] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-03T18:05:55.734880] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T18:05:55.736773] [INFO ] [REMOTE ] CMP: Full fetch complete (52404 records). [2025-10-03T18:05:55.736904] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-03T18:05:56.162343] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-03T18:05:56.162431] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-03T18:05:56.163186] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-03T18:05:56.163253] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-03T18:05:56.164440] [DEBUG] [LOCAL ] CMP: Trimmed 52404 records to 36601 (keeping 200 days of data) [2025-10-03T18:05:56.385577] [DEBUG] [LOCAL ] CMP: Primary data saved (36601 records). [2025-10-03T18:05:56.385755] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-03T18:05:56.386198] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMP took 29.4s. Estimated remaining: 4h 20m 1s. Rate: 7.3 symbols/min [2025-10-03T18:05:56.698976] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:05:56.708810] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-03T18:05:58.205197] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T18:05:58.214374] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-03T18:05:59.327033] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:05:59.333314] [INFO ] [REMOTE ] CMPO: Full fetch complete (58891 records). [2025-10-03T18:05:59.333456] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-03T18:05:59.752610] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-03T18:05:59.752735] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-03T18:05:59.753461] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-03T18:05:59.753528] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-03T18:05:59.755026] [DEBUG] [LOCAL ] CMPO: Trimmed 58891 records to 39703 (keeping 200 days of data) [2025-10-03T18:05:59.995755] [DEBUG] [LOCAL ] CMPO: Primary data saved (39703 records). [2025-10-03T18:05:59.995915] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-03T18:05:59.996004] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMPO took 23.5s. Estimated remaining: 4h 19m 35s. Rate: 7.3 symbols/min [2025-10-03T18:06:00.723834] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.819708] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.790636] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.856599] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:00.865798] [DEBUG] [LOCAL ] CMSC: Loaded 5108 existing records from primary storage. [2025-10-03T18:06:00.866301] [INFO ] [MAIN ] CMSC: Loaded 5108 existing records. [2025-10-03T18:06:00.907518] [DEBUG] [LOCAL ] CMSA: Loaded 3530 existing records from primary storage. [2025-10-03T18:06:00.963587] [INFO ] [MAIN ] CMSA: Loaded 3530 existing records. [2025-10-03T18:06:01.062385] [DEBUG] [LOCAL ] CMRE: Loaded 35698 existing records from primary storage. [2025-10-03T18:06:01.140096] [INFO ] [MAIN ] CMRE: Loaded 35698 existing records. [2025-10-03T18:06:01.305125] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:01.349318] [DEBUG] [LOCAL ] CMS: Loaded 52995 existing records from primary storage. [2025-10-03T18:06:01.427376] [INFO ] [MAIN ] CMS: Loaded 52995 existing records. [2025-10-03T18:06:01.427185] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-03T18:06:01.464760] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-03T18:06:01.527556] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:01.553040] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-03T18:06:01.563886] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-03T18:06:01.569062] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-03T18:06:01.633988] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-03T18:06:01.639511] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-03T18:06:01.634215] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-03T18:06:01.952922] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:02.053508] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-03T18:06:02.053221] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:02.062103] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-03T18:06:02.067904] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-03T18:06:02.076749] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-03T18:06:02.080837] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-03T18:06:02.102187] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-03T18:06:02.091432] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-03T18:06:02.158263] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-03T18:06:03.077121] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.162701] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-03T18:06:03.242205] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.314925] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-03T18:06:03.440282] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.452518] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-03T18:06:03.530195] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:03.530904] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-03T18:06:04.110224] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:06:04.112202] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-03T18:06:04.185950] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T18:06:04.188244] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-03T18:06:04.741551] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:06:04.744567] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-03T18:06:04.842291] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T18:06:04.848282] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-03T18:06:04.901708] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:06:04.903617] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-03T18:06:05.289510] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-03T18:06:05.291018] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-03T18:06:05.338561] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:06:05.567415] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:06:05.590737] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-03T18:06:05.628796] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T18:06:05.750127] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T18:06:06.390709] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-03T18:06:07.008309] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-03T18:06:07.190698] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-03T18:06:07.376135] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:06:07.827229] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:06:07.990729] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-03T18:06:08.542549] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:06:08.790728] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-03T18:06:09.373081] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:06:09.590727] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-03T18:06:10.390703] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-03T18:06:10.440438] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T18:06:11.190711] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-03T18:06:11.767613] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T18:06:11.767401] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:06:11.990734] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-03T18:06:12.611772] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T18:06:12.790720] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-03T18:06:13.590700] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-03T18:06:14.232512] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T18:06:14.390683] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-03T18:06:14.436695] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:06:15.190708] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-03T18:06:15.957189] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T18:06:15.990718] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-03T18:06:16.790710] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-03T18:06:17.001011] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:06:17.357269] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:06:17.358066] [INFO ] [REMOTE ] CMSA: Full fetch complete (5107 records). [2025-10-03T18:06:17.358137] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-03T18:06:17.597241] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-03T18:06:17.721576] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:06:17.803968] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-03T18:06:17.804056] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-03T18:06:17.804219] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-03T18:06:17.804261] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-03T18:06:17.804861] [DEBUG] [LOCAL ] CMSA: Trimmed 5107 records to 3544 (keeping 200 days of data) [2025-10-03T18:06:17.827322] [DEBUG] [LOCAL ] CMSA: Primary data saved (3544 records). [2025-10-03T18:06:17.827467] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-03T18:06:17.827556] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 17.8s. Estimated remaining: 4h 20m 4s. Rate: 7.3 symbols/min [2025-10-03T18:06:18.024438] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:18.037221] [DEBUG] [LOCAL ] CMSD: Loaded 8137 existing records from primary storage. [2025-10-03T18:06:18.037469] [INFO ] [MAIN ] CMSD: Loaded 8137 existing records. [2025-10-03T18:06:18.241681] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:18.242108] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-03T18:06:18.242282] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-03T18:06:18.242609] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-03T18:06:18.242722] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-03T18:06:18.380990] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T18:06:18.397292] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-03T18:06:18.659106] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:19.190719] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-03T18:06:19.990635] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-03T18:06:20.202684] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:06:20.315340] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:06:20.790747] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-03T18:06:21.381721] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:06:21.435067] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:06:21.590707] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-03T18:06:22.193598] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:06:22.390713] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-03T18:06:22.819933] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T18:06:23.190723] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-03T18:06:23.990709] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-03T18:06:24.557851] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T18:06:24.790689] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-03T18:06:25.060448] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T18:06:25.590694] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-03T18:06:25.659989] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T18:06:26.171873] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:06:26.172885] [INFO ] [REMOTE ] CMSC: Full fetch complete (7187 records). [2025-10-03T18:06:26.172960] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-03T18:06:26.395853] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-03T18:06:26.587260] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-03T18:06:26.587349] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-03T18:06:26.587568] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-03T18:06:26.587630] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-03T18:06:26.588117] [DEBUG] [LOCAL ] CMSC: Trimmed 7187 records to 5138 (keeping 200 days of data) [2025-10-03T18:06:26.621014] [DEBUG] [LOCAL ] CMSC: Primary data saved (5138 records). [2025-10-03T18:06:26.621162] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-03T18:06:26.621288] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMSC took 26.6s. Estimated remaining: 4h 19m 58s. Rate: 7.3 symbols/min [2025-10-03T18:06:26.805098] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:26.842401] [DEBUG] [LOCAL ] CMTG: Loaded 37088 existing records from primary storage. [2025-10-03T18:06:26.842747] [INFO ] [MAIN ] CMTG: Loaded 37088 existing records. [2025-10-03T18:06:27.063511] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:27.064014] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-03T18:06:27.064077] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-03T18:06:27.064309] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-03T18:06:27.064380] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-03T18:06:27.195821] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-03T18:06:27.458538] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:27.990736] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-03T18:06:28.265082] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:06:28.714377] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:06:28.790781] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-03T18:06:29.118696] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:06:29.590698] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-03T18:06:30.244727] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T18:06:30.390714] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-03T18:06:30.981572] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:06:31.190745] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-03T18:06:31.800861] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:06:31.990715] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-03T18:06:32.790756] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-03T18:06:32.962620] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:06:33.377411] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:06:33.381170] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:06:33.590729] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-03T18:06:34.390727] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-03T18:06:35.031391] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:06:35.190727] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-03T18:06:35.990780] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-03T18:06:36.127303] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:06:36.384279] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:06:36.387257] [INFO ] [REMOTE ] CMRE: Full fetch complete (50086 records). [2025-10-03T18:06:36.387561] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-03T18:06:36.800748] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-03T18:06:37.012308] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-03T18:06:37.012445] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-03T18:06:37.013575] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-03T18:06:37.013773] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-03T18:06:37.015603] [DEBUG] [LOCAL ] CMRE: Trimmed 50086 records to 35928 (keeping 200 days of data) [2025-10-03T18:06:37.246347] [DEBUG] [LOCAL ] CMRE: Primary data saved (35928 records). [2025-10-03T18:06:37.246737] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-03T18:06:37.246869] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMRE took 37.2s. Estimated remaining: 4h 19m 59s. Rate: 7.3 symbols/min [2025-10-03T18:06:37.452478] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:37.461761] [DEBUG] [LOCAL ] CMU: Loaded 6891 existing records from primary storage. [2025-10-03T18:06:37.462020] [INFO ] [MAIN ] CMU: Loaded 6891 existing records. [2025-10-03T18:06:37.595073] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-03T18:06:37.702300] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T18:06:37.706629] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:37.727103] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-03T18:06:37.727311] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-03T18:06:37.727637] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-03T18:06:37.727979] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-03T18:06:37.766338] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T18:06:38.125070] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:38.390728] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-03T18:06:39.147592] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:06:39.190639] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-03T18:06:39.452956] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T18:06:39.961717] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:06:39.990614] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-03T18:06:40.695352] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T18:06:40.790711] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-03T18:06:41.590690] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-03T18:06:42.390672] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-03T18:06:42.514298] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:06:42.552092] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:06:43.190696] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-03T18:06:43.990635] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-03T18:06:43.992263] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:06:43.995116] [INFO ] [REMOTE ] CMS: Full fetch complete (76018 records). [2025-10-03T18:06:43.995219] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-03T18:06:44.434423] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-03T18:06:44.434563] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-03T18:06:44.435599] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-03T18:06:44.435693] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-03T18:06:44.437218] [DEBUG] [LOCAL ] CMS: Trimmed 76018 records to 53374 (keeping 200 days of data) [2025-10-03T18:06:44.716240] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T18:06:44.712505] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:06:44.805823] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-03T18:06:44.832674] [DEBUG] [LOCAL ] CMS: Primary data saved (53374 records). [2025-10-03T18:06:44.832817] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-03T18:06:44.832937] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 44.8s. Estimated remaining: 4h 19m 48s. Rate: 7.3 symbols/min [2025-10-03T18:06:45.010317] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:45.042942] [DEBUG] [LOCAL ] CNA: Loaded 33010 existing records from primary storage. [2025-10-03T18:06:45.043257] [INFO ] [MAIN ] CNA: Loaded 33010 existing records. [2025-10-03T18:06:45.233388] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:45.233609] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-03T18:06:45.233687] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-03T18:06:45.233958] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-03T18:06:45.234019] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-03T18:06:45.554201] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:06:45.597579] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-03T18:06:45.643769] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:46.208415] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T18:06:46.390705] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-03T18:06:47.190708] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-03T18:06:47.636475] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T18:06:47.836939] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:06:47.990678] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-03T18:06:48.690758] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T18:06:48.790711] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-03T18:06:49.590752] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-03T18:06:50.165343] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:06:50.349903] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:06:50.390698] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-03T18:06:51.190711] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-03T18:06:51.990683] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-03T18:06:52.034910] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T18:06:52.082461] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:06:52.790689] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-03T18:06:53.237214] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:06:53.590688] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-03T18:06:54.213754] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T18:06:54.217509] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:06:54.390738] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-03T18:06:54.968110] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:06:55.190747] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-03T18:06:55.961457] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:06:55.962437] [INFO ] [REMOTE ] CMSD: Full fetch complete (12342 records). [2025-10-03T18:06:55.962512] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-03T18:06:55.995809] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-03T18:06:56.364385] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-03T18:06:56.364506] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-03T18:06:56.364876] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-03T18:06:56.364959] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-03T18:06:56.365804] [DEBUG] [LOCAL ] CMSD: Trimmed 12342 records to 8171 (keeping 200 days of data) [2025-10-03T18:06:56.419375] [DEBUG] [LOCAL ] CMSD: Primary data saved (8171 records). [2025-10-03T18:06:56.419604] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-03T18:06:56.419790] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 38.6s. Estimated remaining: 4h 19m 53s. Rate: 7.3 symbols/min [2025-10-03T18:06:56.610631] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:06:56.682536] [DEBUG] [LOCAL ] CNC: Loaded 54129 existing records from primary storage. [2025-10-03T18:06:56.682935] [INFO ] [MAIN ] CNC: Loaded 54129 existing records. [2025-10-03T18:06:56.791048] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-03T18:06:56.876384] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:06:56.876591] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-03T18:06:56.876663] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-03T18:06:56.876988] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-03T18:06:56.877050] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-03T18:06:57.259288] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T18:06:57.299059] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:06:57.590743] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-03T18:06:58.096490] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T18:06:58.390688] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-03T18:06:59.190691] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-03T18:06:59.256073] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:06:59.724212] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:06:59.990694] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-03T18:07:00.331544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:07:00.333356] [INFO ] [REMOTE ] CMTG: Full fetch complete (53626 records). [2025-10-03T18:07:00.333474] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-03T18:07:00.752021] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-03T18:07:00.752138] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-03T18:07:00.752807] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-03T18:07:00.752875] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-03T18:07:00.754636] [DEBUG] [LOCAL ] CMTG: Trimmed 53626 records to 37256 (keeping 200 days of data) [2025-10-03T18:07:00.806680] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-03T18:07:00.977164] [DEBUG] [LOCAL ] CMTG: Primary data saved (37256 records). [2025-10-03T18:07:00.977328] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-03T18:07:00.977423] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMTG took 34.4s. Estimated remaining: 4h 19m 30s. Rate: 7.3 symbols/min [2025-10-03T18:07:01.163568] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:01.163768] [DEBUG] [LOCAL ] CNF: No existing data file found in primary storage. [2025-10-03T18:07:01.163814] [WARN ] [MAIN ] CNF: No existing data found, performing full refresh instead. [2025-10-03T18:07:01.163933] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-03T18:07:01.163977] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-03T18:07:01.164023] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-03T18:07:01.164060] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-03T18:07:01.586535] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:01.600249] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-03T18:07:01.616829] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:07:01.872249] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:07:02.390714] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-03T18:07:02.398175] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:07:03.190688] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-03T18:07:03.765743] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T18:07:03.990628] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-03T18:07:04.091823] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:07:04.292046] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-03T18:07:04.790689] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-03T18:07:05.590727] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-03T18:07:06.138700] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:07:06.332966] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T18:07:06.390724] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-03T18:07:07.190735] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-03T18:07:07.856767] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:07:07.990669] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-03T18:07:08.112105] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:07:08.790705] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-03T18:07:09.292038] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T18:07:09.292912] [INFO ] [REMOTE ] CMU: Full fetch complete (9680 records). [2025-10-03T18:07:09.292984] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-03T18:07:09.513954] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:07:09.596357] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-03T18:07:09.741122] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-03T18:07:09.741203] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-03T18:07:09.741470] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-03T18:07:09.741512] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-03T18:07:09.742433] [DEBUG] [LOCAL ] CMU: Trimmed 9680 records to 6911 (keeping 200 days of data) [2025-10-03T18:07:09.787788] [DEBUG] [LOCAL ] CMU: Primary data saved (6911 records). [2025-10-03T18:07:09.787938] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-03T18:07:09.788056] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMU took 32.5s. Estimated remaining: 4h 19m 24s. Rate: 7.3 symbols/min [2025-10-03T18:07:09.996504] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:10.063011] [DEBUG] [LOCAL ] CNH: Loaded 53944 existing records from primary storage. [2025-10-03T18:07:10.063443] [INFO ] [MAIN ] CNH: Loaded 53944 existing records. [2025-10-03T18:07:10.269260] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:10.269519] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-03T18:07:10.269579] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-03T18:07:10.269853] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-03T18:07:10.269915] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-03T18:07:10.395979] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-03T18:07:10.651820] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:11.190730] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-03T18:07:11.284774] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-03T18:07:11.743975] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T18:07:11.990720] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-03T18:07:12.790726] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-03T18:07:13.106190] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:07:13.590697] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-03T18:07:13.940188] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:07:14.328184] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:07:14.390675] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-03T18:07:15.190686] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-03T18:07:15.310609] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:07:15.599431] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:07:15.990635] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-03T18:07:15.996900] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T18:07:16.790716] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-03T18:07:17.590619] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-03T18:07:17.842879] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:07:18.052498] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:07:18.069928] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T18:07:18.390714] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-03T18:07:19.190685] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-03T18:07:19.990679] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-03T18:07:20.140546] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T18:07:20.265794] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:07:20.790699] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-03T18:07:21.590691] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-03T18:07:21.690027] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:07:22.372622] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T18:07:22.390660] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-03T18:07:22.627238] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:07:23.190702] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-03T18:07:23.255162] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:07:23.258847] [INFO ] [REMOTE ] CNA: Full fetch complete (45615 records). [2025-10-03T18:07:23.258973] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-03T18:07:23.717479] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-03T18:07:23.717592] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-03T18:07:23.718364] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-03T18:07:23.718479] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-03T18:07:23.719993] [DEBUG] [LOCAL ] CNA: Trimmed 45615 records to 33259 (keeping 200 days of data) [2025-10-03T18:07:23.941254] [DEBUG] [LOCAL ] CNA: Primary data saved (33259 records). [2025-10-03T18:07:23.941411] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-03T18:07:23.941561] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNA took 39.1s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-03T18:07:23.995755] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-03T18:07:24.135679] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:24.145438] [DEBUG] [LOCAL ] CNI: No existing data file found in primary storage. [2025-10-03T18:07:24.146528] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:07:24.146585] [WARN ] [MAIN ] CNI: No existing data found, performing full refresh instead. [2025-10-03T18:07:24.150471] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-03T18:07:24.150864] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-03T18:07:24.151245] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-03T18:07:24.151295] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-03T18:07:24.547477] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:24.790717] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-03T18:07:25.590767] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-03T18:07:25.738606] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T18:07:26.021046] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:07:26.390725] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-03T18:07:27.190623] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-03T18:07:27.245802] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:07:27.246717] [INFO ] [REMOTE ] CNF: Full fetch complete (12963 records). [2025-10-03T18:07:27.246792] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-03T18:07:27.247322] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:07:27.247419] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:07:27.247464] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:07:27.247529] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-03T18:07:27.247618] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-03T18:07:27.247711] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-03T18:07:27.247785] [DEBUG] [LOCAL ] CNF: No derivative data file found to delete. [2025-10-03T18:07:27.247863] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNF took 26.3s. Estimated remaining: 4h 19m 11s. Rate: 7.3 symbols/min [2025-10-03T18:07:27.496977] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:27.500633] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T18:07:27.562624] [DEBUG] [LOCAL ] CNK: Loaded 53264 existing records from primary storage. [2025-10-03T18:07:27.562981] [INFO ] [MAIN ] CNK: Loaded 53264 existing records. [2025-10-03T18:07:27.759633] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:27.759916] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-03T18:07:27.759988] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-03T18:07:27.760253] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-03T18:07:27.760313] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-03T18:07:27.999368] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-03T18:07:28.154749] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:28.790749] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-03T18:07:28.873370] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:07:29.590727] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-03T18:07:30.048499] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T18:07:30.390722] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-03T18:07:31.190748] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-03T18:07:31.456786] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-03T18:07:31.512072] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:07:31.990707] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-03T18:07:32.122005] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:07:32.790636] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-03T18:07:32.903967] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:07:33.590679] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-03T18:07:33.632340] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T18:07:34.390706] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-03T18:07:35.038428] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-03T18:07:35.190707] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-03T18:07:35.250404] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:07:35.990742] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-03T18:07:36.416979] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:07:36.790705] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-03T18:07:37.387321] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-03T18:07:37.590690] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-03T18:07:37.774633] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:07:38.380988] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:07:38.383952] [INFO ] [REMOTE ] CNH: Full fetch complete (77536 records). [2025-10-03T18:07:38.384081] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-03T18:07:38.397967] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-03T18:07:38.866748] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-03T18:07:38.866910] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-03T18:07:38.868156] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-03T18:07:38.868236] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-03T18:07:38.869960] [DEBUG] [LOCAL ] CNH: Trimmed 77536 records to 54333 (keeping 200 days of data) [2025-10-03T18:07:39.199352] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-03T18:07:39.229868] [DEBUG] [LOCAL ] CNH: Primary data saved (54333 records). [2025-10-03T18:07:39.230036] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-03T18:07:39.230125] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNH took 29.4s. Estimated remaining: 4h 19m 17s. Rate: 7.3 symbols/min [2025-10-03T18:07:39.420805] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:39.453935] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T18:07:39.512130] [DEBUG] [LOCAL ] CNM: Loaded 51367 existing records from primary storage. [2025-10-03T18:07:39.512469] [INFO ] [MAIN ] CNM: Loaded 51367 existing records. [2025-10-03T18:07:39.711227] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:39.711463] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-03T18:07:39.711512] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-03T18:07:39.711829] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-03T18:07:39.711890] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-03T18:07:39.995783] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-03T18:07:40.108150] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:40.591050] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-03T18:07:40.599466] [INFO ] [REMOTE ] CNC: Full fetch complete (77673 records). [2025-10-03T18:07:40.599601] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-03T18:07:40.796610] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-03T18:07:41.052015] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-03T18:07:41.052137] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-03T18:07:41.053180] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-03T18:07:41.053272] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-03T18:07:41.055254] [DEBUG] [LOCAL ] CNC: Trimmed 77673 records to 54518 (keeping 200 days of data) [2025-10-03T18:07:41.169296] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:07:41.424239] [DEBUG] [LOCAL ] CNC: Primary data saved (54518 records). [2025-10-03T18:07:41.424386] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-03T18:07:41.425299] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNC took 45.0s. Estimated remaining: 4h 18m 45s. Rate: 7.3 symbols/min [2025-10-03T18:07:41.597594] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-03T18:07:41.634343] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:07:41.674979] [DEBUG] [LOCAL ] CNMD: Loaded 32498 existing records from primary storage. [2025-10-03T18:07:41.675311] [INFO ] [MAIN ] CNMD: Loaded 32498 existing records. [2025-10-03T18:07:41.899415] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:07:41.900248] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-03T18:07:41.900381] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-03T18:07:41.900812] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-03T18:07:41.900965] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-03T18:07:42.266362] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T18:07:42.384502] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:07:42.398920] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-03T18:07:42.422451] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:07:43.174116] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:07:43.190613] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-03T18:07:43.733240] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:07:43.990706] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-03T18:07:44.790675] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-03T18:07:44.884152] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:07:45.382690] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:07:45.590691] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-03T18:07:46.185891] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:07:46.390692] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-03T18:07:46.985498] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:07:47.190706] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-03T18:07:47.866231] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:07:47.990696] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-03T18:07:48.790632] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-03T18:07:49.133961] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:07:49.596286] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-03T18:07:49.615971] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:07:50.268546] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:07:50.390694] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-03T18:07:50.723235] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:07:51.190724] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-03T18:07:51.990678] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-03T18:07:52.105690] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T18:07:52.794313] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-03T18:07:52.800621] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T18:07:53.145360] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T18:07:53.590742] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-03T18:07:54.390699] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-03T18:07:54.729690] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:07:55.190696] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-03T18:07:55.291070] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:07:55.998969] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-03T18:07:56.021252] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:07:56.611147] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T18:07:56.790714] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-03T18:07:57.590634] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-03T18:07:57.636890] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:07:58.390746] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-03T18:07:58.535909] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:07:58.983872] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:07:59.190731] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-03T18:07:59.689537] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:07:59.990634] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-03T18:08:00.790697] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-03T18:08:01.280745] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-03T18:08:01.590638] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-03T18:08:01.661235] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:08:02.345927] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:08:02.390626] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-03T18:08:02.947549] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T18:08:03.190722] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-03T18:08:03.990731] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-03T18:08:04.161725] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:08:04.165506] [INFO ] [REMOTE ] CNI: Full fetch complete (74595 records). [2025-10-03T18:08:04.165694] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-03T18:08:04.591686] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-03T18:08:04.591847] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-03T18:08:04.592815] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-03T18:08:04.592881] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-03T18:08:04.594343] [DEBUG] [LOCAL ] CNI: Trimmed 74595 records to 52388 (keeping 200 days of data) [2025-10-03T18:08:04.794587] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-03T18:08:04.865387] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:08:04.980393] [DEBUG] [LOCAL ] CNI: Primary data saved (52388 records). [2025-10-03T18:08:04.980543] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-03T18:08:04.980634] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 41.0s. Estimated remaining: 4h 19m 35s. Rate: 7.2 symbols/min [2025-10-03T18:08:05.171636] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:05.209737] [DEBUG] [LOCAL ] CNNE: Loaded 36641 existing records from primary storage. [2025-10-03T18:08:05.210050] [INFO ] [MAIN ] CNNE: Loaded 36641 existing records. [2025-10-03T18:08:05.426541] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:05.426913] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-03T18:08:05.427038] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-03T18:08:05.427474] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-03T18:08:05.427591] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-03T18:08:05.598471] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-03T18:08:05.691046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:08:05.850120] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:06.390696] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-03T18:08:06.489461] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:08:06.492760] [INFO ] [REMOTE ] CNK: Full fetch complete (75812 records). [2025-10-03T18:08:06.492905] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-03T18:08:06.919083] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-03T18:08:06.919176] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-03T18:08:06.920493] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-03T18:08:06.920565] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-03T18:08:06.922397] [DEBUG] [LOCAL ] CNK: Trimmed 75812 records to 53649 (keeping 200 days of data) [2025-10-03T18:08:07.217271] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-03T18:08:07.274979] [DEBUG] [LOCAL ] CNK: Primary data saved (53649 records). [2025-10-03T18:08:07.275254] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-03T18:08:07.276241] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNK took 40.0s. Estimated remaining: 4h 19m 4s. Rate: 7.2 symbols/min [2025-10-03T18:08:07.488155] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:07.527334] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-03T18:08:07.579314] [DEBUG] [LOCAL ] CNO: Loaded 41454 existing records from primary storage. [2025-10-03T18:08:07.579664] [INFO ] [MAIN ] CNO: Loaded 41454 existing records. [2025-10-03T18:08:07.779568] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:07.779896] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-03T18:08:07.779977] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-03T18:08:07.788209] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-10-03T18:08:07.788305] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-03T18:08:07.900769] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:08:07.997127] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-03T18:08:08.202535] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:08.218148] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:08:08.790738] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-03T18:08:09.136575] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:08:09.590706] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-03T18:08:10.374226] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:08:10.378602] [INFO ] [REMOTE ] CNM: Full fetch complete (73646 records). [2025-10-03T18:08:10.378732] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-03T18:08:10.395785] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-03T18:08:10.801363] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-03T18:08:10.806673] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-03T18:08:10.816531] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-03T18:08:10.817993] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:08:10.817215] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-03T18:08:10.825570] [DEBUG] [LOCAL ] CNM: Trimmed 73646 records to 51723 (keeping 200 days of data) [2025-10-03T18:08:11.130130] [DEBUG] [LOCAL ] CNM: Primary data saved (51723 records). [2025-10-03T18:08:11.130273] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-03T18:08:11.130371] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNM took 31.9s. Estimated remaining: 4h 18m 39s. Rate: 7.3 symbols/min [2025-10-03T18:08:11.199165] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-03T18:08:11.318933] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:11.374538] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-10-03T18:08:11.374987] [INFO ] [MAIN ] CNP: Loaded 53859 existing records. [2025-10-03T18:08:11.560794] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:11.561060] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-03T18:08:11.561115] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-03T18:08:11.562882] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-03T18:08:11.562946] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-03T18:08:11.879766] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:08:11.899695] [INFO ] [REMOTE ] CNMD: Full fetch complete (47344 records). [2025-10-03T18:08:11.922864] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-03T18:08:12.009876] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:11.997781] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-03T18:08:12.394895] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-03T18:08:12.394981] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-03T18:08:12.395615] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-03T18:08:12.395689] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-03T18:08:12.396877] [DEBUG] [LOCAL ] CNMD: Trimmed 47344 records to 32705 (keeping 200 days of data) [2025-10-03T18:08:12.603818] [DEBUG] [LOCAL ] CNMD: Primary data saved (32705 records). [2025-10-03T18:08:12.604105] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-03T18:08:12.604968] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNMD took 31.2s. Estimated remaining: 4h 18m 5s. Rate: 7.3 symbols/min [2025-10-03T18:08:12.788513] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:12.790684] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-03T18:08:12.852189] [DEBUG] [LOCAL ] CNQ: Loaded 53970 existing records from primary storage. [2025-10-03T18:08:12.852610] [INFO ] [MAIN ] CNQ: Loaded 53970 existing records. [2025-10-03T18:08:13.022941] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:08:13.090188] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:13.090499] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-03T18:08:13.090626] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-03T18:08:13.097320] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-03T18:08:13.106690] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-03T18:08:13.113330] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:08:13.511572] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:13.590693] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-03T18:08:14.390687] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-03T18:08:14.662044] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:08:15.190706] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-03T18:08:15.488009] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:08:15.879144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:08:15.990747] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-03T18:08:16.790670] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-03T18:08:16.950304] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:08:17.590705] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-03T18:08:17.736446] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:08:18.390623] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-03T18:08:18.595963] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T18:08:18.833836] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:08:19.190735] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-03T18:08:19.984562] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:08:19.994047] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-03T18:08:20.790634] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-03T18:08:20.835529] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:08:20.979550] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:08:21.590702] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-03T18:08:22.390733] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-03T18:08:22.513384] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:08:23.190703] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-03T18:08:23.417830] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:08:23.579379] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T18:08:23.990691] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-03T18:08:24.790682] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-03T18:08:25.255087] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T18:08:25.556830] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T18:08:25.590730] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-03T18:08:26.390683] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-03T18:08:26.625894] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:08:27.179105] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:08:27.190626] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-03T18:08:27.784909] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:08:27.990727] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-03T18:08:28.488669] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:08:28.790790] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-03T18:08:29.590785] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-03T18:08:29.749242] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:08:29.855364] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:08:30.390725] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-03T18:08:31.068118] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T18:08:31.190722] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-03T18:08:31.990730] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-03T18:08:32.228375] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:08:32.469044] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T18:08:32.790701] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-03T18:08:33.590668] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-03T18:08:34.005091] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T18:08:34.167955] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T18:08:34.390688] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-03T18:08:35.190697] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-03T18:08:35.467873] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:08:35.990721] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-03T18:08:36.721768] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-03T18:08:36.790675] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-03T18:08:37.174098] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T18:08:37.590916] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-03T18:08:37.805704] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:08:37.944709] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T18:08:37.947766] [INFO ] [REMOTE ] CNNE: Full fetch complete (50015 records). [2025-10-03T18:08:37.947935] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-03T18:08:38.395893] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-03T18:08:38.483276] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-03T18:08:38.483402] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-03T18:08:38.484288] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-03T18:08:38.484363] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-03T18:08:38.485804] [DEBUG] [LOCAL ] CNNE: Trimmed 50015 records to 36931 (keeping 200 days of data) [2025-10-03T18:08:38.746330] [DEBUG] [LOCAL ] CNNE: Primary data saved (36931 records). [2025-10-03T18:08:38.746547] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-03T18:08:38.746741] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNNE took 33.8s. Estimated remaining: 4h 19m 4s. Rate: 7.2 symbols/min [2025-10-03T18:08:38.967728] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:38.968025] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-03T18:08:38.968135] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-03T18:08:38.968380] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-03T18:08:38.968703] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-03T18:08:38.977410] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-03T18:08:38.982741] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-03T18:08:39.072172] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:08:39.194105] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-03T18:08:39.425272] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:39.943160] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T18:08:39.990713] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-03T18:08:40.182730] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:08:40.183129] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-03T18:08:40.183217] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:08:40.183267] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-03T18:08:40.183330] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:08:40.183403] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-03T18:08:40.183549] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-03T18:08:40.183602] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-03T18:08:40.183710] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-03T18:08:40.183771] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNR took 1.4s. Estimated remaining: 4h 18m 30s. Rate: 7.2 symbols/min [2025-10-03T18:08:40.366177] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:40.387442] [DEBUG] [LOCAL ] CNS: Loaded 20779 existing records from primary storage. [2025-10-03T18:08:40.387734] [INFO ] [MAIN ] CNS: Loaded 20779 existing records. [2025-10-03T18:08:40.583313] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:40.583530] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-03T18:08:40.583581] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-03T18:08:40.584253] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-03T18:08:40.584316] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-03T18:08:40.790751] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-03T18:08:41.017713] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:08:41.016202] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:41.590698] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-03T18:08:42.390689] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-03T18:08:42.592508] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:08:42.814862] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:08:42.817036] [INFO ] [REMOTE ] CNO: Full fetch complete (60639 records). [2025-10-03T18:08:42.817188] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-03T18:08:43.195780] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-03T18:08:43.254703] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-03T18:08:43.254821] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-03T18:08:43.255711] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-03T18:08:43.255780] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-03T18:08:43.257345] [DEBUG] [LOCAL ] CNO: Trimmed 60639 records to 41722 (keeping 200 days of data) [2025-10-03T18:08:43.531089] [DEBUG] [LOCAL ] CNO: Primary data saved (41722 records). [2025-10-03T18:08:43.531225] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-03T18:08:43.532003] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNO took 36.3s. Estimated remaining: 4h 18m 3s. Rate: 7.3 symbols/min [2025-10-03T18:08:43.715467] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:43.715730] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-10-03T18:08:43.715790] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-10-03T18:08:43.715920] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-03T18:08:43.715969] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-03T18:08:43.716013] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-03T18:08:43.716047] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-03T18:08:43.991460] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-03T18:08:44.126212] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:44.141967] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T18:08:44.144769] [INFO ] [REMOTE ] CNP: Full fetch complete (77369 records). [2025-10-03T18:08:44.144909] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-03T18:08:44.561267] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:08:44.627709] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-03T18:08:44.627835] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-03T18:08:44.628885] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-03T18:08:44.628956] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-03T18:08:44.630563] [DEBUG] [LOCAL ] CNP: Trimmed 77369 records to 54248 (keeping 200 days of data) [2025-10-03T18:08:44.814267] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-03T18:08:44.978628] [DEBUG] [LOCAL ] CNP: Primary data saved (54248 records). [2025-10-03T18:08:44.978821] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-03T18:08:44.978935] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNP took 33.8s. Estimated remaining: 4h 17m 30s. Rate: 7.3 symbols/min [2025-10-03T18:08:45.157379] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:08:45.198254] [DEBUG] [LOCAL ] CODI: Loaded 40283 existing records from primary storage. [2025-10-03T18:08:45.198626] [INFO ] [MAIN ] CODI: Loaded 40283 existing records. [2025-10-03T18:08:45.393935] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:08:45.394169] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-03T18:08:45.394227] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-03T18:08:45.395595] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-03T18:08:45.395726] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-03T18:08:45.600232] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-03T18:08:45.811670] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:08:45.903373] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:08:46.390696] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-03T18:08:46.533964] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:08:46.896967] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:08:47.190685] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-03T18:08:47.628830] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:08:47.990682] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-03T18:08:48.790631] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-03T18:08:48.922632] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:08:49.109477] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:08:49.590697] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-03T18:08:49.874556] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:08:50.390736] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-03T18:08:51.189605] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:08:51.199569] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-03T18:08:51.475034] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T18:08:51.990665] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-03T18:08:51.993164] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:08:52.790631] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-03T18:08:53.180177] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:08:53.590726] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-03T18:08:54.390694] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-03T18:08:54.468223] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:08:54.577117] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:08:55.190730] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-03T18:08:55.884585] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-03T18:08:55.990635] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-03T18:08:56.219918] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T18:08:56.795853] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-03T18:08:56.805951] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T18:08:57.551696] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:08:57.590681] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-03T18:08:58.390698] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-03T18:08:58.640679] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:08:59.190694] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-03T18:08:59.942959] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:08:59.945886] [INFO ] [REMOTE ] CNQ: Full fetch complete (77552 records). [2025-10-03T18:08:59.946019] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-03T18:08:59.994741] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-03T18:09:00.394553] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:09:00.428279] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-03T18:09:00.428985] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-03T18:09:00.430440] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-03T18:09:00.430558] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-03T18:09:00.432790] [DEBUG] [LOCAL ] CNQ: Trimmed 77552 records to 54359 (keeping 200 days of data) [2025-10-03T18:09:00.790960] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-03T18:09:00.819044] [DEBUG] [LOCAL ] CNQ: Primary data saved (54359 records). [2025-10-03T18:09:00.819175] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-03T18:09:00.820904] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNQ took 48.2s. Estimated remaining: 4h 17m 50s. Rate: 7.3 symbols/min [2025-10-03T18:09:01.003568] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:01.064153] [DEBUG] [LOCAL ] COF: Loaded 53999 existing records from primary storage. [2025-10-03T18:09:01.064518] [INFO ] [MAIN ] COF: Loaded 53999 existing records. [2025-10-03T18:09:01.254064] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:01.254283] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-03T18:09:01.254341] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-03T18:09:01.256419] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-03T18:09:01.256500] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-03T18:09:01.593690] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-03T18:09:01.681222] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:01.769531] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:09:01.771073] [INFO ] [REMOTE ] CNS: Full fetch complete (30091 records). [2025-10-03T18:09:01.788977] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-03T18:09:01.792398] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:09:01.793709] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:09:01.793914] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:09:01.801610] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:09:01.802486] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-03T18:09:01.802568] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-03T18:09:01.802608] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-03T18:09:01.802996] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-03T18:09:01.803101] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNS took 21.6s. Estimated remaining: 4h 17m 14s. Rate: 7.3 symbols/min [2025-10-03T18:09:01.987863] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:01.988164] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-03T18:09:01.988220] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-03T18:09:01.988340] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-03T18:09:01.988382] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-03T18:09:01.988426] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-03T18:09:01.988460] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-03T18:09:02.365402] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:02.390692] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-03T18:09:03.190688] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-03T18:09:03.351737] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:09:03.990681] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-03T18:09:04.478766] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:09:04.553413] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T18:09:04.790689] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-03T18:09:05.590688] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-03T18:09:05.753053] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:09:06.390737] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-03T18:09:06.784626] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-03T18:09:07.190745] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-03T18:09:07.599663] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T18:09:07.990624] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-03T18:09:08.029407] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:09:08.790688] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-03T18:09:08.959002] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T18:09:09.563809] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:09:09.590698] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-03T18:09:10.390714] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-03T18:09:10.730757] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T18:09:11.190675] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-03T18:09:11.271451] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:09:11.990672] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-03T18:09:12.104218] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:09:12.790672] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-03T18:09:13.035868] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:09:13.590712] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-03T18:09:13.730963] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:09:14.345868] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T18:09:14.390668] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-03T18:09:15.190708] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-03T18:09:15.704774] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:09:15.990727] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-03T18:09:16.057548] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:09:16.557715] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:09:16.790690] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-03T18:09:17.590695] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-03T18:09:17.992690] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:09:17.994867] [INFO ] [REMOTE ] CODI: Full fetch complete (51146 records). [2025-10-03T18:09:17.994963] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-03T18:09:18.151875] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:09:18.405078] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-03T18:09:18.467415] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-03T18:09:18.467515] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-03T18:09:18.468221] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-03T18:09:18.468291] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-03T18:09:18.469606] [DEBUG] [LOCAL ] CODI: Trimmed 51146 records to 40570 (keeping 200 days of data) [2025-10-03T18:09:18.722866] [DEBUG] [LOCAL ] CODI: Primary data saved (40570 records). [2025-10-03T18:09:18.723097] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-03T18:09:18.723380] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CODI took 33.7s. Estimated remaining: 4h 17m 38s. Rate: 7.3 symbols/min [2025-10-03T18:09:18.905774] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:18.968474] [DEBUG] [LOCAL ] COLD: Loaded 52465 existing records from primary storage. [2025-10-03T18:09:18.968965] [INFO ] [MAIN ] COLD: Loaded 52465 existing records. [2025-10-03T18:09:19.163585] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:19.163898] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-03T18:09:19.163954] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-03T18:09:19.166263] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-03T18:09:19.166330] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-03T18:09:19.198043] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-03T18:09:19.600270] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:19.640251] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T18:09:19.990696] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-03T18:09:20.217666] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:09:20.790707] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-03T18:09:21.326369] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-03T18:09:21.590736] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-03T18:09:21.645766] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:09:22.390753] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-03T18:09:22.439674] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T18:09:22.442251] [INFO ] [REMOTE ] CNX: Full fetch complete (74724 records). [2025-10-03T18:09:22.442366] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-03T18:09:22.882805] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-03T18:09:22.882900] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-03T18:09:22.883801] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-03T18:09:22.883869] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-03T18:09:22.885527] [DEBUG] [LOCAL ] CNX: Trimmed 74724 records to 52109 (keeping 200 days of data) [2025-10-03T18:09:23.191849] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-03T18:09:23.216887] [DEBUG] [LOCAL ] CNX: Primary data saved (52109 records). [2025-10-03T18:09:23.217076] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-03T18:09:23.217194] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CNX took 39.7s. Estimated remaining: 4h 17m 16s. Rate: 7.3 symbols/min [2025-10-03T18:09:23.406696] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:23.406891] [DEBUG] [LOCAL ] COMP: No existing data file found in primary storage. [2025-10-03T18:09:23.406938] [WARN ] [MAIN ] COMP: No existing data found, performing full refresh instead. [2025-10-03T18:09:23.407084] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-03T18:09:23.407143] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-03T18:09:23.407189] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-03T18:09:23.407225] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-03T18:09:23.804745] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:23.838097] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-03T18:09:23.990696] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-03T18:09:24.272738] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:09:24.790698] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-03T18:09:25.083624] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T18:09:25.590713] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-03T18:09:25.827312] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-03T18:09:26.390636] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-03T18:09:26.918352] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:09:27.000337] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:09:27.190733] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-03T18:09:27.990748] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-03T18:09:28.054872] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:09:28.790708] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-03T18:09:28.927308] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:09:29.590626] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-03T18:09:30.093571] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T18:09:30.390698] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-03T18:09:30.522836] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:09:31.190730] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-03T18:09:31.596453] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:09:31.990709] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-03T18:09:32.133113] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:09:32.790673] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-03T18:09:33.133300] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:09:33.590716] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-03T18:09:34.388117] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-03T18:09:34.399768] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-03T18:09:34.579662] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:09:35.190671] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-03T18:09:35.509662] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:09:35.749247] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:09:35.990689] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-03T18:09:36.684662] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T18:09:36.790704] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-03T18:09:37.590687] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-03T18:09:37.958051] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:09:38.390689] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-03T18:09:38.819113] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:09:39.190693] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-03T18:09:39.767760] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T18:09:39.771233] [INFO ] [REMOTE ] COHR: Full fetch complete (77127 records). [2025-10-03T18:09:39.771405] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-03T18:09:39.991815] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-03T18:09:40.244546] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-03T18:09:40.244743] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-03T18:09:40.245961] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-03T18:09:40.246060] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-03T18:09:40.248662] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:09:40.261537] [DEBUG] [LOCAL ] COHR: Trimmed 77127 records to 54136 (keeping 200 days of data) [2025-10-03T18:09:40.613670] [DEBUG] [LOCAL ] COHR: Primary data saved (54136 records). [2025-10-03T18:09:40.613832] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-03T18:09:40.613933] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COHR took 38.8s. Estimated remaining: 4h 17m 41s. Rate: 7.2 symbols/min [2025-10-03T18:09:40.801716] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-03T18:09:40.840305] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:40.843716] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:09:40.891711] [DEBUG] [LOCAL ] CON: Loaded 39102 existing records from primary storage. [2025-10-03T18:09:40.892074] [INFO ] [MAIN ] CON: Loaded 39102 existing records. [2025-10-03T18:09:41.093503] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:41.093776] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-03T18:09:41.093868] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-03T18:09:41.095129] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-03T18:09:41.095194] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-03T18:09:41.504251] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:41.590700] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-03T18:09:41.791577] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-03T18:09:41.794509] [INFO ] [REMOTE ] COF: Full fetch complete (77426 records). [2025-10-03T18:09:41.794666] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-03T18:09:42.269512] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-03T18:09:42.269731] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-03T18:09:42.270566] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-03T18:09:42.270616] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-03T18:09:42.272238] [DEBUG] [LOCAL ] COF: Trimmed 77426 records to 54389 (keeping 200 days of data) [2025-10-03T18:09:42.390845] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-03T18:09:42.555464] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T18:09:42.688831] [DEBUG] [LOCAL ] COF: Primary data saved (54389 records). [2025-10-03T18:09:42.689001] [INFO ] [MAIN ] COF: Full history saved. [2025-10-03T18:09:42.689839] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COF took 41.9s. Estimated remaining: 4h 17m 10s. Rate: 7.3 symbols/min [2025-10-03T18:09:42.873139] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:42.898815] [DEBUG] [LOCAL ] COOK: Loaded 24479 existing records from primary storage. [2025-10-03T18:09:42.899111] [INFO ] [MAIN ] COOK: Loaded 24479 existing records. [2025-10-03T18:09:43.096858] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:43.097278] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-03T18:09:43.097571] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-03T18:09:43.098465] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-03T18:09:43.098536] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-03T18:09:43.198372] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-03T18:09:43.363739] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T18:09:43.547807] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:43.990627] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-03T18:09:44.245371] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:09:44.577348] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:09:44.790689] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-03T18:09:45.432110] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:09:45.590686] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-03T18:09:46.390746] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-03T18:09:46.614795] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:09:47.048577] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:09:47.184426] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T18:09:47.190616] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-03T18:09:47.863716] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T18:09:47.990717] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-03T18:09:48.790691] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-03T18:09:49.512177] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:09:49.555732] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:09:49.590721] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-03T18:09:50.390672] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-03T18:09:51.185467] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:09:51.189330] [INFO ] [REMOTE ] COLD: Full fetch complete (74328 records). [2025-10-03T18:09:51.189511] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-03T18:09:51.195811] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-03T18:09:51.698726] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-03T18:09:51.698845] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-03T18:09:51.700069] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-03T18:09:51.700155] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-03T18:09:51.702304] [DEBUG] [LOCAL ] COLD: Trimmed 74328 records to 52854 (keeping 200 days of data) [2025-10-03T18:09:52.033288] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-03T18:09:52.076275] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:09:52.110698] [DEBUG] [LOCAL ] COLD: Primary data saved (52854 records). [2025-10-03T18:09:52.110880] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-03T18:09:52.110995] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COLD took 33.4s. Estimated remaining: 4h 17m 6s. Rate: 7.3 symbols/min [2025-10-03T18:09:52.304347] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:09:52.352635] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:09:52.376870] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-10-03T18:09:52.377201] [INFO ] [MAIN ] COP: Loaded 54117 existing records. [2025-10-03T18:09:52.584979] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:09:52.585313] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-03T18:09:52.585421] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-03T18:09:52.587257] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-03T18:09:52.587361] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-03T18:09:52.799230] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-03T18:09:53.087188] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:09:53.590714] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-03T18:09:54.042113] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:09:54.109683] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:09:54.390742] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-03T18:09:55.190723] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-03T18:09:55.468119] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:09:55.666812] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:09:55.990693] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-03T18:09:56.608211] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:09:56.790691] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-03T18:09:57.590636] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-03T18:09:57.858440] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:09:58.040314] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T18:09:58.390690] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-03T18:09:58.886517] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:09:59.190733] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-03T18:09:59.990697] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-03T18:10:00.114802] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T18:10:00.172447] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:10:00.790746] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-03T18:10:01.379493] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:10:01.590728] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-03T18:10:02.390705] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-03T18:10:02.557121] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:10:03.190766] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-03T18:10:03.943288] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-03T18:10:03.990710] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-03T18:10:04.302042] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-03T18:10:04.306890] [INFO ] [REMOTE ] COMP: Full fetch complete (77178 records). [2025-10-03T18:10:04.307164] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-03T18:10:04.764978] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-03T18:10:04.765149] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-03T18:10:04.766254] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-03T18:10:04.766382] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-03T18:10:04.777136] [DEBUG] [LOCAL ] COMP: Trimmed 77178 records to 54169 (keeping 200 days of data) [2025-10-03T18:10:04.792174] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-03T18:10:04.796430] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T18:10:05.138136] [DEBUG] [LOCAL ] COMP: Primary data saved (54169 records). [2025-10-03T18:10:05.138298] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-03T18:10:05.138503] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. COMP took 41.9s. Estimated remaining: 4h 17m 15s. Rate: 7.2 symbols/min [2025-10-03T18:10:05.355687] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:05.407623] [DEBUG] [LOCAL ] COR: Loaded 47382 existing records from primary storage. [2025-10-03T18:10:05.408025] [INFO ] [MAIN ] COR: Loaded 47382 existing records. [2025-10-03T18:10:05.606135] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-03T18:10:05.613561] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:05.614894] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-03T18:10:05.614962] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-03T18:10:05.615745] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-03T18:10:05.615870] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-03T18:10:06.018632] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:06.252620] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T18:10:06.265622] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-03T18:10:06.390738] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-03T18:10:06.981564] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:10:06.983806] [INFO ] [REMOTE ] CON: Full fetch complete (56908 records). [2025-10-03T18:10:06.983906] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-03T18:10:07.195871] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-03T18:10:07.414033] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-03T18:10:07.414218] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-03T18:10:07.415062] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-03T18:10:07.415129] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-03T18:10:07.419033] [DEBUG] [LOCAL ] CON: Trimmed 56908 records to 39417 (keeping 200 days of data) [2025-10-03T18:10:07.680522] [DEBUG] [LOCAL ] CON: Primary data saved (39417 records). [2025-10-03T18:10:07.680733] [INFO ] [MAIN ] CON: Full history saved. [2025-10-03T18:10:07.680866] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. CON took 27.1s. Estimated remaining: 4h 16m 46s. Rate: 7.3 symbols/min [2025-10-03T18:10:07.868801] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:07.921799] [DEBUG] [LOCAL ] COTY: Loaded 53616 existing records from primary storage. [2025-10-03T18:10:07.922132] [INFO ] [MAIN ] COTY: Loaded 53616 existing records. [2025-10-03T18:10:08.000724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-03T18:10:08.141623] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:08.142030] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-03T18:10:08.142197] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-03T18:10:08.142622] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-03T18:10:08.142727] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-03T18:10:08.495532] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T18:10:08.642058] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:08.660735] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:10:08.790737] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-03T18:10:09.590716] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-03T18:10:10.145202] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-03T18:10:10.390684] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-03T18:10:10.660716] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:10:10.913266] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T18:10:11.190728] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-03T18:10:11.990624] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-03T18:10:12.500299] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-03T18:10:12.790724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-03T18:10:13.020031] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:10:13.021664] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:10:13.033089] [INFO ] [REMOTE ] COOK: Full fetch complete (32417 records). [2025-10-03T18:10:13.033701] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-03T18:10:13.447171] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-03T18:10:13.447303] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-03T18:10:13.447988] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-03T18:10:13.448056] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-03T18:10:13.449195] [DEBUG] [LOCAL ] COOK: Trimmed 32417 records to 24640 (keeping 200 days of data) [2025-10-03T18:10:13.593171] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-03T18:10:13.605189] [DEBUG] [LOCAL ] COOK: Primary data saved (24640 records). [2025-10-03T18:10:13.605375] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-03T18:10:13.605540] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COOK took 30.9s. Estimated remaining: 4h 16m 29s. Rate: 7.3 symbols/min [2025-10-03T18:10:13.788463] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:13.842372] [DEBUG] [LOCAL ] COUR: Loaded 49263 existing records from primary storage. [2025-10-03T18:10:13.842750] [INFO ] [MAIN ] COUR: Loaded 49263 existing records. [2025-10-03T18:10:14.036762] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:14.037025] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-03T18:10:14.037080] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-03T18:10:14.037342] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-03T18:10:14.037405] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-03T18:10:14.399221] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-03T18:10:14.446244] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:14.569810] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:10:15.190714] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-03T18:10:15.401245] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:10:15.990724] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-03T18:10:16.601516] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-10-03T18:10:16.790720] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-03T18:10:17.174398] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:10:17.513103] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:10:17.590739] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-03T18:10:18.390726] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-03T18:10:18.640250] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:10:19.155636] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:10:19.190675] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-03T18:10:19.990695] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-03T18:10:20.499051] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T18:10:20.715843] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T18:10:20.790722] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-03T18:10:21.590635] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-03T18:10:22.109076] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T18:10:22.399189] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-03T18:10:22.418779] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:10:23.190744] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-03T18:10:23.690459] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-03T18:10:23.990753] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-03T18:10:24.133437] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:10:24.790701] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-03T18:10:25.023803] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:10:25.590719] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-03T18:10:26.030018] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T18:10:26.390727] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-03T18:10:26.439777] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:10:27.190704] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-03T18:10:27.310864] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:10:27.990698] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-03T18:10:28.229879] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:10:28.790713] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-03T18:10:29.141618] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T18:10:29.144581] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-03T18:10:29.144833] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-03T18:10:29.593793] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-03T18:10:29.599066] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-03T18:10:29.599188] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-03T18:10:29.600422] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-03T18:10:29.600840] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-03T18:10:29.628877] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:10:29.639337] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54507 (keeping 200 days of data) [2025-10-03T18:10:29.994313] [DEBUG] [LOCAL ] COP: Primary data saved (54507 records). [2025-10-03T18:10:29.994477] [INFO ] [MAIN ] COP: Full history saved. [2025-10-03T18:10:29.994598] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 37.9s. Estimated remaining: 4h 16m 50s. Rate: 7.2 symbols/min [2025-10-03T18:10:30.189637] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:30.251452] [DEBUG] [LOCAL ] CP: Loaded 53656 existing records from primary storage. [2025-10-03T18:10:30.251902] [INFO ] [MAIN ] CP: Loaded 53656 existing records. [2025-10-03T18:10:30.395881] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-03T18:10:30.461314] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:30.461539] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-03T18:10:30.461590] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-03T18:10:30.463339] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-03T18:10:30.463413] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-03T18:10:30.874398] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T18:10:30.923328] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:31.190708] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-03T18:10:31.255503] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:10:31.990696] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-03T18:10:32.287901] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:10:32.790708] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-03T18:10:33.376786] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:10:33.464220] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T18:10:33.590718] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-03T18:10:34.390676] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-03T18:10:34.904544] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:10:35.190676] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-03T18:10:35.480021] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:10:35.699530] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T18:10:35.990717] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-03T18:10:36.790702] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-03T18:10:37.020053] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:10:37.590711] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-03T18:10:37.952619] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:10:37.971516] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:10:37.974521] [INFO ] [REMOTE ] COR: Full fetch complete (68792 records). [2025-10-03T18:10:37.974719] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-03T18:10:38.407821] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-03T18:10:38.435269] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-03T18:10:38.435437] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-03T18:10:38.436351] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-03T18:10:38.436426] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-03T18:10:38.438249] [DEBUG] [LOCAL ] COR: Trimmed 68792 records to 47718 (keeping 200 days of data) [2025-10-03T18:10:38.757075] [DEBUG] [LOCAL ] COR: Primary data saved (47718 records). [2025-10-03T18:10:38.757230] [INFO ] [MAIN ] COR: Full history saved. [2025-10-03T18:10:38.758742] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COR took 33.6s. Estimated remaining: 4h 16m 44s. Rate: 7.2 symbols/min [2025-10-03T18:10:38.961429] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:38.961713] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-03T18:10:38.961765] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-03T18:10:38.961880] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-03T18:10:38.961923] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-03T18:10:38.961966] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-03T18:10:38.962029] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-03T18:10:39.207081] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-03T18:10:39.392870] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:39.436473] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:10:39.990626] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-03T18:10:40.108045] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:10:40.790680] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-03T18:10:41.143364] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:10:41.590699] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-03T18:10:41.998915] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:10:42.142450] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:10:42.145015] [INFO ] [REMOTE ] COUR: Full fetch complete (70861 records). [2025-10-03T18:10:42.145153] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-03T18:10:42.395843] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-03T18:10:42.605166] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-03T18:10:42.605298] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-03T18:10:42.606408] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-03T18:10:42.606491] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-03T18:10:42.608480] [DEBUG] [LOCAL ] COUR: Trimmed 70861 records to 49645 (keeping 200 days of data) [2025-10-03T18:10:42.918094] [DEBUG] [LOCAL ] COUR: Primary data saved (49645 records). [2025-10-03T18:10:42.918252] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-03T18:10:42.919068] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 29.3s. Estimated remaining: 4h 16m 21s. Rate: 7.2 symbols/min [2025-10-03T18:10:43.114016] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:43.114452] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-03T18:10:43.114699] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-03T18:10:43.114903] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-03T18:10:43.114955] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-03T18:10:43.115009] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-03T18:10:43.115056] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-03T18:10:43.196532] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-03T18:10:43.543484] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:43.546382] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T18:10:43.990668] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-03T18:10:44.255688] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:10:44.651754] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:10:44.769636] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:10:44.790625] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-03T18:10:45.590713] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-03T18:10:46.062340] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T18:10:46.390720] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-03T18:10:47.190631] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-03T18:10:47.291318] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:10:47.606944] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:10:47.990726] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-03T18:10:48.324244] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:10:48.790699] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-03T18:10:49.125935] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-03T18:10:49.128817] [INFO ] [REMOTE ] COTY: Full fetch complete (77101 records). [2025-10-03T18:10:49.128973] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-03T18:10:49.590090] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-03T18:10:49.590219] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-03T18:10:49.591358] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-03T18:10:49.591701] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-03T18:10:49.591469] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-03T18:10:49.595107] [DEBUG] [LOCAL ] COTY: Trimmed 77101 records to 54004 (keeping 200 days of data) [2025-10-03T18:10:49.929962] [DEBUG] [LOCAL ] COTY: Primary data saved (54004 records). [2025-10-03T18:10:49.930133] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-03T18:10:49.930232] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COTY took 42.2s. Estimated remaining: 4h 16m 8s. Rate: 7.3 symbols/min [2025-10-03T18:10:50.044887] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T18:10:50.123145] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:10:50.157355] [DEBUG] [LOCAL ] CPAY: Loaded 30849 existing records from primary storage. [2025-10-03T18:10:50.157772] [INFO ] [MAIN ] CPAY: Loaded 30849 existing records. [2025-10-03T18:10:50.368129] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:10:50.368427] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-03T18:10:50.368517] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-03T18:10:50.369845] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-03T18:10:50.369917] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-03T18:10:50.395848] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-03T18:10:50.781135] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T18:10:50.838181] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:10:51.190702] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-03T18:10:51.555745] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-03T18:10:51.793720] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T18:10:51.990691] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-03T18:10:52.790713] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-03T18:10:53.358501] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T18:10:53.590734] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-03T18:10:54.380353] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:10:54.390612] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-03T18:10:55.092597] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T18:10:55.190716] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-03T18:10:55.800693] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T18:10:55.990728] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-03T18:10:56.690903] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:10:56.790719] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-03T18:10:57.341536] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:10:57.590719] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-03T18:10:58.390706] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-03T18:10:58.646056] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T18:10:58.955875] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T18:10:59.190741] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-03T18:10:59.860297] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T18:10:59.990715] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-03T18:11:00.790747] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-03T18:11:01.328328] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:11:01.394150] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:11:01.408093] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-03T18:11:01.410854] [INFO ] [REMOTE ] CP: Full fetch complete (77127 records). [2025-10-03T18:11:01.411023] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-03T18:11:01.603626] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-03T18:11:01.847742] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-03T18:11:01.847845] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-03T18:11:01.848835] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-03T18:11:01.848908] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-03T18:11:01.852684] [DEBUG] [LOCAL ] CP: Trimmed 77127 records to 54043 (keeping 200 days of data) [2025-10-03T18:11:02.084604] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T18:11:02.214220] [DEBUG] [LOCAL ] CP: Primary data saved (54043 records). [2025-10-03T18:11:02.214376] [INFO ] [MAIN ] CP: Full history saved. [2025-10-03T18:11:02.214479] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CP took 32.2s. Estimated remaining: 4h 16m 14s. Rate: 7.2 symbols/min [2025-10-03T18:11:02.400903] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-03T18:11:02.405837] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:02.424110] [DEBUG] [LOCAL ] CPF: Loaded 15271 existing records from primary storage. [2025-10-03T18:11:02.424422] [INFO ] [MAIN ] CPF: Loaded 15271 existing records. [2025-10-03T18:11:02.625013] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:02.625297] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-03T18:11:02.625375] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-03T18:11:02.626023] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-03T18:11:02.626087] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-03T18:11:03.083137] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:03.190730] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-03T18:11:03.733805] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:11:03.990737] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-03T18:11:04.368192] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T18:11:04.705404] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T18:11:04.790699] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-03T18:11:05.590704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-03T18:11:06.229127] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:11:06.390729] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-03T18:11:06.783776] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:11:07.190737] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-03T18:11:07.412304] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:11:07.990735] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-03T18:11:08.270711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:11:08.790738] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-03T18:11:09.356037] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:11:09.590689] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-03T18:11:09.807550] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T18:11:10.390708] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-03T18:11:10.861441] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T18:11:10.929223] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T18:11:11.190722] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-03T18:11:11.990687] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-03T18:11:12.311421] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:11:12.790701] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-03T18:11:13.100006] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:11:13.102403] [INFO ] [REMOTE ] CPA: Full fetch complete (41703 records). [2025-10-03T18:11:13.102559] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-03T18:11:13.308729] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:11:13.532768] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-10-03T18:11:13.532850] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-10-03T18:11:13.533516] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-10-03T18:11:13.533581] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-10-03T18:11:13.534829] [DEBUG] [LOCAL ] CPA: Trimmed 41703 records to 28805 (keeping 200 days of data) [2025-10-03T18:11:13.597216] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-03T18:11:13.730602] [DEBUG] [LOCAL ] CPA: Primary data saved (28805 records). [2025-10-03T18:11:13.730773] [INFO ] [MAIN ] CPA: Full history saved. [2025-10-03T18:11:13.730866] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CPA took 35.0s. Estimated remaining: 4h 16m 17s. Rate: 7.2 symbols/min [2025-10-03T18:11:13.924480] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:13.941873] [DEBUG] [LOCAL ] CPK: Loaded 13609 existing records from primary storage. [2025-10-03T18:11:13.942129] [INFO ] [MAIN ] CPK: Loaded 13609 existing records. [2025-10-03T18:11:14.113197] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T18:11:14.146681] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:14.148202] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-03T18:11:14.148265] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-03T18:11:14.149024] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-03T18:11:14.149139] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-03T18:11:14.395770] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-03T18:11:14.542423] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:15.190724] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-03T18:11:15.990735] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-03T18:11:16.051081] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:11:16.279595] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T18:11:16.555886] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-03T18:11:16.790735] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-03T18:11:17.580126] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:11:17.590670] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-03T18:11:18.390716] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-03T18:11:18.966184] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:11:18.974220] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:11:19.190738] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-03T18:11:19.990702] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-03T18:11:20.424186] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:11:20.790692] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-03T18:11:21.042143] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:11:21.590739] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-03T18:11:22.124967] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T18:11:22.126724] [INFO ] [REMOTE ] CPAY: Full fetch complete (44992 records). [2025-10-03T18:11:22.126830] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-03T18:11:22.395837] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-03T18:11:22.472711] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T18:11:22.571823] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-03T18:11:22.571905] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-03T18:11:22.573175] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-03T18:11:22.573241] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-03T18:11:22.576857] [DEBUG] [LOCAL ] CPAY: Trimmed 44992 records to 30967 (keeping 200 days of data) [2025-10-03T18:11:22.780498] [DEBUG] [LOCAL ] CPAY: Primary data saved (30967 records). [2025-10-03T18:11:22.780666] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-03T18:11:22.780811] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CPAY took 32.9s. Estimated remaining: 4h 16m 12s. Rate: 7.2 symbols/min [2025-10-03T18:11:22.969778] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:23.025291] [DEBUG] [LOCAL ] CPNG: Loaded 54061 existing records from primary storage. [2025-10-03T18:11:23.025692] [INFO ] [MAIN ] CPNG: Loaded 54061 existing records. [2025-10-03T18:11:23.195493] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-03T18:11:23.221966] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:23.222328] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-03T18:11:23.222386] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-03T18:11:23.224225] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-03T18:11:23.224292] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-03T18:11:23.620545] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:23.629403] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:11:23.769443] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:11:23.770230] [INFO ] [REMOTE ] CPAC: Full fetch complete (1872 records). [2025-10-03T18:11:23.770305] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-03T18:11:23.968871] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:11:23.969087] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:11:23.969175] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:11:23.969280] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-03T18:11:23.969396] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-03T18:11:23.969438] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-03T18:11:23.969482] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-03T18:11:23.969541] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPAC took 41.1s. Estimated remaining: 4h 15m 38s. Rate: 7.2 symbols/min [2025-10-03T18:11:23.990625] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-03T18:11:24.790688] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-03T18:11:24.948564] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:11:25.590694] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-03T18:11:25.759115] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T18:11:26.369771] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T18:11:26.390701] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-03T18:11:27.190679] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-03T18:11:27.339804] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:11:27.990706] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-03T18:11:28.122255] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:11:28.790704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-03T18:11:29.590707] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-03T18:11:29.757443] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T18:11:30.385178] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:11:30.396366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-03T18:11:30.420037] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:11:31.190737] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-03T18:11:31.361866] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:11:31.990704] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-03T18:11:32.790728] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-03T18:11:32.833347] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:11:32.834631] [INFO ] [REMOTE ] CPF: Full fetch complete (24163 records). [2025-10-03T18:11:32.834745] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-03T18:11:33.277523] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-03T18:11:33.277741] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-03T18:11:33.278453] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-03T18:11:33.278558] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-03T18:11:33.279944] [DEBUG] [LOCAL ] CPF: Trimmed 24163 records to 15402 (keeping 200 days of data) [2025-10-03T18:11:33.388760] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T18:11:33.426281] [DEBUG] [LOCAL ] CPF: Primary data saved (15402 records). [2025-10-03T18:11:33.426453] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-03T18:11:33.426587] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPF took 31.2s. Estimated remaining: 4h 15m 34s. Rate: 7.2 symbols/min [2025-10-03T18:11:33.590702] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-03T18:11:33.863740] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:11:34.390688] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-03T18:11:35.149325] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T18:11:35.150563] [INFO ] [REMOTE ] CPK: Full fetch complete (17823 records). [2025-10-03T18:11:35.150699] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-03T18:11:35.151273] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:11:35.151375] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:11:35.151428] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:11:35.151470] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-03T18:11:35.151555] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-03T18:11:35.151614] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-03T18:11:35.152006] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-10-03T18:11:35.152104] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 21.4s. Estimated remaining: 4h 15m 2s. Rate: 7.3 symbols/min [2025-10-03T18:11:35.734024] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-10-03T18:11:35.745295] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-03T18:11:37.937078] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-03T18:11:37.949639] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-03T18:11:40.387604] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-03T18:11:40.400618] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-03T18:11:42.869281] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-03T18:11:42.881829] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-03T18:11:45.124713] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-03T18:11:45.136805] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-03T18:11:47.563522] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-03T18:11:47.576726] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-03T18:11:49.897907] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T18:11:49.911075] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-03T18:11:52.191411] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T18:11:52.204265] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-03T18:11:54.452477] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-03T18:11:54.455378] [INFO ] [REMOTE ] CPNG: Full fetch complete (77674 records). [2025-10-03T18:11:54.455495] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-03T18:11:54.892782] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-03T18:11:54.892872] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-03T18:11:54.893779] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-03T18:11:54.893848] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-03T18:11:54.895459] [DEBUG] [LOCAL ] CPNG: Trimmed 77674 records to 54451 (keeping 200 days of data) [2025-10-03T18:11:55.246251] [DEBUG] [LOCAL ] CPNG: Primary data saved (54451 records). [2025-10-03T18:11:55.246404] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-03T18:11:55.246512] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 32.5s. Estimated remaining: 4h 15m 36s. Rate: 7.2 symbols/min [2025-10-03T18:11:55.931899] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:55.969728] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.062325] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.067394] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:11:56.098087] [DEBUG] [LOCAL ] CQP: Loaded 19574 existing records from primary storage. [2025-10-03T18:11:56.117729] [INFO ] [MAIN ] CQP: Loaded 19574 existing records. [2025-10-03T18:11:56.118794] [DEBUG] [LOCAL ] CPS: Loaded 26039 existing records from primary storage. [2025-10-03T18:11:56.152771] [INFO ] [MAIN ] CPS: Loaded 26039 existing records. [2025-10-03T18:11:56.329749] [DEBUG] [LOCAL ] CPT: Loaded 44684 existing records from primary storage. [2025-10-03T18:11:56.366751] [INFO ] [MAIN ] CPT: Loaded 44684 existing records. [2025-10-03T18:11:56.517435] [DEBUG] [LOCAL ] CPRI: Loaded 52920 existing records from primary storage. [2025-10-03T18:11:56.545347] [INFO ] [MAIN ] CPRI: Loaded 52920 existing records. [2025-10-03T18:11:56.545021] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:56.598484] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-03T18:11:56.620318] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-03T18:11:56.704239] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-03T18:11:56.802696] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-03T18:11:56.825314] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:56.917201] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.013264] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-03T18:11:57.024307] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:57.040469] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-03T18:11:57.051809] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-03T18:11:57.083692] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.201588] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-03T18:11:57.341534] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:11:57.347139] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-03T18:11:57.347320] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-03T18:11:57.377386] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-03T18:11:57.410800] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-03T18:11:57.478243] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-03T18:11:57.569611] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-03T18:11:58.049382] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.093169] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-03T18:11:58.416846] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.441761] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-03T18:11:58.641189] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.647727] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-03T18:11:58.725467] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:11:58.725842] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-03T18:11:59.486010] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:11:59.492081] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-03T18:11:59.610850] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:11:59.616175] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-03T18:12:00.270035] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:12:00.281927] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-03T18:12:00.387079] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:12:00.396391] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-03T18:12:00.824488] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:12:00.829602] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-03T18:12:00.912986] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:12:00.919352] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-03T18:12:02.097897] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:12:02.103582] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-03T18:12:02.243076] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T18:12:02.254192] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-03T18:12:02.287808] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-03T18:12:02.300363] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-03T18:12:02.324072] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:12:02.333137] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-03T18:12:03.398013] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T18:12:03.405080] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-03T18:12:03.432006] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:12:03.437889] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-03T18:12:03.661853] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:12:03.672821] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-03T18:12:04.033270] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:12:04.043568] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-03T18:12:04.227145] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:12:04.231884] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-03T18:12:04.718929] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T18:12:04.726710] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-03T18:12:05.285549] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T18:12:05.291049] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-03T18:12:05.406847] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:12:05.419203] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-03T18:12:05.691534] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:12:05.701887] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-03T18:12:05.736945] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:12:05.744979] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-03T18:12:06.663332] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:12:06.670568] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-03T18:12:06.796870] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:12:06.802391] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-03T18:12:07.271854] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:12:07.283885] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-03T18:12:07.421230] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:12:07.432390] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-03T18:12:07.857445] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T18:12:07.879601] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-03T18:12:07.883470] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:12:07.890486] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-03T18:12:08.809909] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:12:08.813689] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-03T18:12:08.982563] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:12:08.994825] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-03T18:12:09.027120] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:12:09.035228] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-03T18:12:09.074060] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:12:09.085019] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-03T18:12:09.823584] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:12:09.827560] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-03T18:12:10.424224] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:12:10.429936] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-03T18:12:10.641857] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:12:10.644499] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:12:10.657997] [INFO ] [REMOTE ] CQP: Full fetch complete (30537 records). [2025-10-03T18:12:10.660059] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-03T18:12:10.660619] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-03T18:12:10.661511] [FATAL] [VALIDATOR ] CQP: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:12:10.662867] [FATAL] [MAIN ] CQP: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:12:10.663188] [WARN ] [MAIN ] CQP: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:12:10.663345] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-03T18:12:10.663459] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-03T18:12:10.663634] [INFO ] [LOCAL ] CQP: Starting deletion of derivative data. [2025-10-03T18:12:10.663955] [DEBUG] [LOCAL ] CQP: Deleted derivative data file. [2025-10-03T18:12:10.664138] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CQP took 15.4s. Estimated remaining: 4h 15m 53s. Rate: 7.2 symbols/min [2025-10-03T18:12:10.938772] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:10.943757] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:12:10.979579] [DEBUG] [LOCAL ] CR: Loaded 24566 existing records from primary storage. [2025-10-03T18:12:10.979886] [INFO ] [MAIN ] CR: Loaded 24566 existing records. [2025-10-03T18:12:11.173111] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:11.173372] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-03T18:12:11.173433] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-03T18:12:11.173943] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-03T18:12:11.174004] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-03T18:12:11.208959] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-03T18:12:11.501600] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:12:11.535203] [INFO ] [REMOTE ] CPS: Full fetch complete (36177 records). [2025-10-03T18:12:11.559725] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-03T18:12:11.576531] [FATAL] [VALIDATOR ] CPS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:12:11.598939] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:11.599110] [FATAL] [MAIN ] CPS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:12:11.599705] [WARN ] [MAIN ] CPS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:12:11.599803] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-03T18:12:11.599892] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-10-03T18:12:11.599934] [INFO ] [LOCAL ] CPS: Starting deletion of derivative data. [2025-10-03T18:12:11.600163] [DEBUG] [LOCAL ] CPS: Deleted derivative data file. [2025-10-03T18:12:11.600327] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CPS took 16.3s. Estimated remaining: 4h 15m 19s. Rate: 7.2 symbols/min [2025-10-03T18:12:11.791993] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:11.805952] [DEBUG] [LOCAL ] CRBD: Loaded 9065 existing records from primary storage. [2025-10-03T18:12:11.806255] [INFO ] [MAIN ] CRBD: Loaded 9065 existing records. [2025-10-03T18:12:11.991062] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-03T18:12:12.035487] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:12.036261] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-03T18:12:12.036393] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-03T18:12:12.036791] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-03T18:12:12.036867] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-03T18:12:12.438918] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:12.481089] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:12:12.790716] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-03T18:12:12.949334] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:12:13.284027] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T18:12:13.590616] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-03T18:12:13.662717] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:12:14.390618] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-03T18:12:14.787730] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T18:12:15.181148] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:12:15.190610] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-03T18:12:15.990715] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-03T18:12:16.051169] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T18:12:16.790721] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-03T18:12:17.513996] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:12:17.590706] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-03T18:12:18.307913] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:12:18.390682] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-03T18:12:18.505439] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T18:12:19.190678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-03T18:12:19.525114] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T18:12:19.938814] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T18:12:19.990661] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-03T18:12:20.757411] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:12:20.790725] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-03T18:12:21.543593] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:12:21.590741] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-03T18:12:22.390719] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-03T18:12:23.190678] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-03T18:12:23.366795] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:12:23.653173] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:12:23.990724] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-03T18:12:24.097918] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T18:12:24.790751] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-03T18:12:25.280012] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T18:12:25.579588] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:12:25.590688] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-03T18:12:26.371718] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:12:26.390708] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-03T18:12:27.190634] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-03T18:12:27.990682] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-03T18:12:28.302508] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T18:12:28.606569] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:12:28.607576] [INFO ] [REMOTE ] CRBD: Full fetch complete (14504 records). [2025-10-03T18:12:28.607695] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-03T18:12:28.769077] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:12:28.790859] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-03T18:12:28.834364] [INFO ] [REMOTE ] CPT: Full fetch complete (63961 records). [2025-10-03T18:12:28.882588] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-03T18:12:29.164841] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-03T18:12:29.185460] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-03T18:12:29.207607] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-03T18:12:29.227816] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-03T18:12:29.329339] [DEBUG] [LOCAL ] CRBD: Trimmed 14504 records to 9105 (keeping 200 days of data) [2025-10-03T18:12:29.516064] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-03T18:12:29.516725] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-03T18:12:29.518851] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-03T18:12:29.519503] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-03T18:12:29.523810] [DEBUG] [LOCAL ] CPT: Trimmed 63961 records to 44977 (keeping 200 days of data) [2025-10-03T18:12:29.586141] [DEBUG] [LOCAL ] CRBD: Primary data saved (9105 records). [2025-10-03T18:12:29.595329] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-03T18:12:29.595695] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-03T18:12:29.596732] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CRBD took 18.0s. Estimated remaining: 4h 15m 45s. Rate: 7.2 symbols/min [2025-10-03T18:12:29.828476] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:30.000255] [DEBUG] [LOCAL ] CRBG: Loaded 52747 existing records from primary storage. [2025-10-03T18:12:30.001477] [INFO ] [MAIN ] CRBG: Loaded 52747 existing records. [2025-10-03T18:12:30.217236] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:30.219009] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-03T18:12:30.219694] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-03T18:12:30.220258] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-03T18:12:30.220898] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-03T18:12:30.523857] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:12:30.585986] [INFO ] [REMOTE ] CPRI: Full fetch complete (76139 records). [2025-10-03T18:12:30.618615] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-03T18:12:30.643430] [DEBUG] [LOCAL ] CPT: Primary data saved (44977 records). [2025-10-03T18:12:30.680265] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-03T18:12:30.740122] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 35.5s. Estimated remaining: 4h 15m 11s. Rate: 7.2 symbols/min [2025-10-03T18:12:30.790963] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:30.808381] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-03T18:12:31.022607] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:12:31.137374] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:31.198273] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-03T18:12:31.397206] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-03T18:12:31.397356] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-03T18:12:31.398314] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-03T18:12:31.398474] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-03T18:12:31.400480] [DEBUG] [LOCAL ] CPRI: Trimmed 76139 records to 53294 (keeping 200 days of data) [2025-10-03T18:12:31.476404] [DEBUG] [LOCAL ] CRC: Loaded 44370 existing records from primary storage. [2025-10-03T18:12:31.503869] [INFO ] [MAIN ] CRC: Loaded 44370 existing records. [2025-10-03T18:12:31.812833] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:31.842282] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-03T18:12:31.852189] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-03T18:12:31.854905] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-03T18:12:31.856679] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-03T18:12:32.366279] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:32.370823] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-03T18:12:32.388958] [DEBUG] [LOCAL ] CPRI: Primary data saved (53294 records). [2025-10-03T18:12:32.389330] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-03T18:12:32.389478] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CPRI took 37.1s. Estimated remaining: 4h 14m 40s. Rate: 7.2 symbols/min [2025-10-03T18:12:32.590973] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:12:32.653422] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:32.653840] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-03T18:12:32.654025] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-03T18:12:32.654313] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-03T18:12:32.654395] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-03T18:12:32.654482] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-03T18:12:32.654627] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-03T18:12:32.793314] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-03T18:12:33.022470] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:12:33.160435] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:33.590631] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-03T18:12:33.863445] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:12:34.166245] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:12:34.390727] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-03T18:12:35.187514] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:12:35.198996] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-03T18:12:35.243734] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T18:12:35.414368] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:12:35.414759] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-03T18:12:35.414850] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:12:35.414901] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-03T18:12:35.414936] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:12:35.415009] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-03T18:12:35.415074] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-03T18:12:35.415110] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-03T18:12:35.415150] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-03T18:12:35.415197] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CRCL took 3.0s. Estimated remaining: 4h 14m 13s. Rate: 7.3 symbols/min [2025-10-03T18:12:35.610950] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:35.668279] [DEBUG] [LOCAL ] CRGY: Loaded 52894 existing records from primary storage. [2025-10-03T18:12:35.668706] [INFO ] [MAIN ] CRGY: Loaded 52894 existing records. [2025-10-03T18:12:35.864155] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:35.864384] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-03T18:12:35.864439] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-03T18:12:35.864929] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-03T18:12:35.864991] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-03T18:12:35.995796] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-03T18:12:36.273140] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:36.790739] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-03T18:12:37.590620] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-03T18:12:37.911003] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T18:12:37.934290] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:12:38.390699] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-03T18:12:39.190699] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-03T18:12:39.618092] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T18:12:39.740695] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:12:39.990750] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-03T18:12:40.575981] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:12:40.790712] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-03T18:12:41.590729] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-03T18:12:41.751341] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:12:41.768893] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:12:41.771169] [INFO ] [REMOTE ] CR: Full fetch complete (34743 records). [2025-10-03T18:12:41.771319] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-03T18:12:42.204020] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-03T18:12:42.204124] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-03T18:12:42.204691] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-03T18:12:42.204759] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-03T18:12:42.205892] [DEBUG] [LOCAL ] CR: Trimmed 34743 records to 24735 (keeping 200 days of data) [2025-10-03T18:12:42.368257] [DEBUG] [LOCAL ] CR: Primary data saved (24735 records). [2025-10-03T18:12:42.368397] [INFO ] [MAIN ] CR: Full history saved. [2025-10-03T18:12:42.368503] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CR took 31.7s. Estimated remaining: 4h 13m 60s. Rate: 7.3 symbols/min [2025-10-03T18:12:42.395864] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-03T18:12:42.564910] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:12:42.618719] [DEBUG] [LOCAL ] CRH: Loaded 53852 existing records from primary storage. [2025-10-03T18:12:42.619041] [INFO ] [MAIN ] CRH: Loaded 53852 existing records. [2025-10-03T18:12:42.811543] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:12:42.811782] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-03T18:12:42.811834] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-03T18:12:42.812108] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-03T18:12:42.812167] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-03T18:12:43.191241] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-03T18:12:43.212329] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:12:43.504124] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:12:43.664558] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:12:43.990694] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-03T18:12:44.790691] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-03T18:12:45.204178] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:12:45.590674] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-03T18:12:45.934767] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T18:12:46.354355] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:12:46.390617] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-03T18:12:47.190692] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-03T18:12:47.564823] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T18:12:47.990724] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-03T18:12:48.282977] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T18:12:48.552337] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:12:48.790718] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-03T18:12:49.590686] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-03T18:12:49.796873] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:12:50.395717] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-03T18:12:50.414347] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T18:12:51.190693] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-03T18:12:51.414804] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:12:51.632693] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:12:51.990710] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-03T18:12:52.365412] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T18:12:52.790747] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-03T18:12:53.590735] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-03T18:12:53.895126] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T18:12:54.195886] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:12:54.390739] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-03T18:12:55.151595] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T18:12:55.190672] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-03T18:12:55.990709] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-03T18:12:56.403489] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T18:12:56.790635] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-03T18:12:56.842053] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:12:57.590695] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-03T18:12:57.790912] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:12:58.390740] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-03T18:12:58.809089] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-03T18:12:59.190729] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-03T18:12:59.734160] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-03T18:12:59.990710] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-03T18:13:00.383129] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:13:00.790723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-03T18:13:01.561228] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-10-03T18:13:01.590696] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-03T18:13:02.012079] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T18:13:02.390695] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-03T18:13:03.190709] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-03T18:13:04.077410] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (3.29 seconds). [2025-10-03T18:13:04.079493] [INFO ] [REMOTE ] CRC: Full fetch complete (62134 records). [2025-10-03T18:13:04.079688] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-03T18:13:04.080854] [FATAL] [VALIDATOR ] CRC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:13:04.080976] [FATAL] [MAIN ] CRC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:13:04.081059] [WARN ] [MAIN ] CRC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:13:04.081146] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-03T18:13:04.081244] [DEBUG] [LOCAL ] CRC: No primary data file found to delete. [2025-10-03T18:13:04.081313] [INFO ] [LOCAL ] CRC: Starting deletion of derivative data. [2025-10-03T18:13:04.081583] [DEBUG] [LOCAL ] CRC: Deleted derivative data file. [2025-10-03T18:13:04.081752] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 33.3s. Estimated remaining: 4h 14m 39s. Rate: 7.2 symbols/min [2025-10-03T18:13:04.273428] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:04.329471] [DEBUG] [LOCAL ] CRI: Loaded 50218 existing records from primary storage. [2025-10-03T18:13:04.329833] [INFO ] [MAIN ] CRI: Loaded 50218 existing records. [2025-10-03T18:13:04.564118] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:04.564620] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-03T18:13:04.564775] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-03T18:13:04.565043] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-03T18:13:04.565111] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-03T18:13:04.764674] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-03T18:13:04.779107] [INFO ] [REMOTE ] CRBG: Full fetch complete (75725 records). [2025-10-03T18:13:04.810844] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-03T18:13:05.095411] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:05.100293] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-03T18:13:05.363393] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.97 seconds). [2025-10-03T18:13:05.392737] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-03T18:13:05.550217] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-03T18:13:05.550052] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T18:13:05.561603] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-03T18:13:05.563442] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-03T18:13:05.564063] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-03T18:13:05.565898] [DEBUG] [LOCAL ] CRBG: Trimmed 75725 records to 53133 (keeping 200 days of data) [2025-10-03T18:13:05.626890] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-03T18:13:05.907573] [DEBUG] [LOCAL ] CRBG: Primary data saved (53133 records). [2025-10-03T18:13:05.907741] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-03T18:13:05.907832] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRBG took 36.3s. Estimated remaining: 4h 14m 8s. Rate: 7.2 symbols/min [2025-10-03T18:13:06.083897] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:06.134197] [DEBUG] [LOCAL ] CRK: Loaded 52539 existing records from primary storage. [2025-10-03T18:13:06.134531] [INFO ] [MAIN ] CRK: Loaded 52539 existing records. [2025-10-03T18:13:06.322972] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:06.323178] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-03T18:13:06.323225] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-03T18:13:06.323475] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-03T18:13:06.323534] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-03T18:13:06.711668] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:06.712291] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-03T18:13:06.895321] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:13:07.190745] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-03T18:13:07.403169] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T18:13:07.456476] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:13:07.990729] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-03T18:13:08.628275] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:13:08.790733] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-03T18:13:09.399456] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-03T18:13:09.590732] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-03T18:13:10.101840] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T18:13:10.390617] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-03T18:13:10.511892] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:13:11.190675] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-03T18:13:11.600062] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:13:11.990621] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-03T18:13:12.305065] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:13:12.790498] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:13:12.790688] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-03T18:13:13.569711] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T18:13:13.590615] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-03T18:13:14.390707] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-03T18:13:14.707848] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T18:13:14.929900] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T18:13:15.190711] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-03T18:13:15.990635] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-03T18:13:16.106673] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:13:16.109738] [INFO ] [REMOTE ] CRGY: Full fetch complete (75980 records). [2025-10-03T18:13:16.109861] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-03T18:13:16.552053] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-03T18:13:16.552151] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-03T18:13:16.553075] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-03T18:13:16.553166] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-03T18:13:16.555006] [DEBUG] [LOCAL ] CRGY: Trimmed 75980 records to 53284 (keeping 200 days of data) [2025-10-03T18:13:16.790898] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-03T18:13:16.892436] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T18:13:16.895704] [INFO ] [REMOTE ] CRH: Full fetch complete (76909 records). [2025-10-03T18:13:16.896382] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-03T18:13:16.897936] [FATAL] [VALIDATOR ] CRH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:13:16.898873] [FATAL] [MAIN ] CRH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:13:16.900848] [WARN ] [MAIN ] CRH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:13:16.901866] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-03T18:13:16.902910] [DEBUG] [LOCAL ] CRH: No primary data file found to delete. [2025-10-03T18:13:16.903012] [INFO ] [LOCAL ] CRH: Starting deletion of derivative data. [2025-10-03T18:13:16.904028] [DEBUG] [LOCAL ] CRH: Deleted derivative data file. [2025-10-03T18:13:16.904525] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRH took 34.5s. Estimated remaining: 4h 14m 9s. Rate: 7.2 symbols/min [2025-10-03T18:13:17.117662] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:17.122123] [DEBUG] [LOCAL ] CRGY: Primary data saved (53284 records). [2025-10-03T18:13:17.122313] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-03T18:13:17.123989] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRGY took 41.7s. Estimated remaining: 4h 13m 33s. Rate: 7.3 symbols/min [2025-10-03T18:13:17.330175] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:17.345684] [DEBUG] [LOCAL ] CRL: Loaded 43331 existing records from primary storage. [2025-10-03T18:13:17.346026] [INFO ] [MAIN ] CRL: Loaded 43331 existing records. [2025-10-03T18:13:17.559727] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:17.560471] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-03T18:13:17.560635] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-03T18:13:17.561145] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-03T18:13:17.561303] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-03T18:13:17.825900] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-10-03T18:13:17.874989] [INFO ] [MAIN ] CRM: Loaded 54160 existing records. [2025-10-03T18:13:18.148333] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:13:18.340915] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-03T18:13:18.346401] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:18.414194] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-03T18:13:18.480778] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:18.482033] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-03T18:13:18.482110] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-03T18:13:18.483723] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-03T18:13:18.483804] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-03T18:13:18.992963] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:19.034827] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-03T18:13:19.190717] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-03T18:13:19.832295] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:13:19.990671] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-03T18:13:20.134594] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:13:20.790684] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-03T18:13:20.896399] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:13:21.540320] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:13:21.590710] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-03T18:13:22.390683] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-03T18:13:22.485084] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:13:22.864246] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:13:23.190719] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-03T18:13:23.990689] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-03T18:13:24.790631] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-03T18:13:24.863600] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:13:25.005281] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:13:25.288203] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T18:13:25.590696] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-03T18:13:26.291163] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:13:26.390717] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-03T18:13:27.190698] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-03T18:13:27.843859] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T18:13:27.990676] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-03T18:13:28.157419] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:13:28.790628] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-03T18:13:29.108511] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:13:29.590663] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-03T18:13:30.313865] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-10-03T18:13:30.390630] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-03T18:13:30.526743] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:13:31.190680] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-03T18:13:31.419718] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:13:31.990726] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-03T18:13:32.370136] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:13:32.413662] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T18:13:32.790749] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-03T18:13:33.498447] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T18:13:33.590765] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-03T18:13:34.390753] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-03T18:13:34.755148] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:13:35.190726] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-03T18:13:35.423508] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:13:35.655265] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T18:13:35.990772] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-03T18:13:36.790730] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-03T18:13:37.597882] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-03T18:13:37.626192] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-03T18:13:37.679238] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:13:37.887712] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:13:38.390738] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-03T18:13:39.190701] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-03T18:13:39.541754] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:13:39.853605] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:13:39.856141] [INFO ] [REMOTE ] CRI: Full fetch complete (70924 records). [2025-10-03T18:13:39.856263] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-03T18:13:40.005184] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-03T18:13:40.284761] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-03T18:13:40.284852] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-03T18:13:40.285628] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-03T18:13:40.285746] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-03T18:13:40.287297] [DEBUG] [LOCAL ] CRI: Trimmed 70924 records to 50562 (keeping 200 days of data) [2025-10-03T18:13:40.621061] [DEBUG] [LOCAL ] CRI: Primary data saved (50562 records). [2025-10-03T18:13:40.621244] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-03T18:13:40.622064] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 36.5s. Estimated remaining: 4h 14m 17s. Rate: 7.2 symbols/min [2025-10-03T18:13:40.801599] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-03T18:13:40.805678] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:40.854617] [DEBUG] [LOCAL ] CRS: Loaded 43533 existing records from primary storage. [2025-10-03T18:13:40.855037] [INFO ] [MAIN ] CRS: Loaded 43533 existing records. [2025-10-03T18:13:41.081531] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:41.084191] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:13:41.084338] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-03T18:13:41.084615] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-03T18:13:41.095377] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-03T18:13:41.095492] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-03T18:13:41.481552] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:41.590792] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-03T18:13:41.671285] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:13:41.675170] [INFO ] [REMOTE ] CRK: Full fetch complete (75590 records). [2025-10-03T18:13:41.675278] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-03T18:13:42.120947] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-03T18:13:42.121041] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-03T18:13:42.122067] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-03T18:13:42.122140] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-03T18:13:42.123959] [DEBUG] [LOCAL ] CRK: Trimmed 75590 records to 52920 (keeping 200 days of data) [2025-10-03T18:13:42.410771] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-03T18:13:42.458792] [DEBUG] [LOCAL ] CRK: Primary data saved (52920 records). [2025-10-03T18:13:42.458949] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-03T18:13:42.459059] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 36.6s. Estimated remaining: 4h 13m 46s. Rate: 7.2 symbols/min [2025-10-03T18:13:42.648458] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:42.656617] [DEBUG] [LOCAL ] CRT: Loaded 5011 existing records from primary storage. [2025-10-03T18:13:42.656849] [INFO ] [MAIN ] CRT: Loaded 5011 existing records. [2025-10-03T18:13:42.858366] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:42.858701] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-03T18:13:42.858763] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-03T18:13:42.858963] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-03T18:13:42.859027] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-03T18:13:43.016097] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:13:43.101187] [INFO ] [REMOTE ] CRL: Full fetch complete (63059 records). [2025-10-03T18:13:43.123529] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-03T18:13:43.426385] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:43.465771] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-03T18:13:43.777044] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-10-03T18:13:43.813484] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-03T18:13:43.813677] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-03T18:13:43.815451] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-03T18:13:43.815557] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-03T18:13:43.817639] [DEBUG] [LOCAL ] CRL: Trimmed 63059 records to 43656 (keeping 200 days of data) [2025-10-03T18:13:43.937930] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:13:44.033056] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-03T18:13:44.132181] [DEBUG] [LOCAL ] CRL: Primary data saved (43656 records). [2025-10-03T18:13:44.132363] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-03T18:13:44.132462] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRL took 27.2s. Estimated remaining: 4h 13m 15s. Rate: 7.2 symbols/min [2025-10-03T18:13:44.321581] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:44.329119] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T18:13:44.372194] [DEBUG] [LOCAL ] CSAN: Loaded 42614 existing records from primary storage. [2025-10-03T18:13:44.372529] [INFO ] [MAIN ] CSAN: Loaded 42614 existing records. [2025-10-03T18:13:44.564477] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:44.564731] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-03T18:13:44.564836] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-03T18:13:44.565783] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-03T18:13:44.565879] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-03T18:13:44.799595] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-03T18:13:44.948008] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:45.528273] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:13:45.590720] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-03T18:13:46.247854] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:13:46.390665] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-03T18:13:46.624198] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-10-03T18:13:47.079595] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T18:13:47.190720] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-03T18:13:47.990862] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-03T18:13:48.790684] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-03T18:13:48.845076] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T18:13:49.527524] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T18:13:49.557034] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:13:49.590692] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-03T18:13:50.390674] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-03T18:13:51.000821] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:13:51.190703] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-03T18:13:51.990690] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-03T18:13:52.563721] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:13:52.723204] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:13:52.790630] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-03T18:13:52.950178] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-10-03T18:13:53.591865] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-03T18:13:53.593143] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T18:13:54.390691] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-03T18:13:55.082362] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T18:13:55.190702] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-03T18:13:55.990686] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-03T18:13:56.118355] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-10-03T18:13:56.577754] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T18:13:56.603538] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:13:56.790674] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-03T18:13:57.510742] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:13:57.590716] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-03T18:13:58.160360] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T18:13:58.161721] [INFO ] [REMOTE ] CRT: Full fetch complete (7566 records). [2025-10-03T18:13:58.161856] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-03T18:13:58.395817] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-03T18:13:58.636126] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-03T18:13:58.636274] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-03T18:13:58.636558] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-03T18:13:58.636636] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-03T18:13:58.637167] [DEBUG] [LOCAL ] CRT: Trimmed 7566 records to 5044 (keeping 200 days of data) [2025-10-03T18:13:58.674234] [DEBUG] [LOCAL ] CRT: Primary data saved (5044 records). [2025-10-03T18:13:58.674372] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-03T18:13:58.674497] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRT took 16.2s. Estimated remaining: 4h 13m 29s. Rate: 7.2 symbols/min [2025-10-03T18:13:58.861827] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:13:58.901538] [DEBUG] [LOCAL ] CSL: Loaded 31700 existing records from primary storage. [2025-10-03T18:13:58.901882] [INFO ] [MAIN ] CSL: Loaded 31700 existing records. [2025-10-03T18:13:59.096540] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:13:59.098415] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-03T18:13:59.098497] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-03T18:13:59.099939] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-03T18:13:59.100000] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-03T18:13:59.195739] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-03T18:13:59.510717] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:13:59.995920] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-03T18:14:00.018440] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T18:14:00.790693] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-03T18:14:01.590636] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-03T18:14:01.812345] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.62 seconds). [2025-10-03T18:14:01.816407] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-03T18:14:01.816617] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-03T18:14:02.283884] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-03T18:14:02.284243] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-03T18:14:02.285528] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-03T18:14:02.285741] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-03T18:14:02.298853] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54550 (keeping 200 days of data) [2025-10-03T18:14:02.317144] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-03T18:14:02.390901] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-03T18:14:02.456999] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:14:02.733607] [DEBUG] [LOCAL ] CRM: Primary data saved (54550 records). [2025-10-03T18:14:02.733824] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-03T18:14:02.734878] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRM took 45.6s. Estimated remaining: 4h 13m 6s. Rate: 7.2 symbols/min [2025-10-03T18:14:02.934809] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:02.955794] [DEBUG] [LOCAL ] CSR: Loaded 12887 existing records from primary storage. [2025-10-03T18:14:02.956051] [INFO ] [MAIN ] CSR: Loaded 12887 existing records. [2025-10-03T18:14:03.147673] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:03.148108] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-03T18:14:03.148259] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-03T18:14:03.149135] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-03T18:14:03.149203] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-03T18:14:03.198779] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-03T18:14:03.376906] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:14:03.601866] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:03.990635] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-03T18:14:04.067354] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:14:04.655344] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:14:04.790674] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-03T18:14:05.510044] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:14:05.590684] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-03T18:14:06.390637] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-03T18:14:06.477162] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:14:06.551832] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:14:07.190708] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-03T18:14:07.841851] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T18:14:07.990719] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-03T18:14:08.677542] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T18:14:08.790707] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-03T18:14:09.459135] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:14:09.590742] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-03T18:14:10.390744] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-03T18:14:10.565835] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:14:10.990107] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T18:14:11.012949] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T18:14:11.190740] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-03T18:14:11.977198] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:14:11.990712] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-03T18:14:12.790731] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-03T18:14:13.590708] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-03T18:14:13.775835] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:14:14.104122] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:14:14.390697] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-03T18:14:14.922449] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:14:15.190700] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-03T18:14:15.921306] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:14:15.990688] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-03T18:14:16.019677] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T18:14:16.790693] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-03T18:14:16.985931] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:14:17.590743] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-03T18:14:18.085854] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T18:14:18.087943] [INFO ] [REMOTE ] CSAN: Full fetch complete (60604 records). [2025-10-03T18:14:18.088043] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-03T18:14:18.398212] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-03T18:14:18.515438] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-03T18:14:18.515595] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-03T18:14:18.516427] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-03T18:14:18.516492] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-03T18:14:18.517968] [DEBUG] [LOCAL ] CSAN: Trimmed 60604 records to 42880 (keeping 200 days of data) [2025-10-03T18:14:18.777331] [DEBUG] [LOCAL ] CSAN: Primary data saved (42880 records). [2025-10-03T18:14:18.777467] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-03T18:14:18.777575] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CSAN took 34.6s. Estimated remaining: 4h 13m 24s. Rate: 7.2 symbols/min [2025-10-03T18:14:18.983098] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:18.984916] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:14:19.036405] [DEBUG] [LOCAL ] CSTM: Loaded 47784 existing records from primary storage. [2025-10-03T18:14:19.036747] [INFO ] [MAIN ] CSTM: Loaded 47784 existing records. [2025-10-03T18:14:19.198744] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-03T18:14:19.234765] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:19.235430] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-03T18:14:19.235494] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-03T18:14:19.236432] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-03T18:14:19.236512] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-03T18:14:19.622781] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:19.975603] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:14:19.990618] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-03T18:14:20.614635] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:14:20.790702] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-03T18:14:21.597926] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-03T18:14:21.601404] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T18:14:21.792698] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T18:14:22.390688] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-03T18:14:22.669377] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T18:14:23.190683] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-03T18:14:23.356521] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T18:14:23.990716] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-03T18:14:24.559577] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:14:24.561853] [INFO ] [REMOTE ] CRS: Full fetch complete (62739 records). [2025-10-03T18:14:24.562023] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-03T18:14:24.809065] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-03T18:14:24.936384] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T18:14:25.055109] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-03T18:14:25.055207] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-03T18:14:25.055947] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-03T18:14:25.056016] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-03T18:14:25.057422] [DEBUG] [LOCAL ] CRS: Trimmed 62739 records to 43817 (keeping 200 days of data) [2025-10-03T18:14:25.350235] [DEBUG] [LOCAL ] CRS: Primary data saved (43817 records). [2025-10-03T18:14:25.350379] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-03T18:14:25.351231] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CRS took 44.7s. Estimated remaining: 4h 13m 10s. Rate: 7.2 symbols/min [2025-10-03T18:14:25.539212] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:25.557366] [DEBUG] [LOCAL ] CSV: Loaded 12924 existing records from primary storage. [2025-10-03T18:14:25.557611] [INFO ] [MAIN ] CSV: Loaded 12924 existing records. [2025-10-03T18:14:25.595859] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-03T18:14:25.760171] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:25.760412] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-03T18:14:25.760463] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-03T18:14:25.760797] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-03T18:14:25.760859] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-03T18:14:26.148009] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:26.390696] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-03T18:14:26.454785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:14:26.528150] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:14:27.190702] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-03T18:14:27.568383] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T18:14:27.990693] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-03T18:14:28.602019] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T18:14:28.702523] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:14:28.790688] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-03T18:14:29.590689] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-03T18:14:29.705776] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:14:30.390683] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-03T18:14:31.187440] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T18:14:31.195037] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-03T18:14:31.990730] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-03T18:14:32.036747] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:14:32.163062] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T18:14:32.790994] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-03T18:14:32.796605] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T18:14:33.590747] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-03T18:14:34.390693] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-03T18:14:34.391978] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:14:34.582990] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T18:14:35.190689] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-03T18:14:35.580843] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:14:35.583282] [INFO ] [REMOTE ] CSL: Full fetch complete (45377 records). [2025-10-03T18:14:35.583407] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-03T18:14:35.972560] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:14:35.992282] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-03T18:14:36.011042] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-03T18:14:36.011163] [INFO ] [REMOTE ] CSR: Full fetch complete (17712 records). [2025-10-03T18:14:36.011322] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-03T18:14:36.012212] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-03T18:14:36.012134] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-03T18:14:36.012443] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-03T18:14:36.055797] [DEBUG] [LOCAL ] CSL: Trimmed 45377 records to 31939 (keeping 200 days of data) [2025-10-03T18:14:36.544997] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-03T18:14:36.554689] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-03T18:14:36.555156] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-03T18:14:36.555623] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-03T18:14:36.568570] [DEBUG] [LOCAL ] CSR: Trimmed 17712 records to 12973 (keeping 200 days of data) [2025-10-03T18:14:36.741437] [DEBUG] [LOCAL ] CSL: Primary data saved (31939 records). [2025-10-03T18:14:36.742113] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-03T18:14:36.742252] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSL took 38.1s. Estimated remaining: 4h 13m 12s. Rate: 7.2 symbols/min [2025-10-03T18:14:36.802918] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-03T18:14:36.883946] [DEBUG] [LOCAL ] CSR: Primary data saved (12973 records). [2025-10-03T18:14:36.889415] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-03T18:14:36.909688] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSR took 34.2s. Estimated remaining: 4h 12m 36s. Rate: 7.2 symbols/min [2025-10-03T18:14:36.963868] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:36.987920] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-03T18:14:37.017045] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-03T18:14:37.035125] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-03T18:14:37.067240] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-03T18:14:37.082046] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-03T18:14:37.131671] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-03T18:14:37.176220] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:37.207299] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T18:14:37.288783] [DEBUG] [LOCAL ] CTBB: Loaded 7097 existing records from primary storage. [2025-10-03T18:14:37.306675] [INFO ] [MAIN ] CTBB: Loaded 7097 existing records. [2025-10-03T18:14:37.597845] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-03T18:14:37.773041] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:37.809568] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-03T18:14:37.822096] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-03T18:14:37.836403] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:37.836875] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-03T18:14:37.836962] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-03T18:14:38.243485] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:38.390634] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-03T18:14:38.566941] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:14:38.583024] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:14:38.583414] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-03T18:14:38.583510] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:14:38.583561] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-03T18:14:38.583628] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:14:38.583738] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-03T18:14:38.583816] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-03T18:14:38.583872] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-03T18:14:38.583992] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-03T18:14:38.584088] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSW took 1.8s. Estimated remaining: 4h 12m 6s. Rate: 7.3 symbols/min [2025-10-03T18:14:38.786231] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:38.787394] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T18:14:38.800298] [DEBUG] [LOCAL ] CTDD: Loaded 5926 existing records from primary storage. [2025-10-03T18:14:38.800532] [INFO ] [MAIN ] CTDD: Loaded 5926 existing records. [2025-10-03T18:14:39.010876] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:39.011110] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-03T18:14:39.011163] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-03T18:14:39.011534] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-03T18:14:39.011594] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-03T18:14:39.191406] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-03T18:14:39.411841] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:39.990689] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-03T18:14:40.193932] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:14:40.790696] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-03T18:14:40.824755] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:14:41.518863] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:14:41.590759] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-03T18:14:42.390693] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-03T18:14:42.981407] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:14:43.190730] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-03T18:14:43.882177] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-03T18:14:43.999357] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-03T18:14:44.027625] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:14:44.771511] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:14:44.790683] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-03T18:14:45.590743] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-03T18:14:45.680056] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:14:46.390729] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-03T18:14:46.407711] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T18:14:47.029375] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T18:14:47.190784] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-03T18:14:47.799838] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:14:47.990706] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-03T18:14:48.722481] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:14:48.790739] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-03T18:14:49.590739] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-03T18:14:49.924799] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T18:14:50.221283] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T18:14:50.390675] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-03T18:14:51.190694] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-03T18:14:51.243682] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T18:14:51.990680] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-03T18:14:52.259542] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:14:52.790694] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-03T18:14:53.590767] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-03T18:14:53.715856] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:14:54.033125] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T18:14:54.307576] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T18:14:54.390714] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-03T18:14:55.136951] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:14:55.138388] [INFO ] [REMOTE ] CSV: Full fetch complete (19591 records). [2025-10-03T18:14:55.138520] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-03T18:14:55.195884] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-03T18:14:55.513892] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-03T18:14:55.514000] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-03T18:14:55.514674] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-03T18:14:55.514741] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-03T18:14:55.515325] [DEBUG] [LOCAL ] CSV: Trimmed 19591 records to 13044 (keeping 200 days of data) [2025-10-03T18:14:55.598084] [DEBUG] [LOCAL ] CSV: Primary data saved (13044 records). [2025-10-03T18:14:55.598286] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-03T18:14:55.598404] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSV took 30.2s. Estimated remaining: 4h 12m 27s. Rate: 7.2 symbols/min [2025-10-03T18:14:55.769931] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:55.770237] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-03T18:14:55.770297] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-03T18:14:55.770429] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-03T18:14:55.770487] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-03T18:14:55.770528] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-03T18:14:55.770563] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-03T18:14:55.995870] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-03T18:14:56.039387] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-03T18:14:56.155041] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:56.760155] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:14:56.790681] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-03T18:14:57.590774] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-03T18:14:57.903534] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:14:57.903944] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-03T18:14:57.904049] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:14:57.904125] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-03T18:14:57.904191] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:14:57.904275] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-03T18:14:57.904534] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-03T18:14:57.904866] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-03T18:14:57.904950] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-03T18:14:57.905025] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CTEST took 2.3s. Estimated remaining: 4h 11m 59s. Rate: 7.3 symbols/min [2025-10-03T18:14:58.085195] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:58.085523] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-03T18:14:58.085594] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-03T18:14:58.085801] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-03T18:14:58.085917] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-03T18:14:58.085985] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-03T18:14:58.086022] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-03T18:14:58.395788] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-03T18:14:58.541926] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:58.585702] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:14:59.151906] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T18:14:59.153326] [INFO ] [REMOTE ] CTBB: Full fetch complete (10694 records). [2025-10-03T18:14:59.153632] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-03T18:14:59.154582] [FATAL] [VALIDATOR ] CTBB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:14:59.154739] [FATAL] [MAIN ] CTBB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:14:59.154787] [WARN ] [MAIN ] CTBB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:14:59.154831] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-03T18:14:59.154896] [DEBUG] [LOCAL ] CTBB: No primary data file found to delete. [2025-10-03T18:14:59.154934] [INFO ] [LOCAL ] CTBB: Starting deletion of derivative data. [2025-10-03T18:14:59.155232] [DEBUG] [LOCAL ] CTBB: Deleted derivative data file. [2025-10-03T18:14:59.155346] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTBB took 22.2s. Estimated remaining: 4h 11m 27s. Rate: 7.3 symbols/min [2025-10-03T18:14:59.196011] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-03T18:14:59.359807] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:14:59.395632] [DEBUG] [LOCAL ] CTO: Loaded 28044 existing records from primary storage. [2025-10-03T18:14:59.395945] [INFO ] [MAIN ] CTO: Loaded 28044 existing records. [2025-10-03T18:14:59.585836] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:14:59.586082] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-03T18:14:59.586132] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-03T18:14:59.586370] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-03T18:14:59.586430] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-03T18:14:59.906457] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T18:14:59.991508] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:14:59.991668] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-03T18:15:00.193426] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:15:00.193820] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-03T18:15:00.193914] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:15:00.194003] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-03T18:15:00.194072] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:15:00.194144] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-03T18:15:00.194211] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-03T18:15:00.194249] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-03T18:15:00.194291] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-03T18:15:00.194340] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTEV took 2.3s. Estimated remaining: 4h 10m 54s. Rate: 7.3 symbols/min [2025-10-03T18:15:00.394705] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:00.436632] [DEBUG] [LOCAL ] CTOS: Loaded 36860 existing records from primary storage. [2025-10-03T18:15:00.437019] [INFO ] [MAIN ] CTOS: Loaded 36860 existing records. [2025-10-03T18:15:00.645424] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:00.645696] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-03T18:15:00.645769] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-03T18:15:00.646258] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-03T18:15:00.646319] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-03T18:15:00.795931] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-03T18:15:01.050304] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:01.590725] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-03T18:15:02.390704] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-03T18:15:03.190751] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-03T18:15:03.385525] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:15:03.472203] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-10-03T18:15:03.736074] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T18:15:03.990750] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-03T18:15:04.224815] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:15:04.790708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-03T18:15:05.590709] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-03T18:15:05.839704] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:15:05.929183] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T18:15:06.222893] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T18:15:06.390708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-03T18:15:07.190705] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-03T18:15:07.820279] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:15:07.820060] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:15:07.990708] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-03T18:15:08.790720] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-03T18:15:09.406772] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:15:09.575597] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:15:09.590621] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-03T18:15:10.390677] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-03T18:15:10.950244] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:15:11.190700] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-03T18:15:11.854015] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:15:11.856753] [INFO ] [REMOTE ] CSTM: Full fetch complete (69251 records). [2025-10-03T18:15:11.856870] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-03T18:15:11.993127] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-03T18:15:12.330781] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-03T18:15:12.330935] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-03T18:15:12.331723] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-03T18:15:12.331816] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-03T18:15:12.333393] [DEBUG] [LOCAL ] CSTM: Trimmed 69251 records to 48106 (keeping 200 days of data) [2025-10-03T18:15:12.635250] [DEBUG] [LOCAL ] CSTM: Primary data saved (48106 records). [2025-10-03T18:15:12.635432] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-03T18:15:12.635560] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CSTM took 53.9s. Estimated remaining: 4h 10m 60s. Rate: 7.3 symbols/min [2025-10-03T18:15:12.800066] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-03T18:15:12.848578] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:12.852766] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:15:12.915308] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-10-03T18:15:12.915680] [INFO ] [MAIN ] CTRA: Loaded 54038 existing records. [2025-10-03T18:15:13.122095] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:13.122348] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-03T18:15:13.122401] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-03T18:15:13.122768] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-03T18:15:13.122830] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-03T18:15:13.425781] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:15:13.487690] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:15:13.530420] [INFO ] [REMOTE ] CTDD: Full fetch complete (8402 records). [2025-10-03T18:15:13.545399] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-03T18:15:13.569434] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:13.570414] [FATAL] [VALIDATOR ] CTDD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:15:13.571022] [FATAL] [MAIN ] CTDD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:15:13.571112] [WARN ] [MAIN ] CTDD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:15:13.571187] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-03T18:15:13.571260] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-03T18:15:13.571299] [INFO ] [LOCAL ] CTDD: Starting deletion of derivative data. [2025-10-03T18:15:13.571587] [DEBUG] [LOCAL ] CTDD: Deleted derivative data file. [2025-10-03T18:15:13.571729] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTDD took 35.0s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-03T18:15:13.595785] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-03T18:15:13.766933] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:13.816921] [DEBUG] [LOCAL ] CTRE: Loaded 49617 existing records from primary storage. [2025-10-03T18:15:13.817277] [INFO ] [MAIN ] CTRE: Loaded 49617 existing records. [2025-10-03T18:15:14.007503] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:14.007753] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-03T18:15:14.007807] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-03T18:15:14.008065] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-03T18:15:14.008125] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-03T18:15:14.393877] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-03T18:15:14.417611] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:15.190680] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-03T18:15:15.672128] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:15:15.862501] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:15:15.990688] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-03T18:15:16.790715] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-03T18:15:17.304173] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:15:17.590691] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-03T18:15:18.206613] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:15:18.368765] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-03T18:15:18.390668] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-03T18:15:18.543840] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:15:19.190700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-03T18:15:19.847727] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:15:19.990683] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-03T18:15:20.788935] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:15:20.800897] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-03T18:15:21.590705] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-03T18:15:21.879752] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:15:21.917109] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:15:22.390671] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-03T18:15:22.805263] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:15:23.190694] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-03T18:15:23.952378] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:15:23.990698] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-03T18:15:24.790701] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-03T18:15:25.095913] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:15:25.313776] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:15:25.590705] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-03T18:15:26.011685] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:15:26.390691] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-03T18:15:27.190717] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-03T18:15:27.609293] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:15:27.645714] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T18:15:27.990736] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-03T18:15:28.791038] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-03T18:15:28.791879] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:15:28.795063] [INFO ] [REMOTE ] CTO: Full fetch complete (41788 records). [2025-10-03T18:15:28.795173] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-03T18:15:29.227404] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-03T18:15:29.227496] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-03T18:15:29.228095] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-03T18:15:29.228199] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-03T18:15:29.229495] [DEBUG] [LOCAL ] CTO: Trimmed 41788 records to 28288 (keeping 200 days of data) [2025-10-03T18:15:29.418734] [DEBUG] [LOCAL ] CTO: Primary data saved (28288 records). [2025-10-03T18:15:29.418892] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-03T18:15:29.419006] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTO took 30.3s. Estimated remaining: 4h 10m 44s. Rate: 7.3 symbols/min [2025-10-03T18:15:29.626933] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-03T18:15:29.631738] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:29.682849] [DEBUG] [LOCAL ] CTRI: Loaded 39023 existing records from primary storage. [2025-10-03T18:15:29.683197] [INFO ] [MAIN ] CTRI: Loaded 39023 existing records. [2025-10-03T18:15:29.940954] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:29.941230] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-03T18:15:29.941406] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-03T18:15:29.941850] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-03T18:15:29.942185] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-03T18:15:29.944067] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:15:30.352548] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:30.371851] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:15:30.390615] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-03T18:15:31.190635] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-03T18:15:31.449286] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:15:31.863375] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:15:31.990720] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-03T18:15:32.790741] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-03T18:15:32.886509] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:15:33.590720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-03T18:15:33.886227] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:15:33.930295] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:15:34.390693] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-03T18:15:34.888223] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:15:35.190711] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-03T18:15:35.810890] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:15:35.990734] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-03T18:15:36.790636] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-03T18:15:37.343286] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T18:15:37.403114] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:15:37.590682] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-03T18:15:38.004313] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:15:38.390717] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-03T18:15:39.190710] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-03T18:15:39.384793] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:15:39.990672] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-03T18:15:40.377396] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:15:40.414018] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:15:40.790700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-03T18:15:41.230565] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:15:41.590721] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-03T18:15:42.390702] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-03T18:15:42.522243] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T18:15:42.854827] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T18:15:42.857088] [INFO ] [REMOTE ] CTOS: Full fetch complete (53621 records). [2025-10-03T18:15:42.857188] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-03T18:15:43.195934] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-03T18:15:43.276867] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-03T18:15:43.276959] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-03T18:15:43.277713] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-03T18:15:43.277781] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-03T18:15:43.279149] [DEBUG] [LOCAL ] CTOS: Trimmed 53621 records to 37159 (keeping 200 days of data) [2025-10-03T18:15:43.508165] [DEBUG] [LOCAL ] CTOS: Primary data saved (37159 records). [2025-10-03T18:15:43.508321] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-03T18:15:43.508410] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTOS took 43.3s. Estimated remaining: 4h 10m 55s. Rate: 7.3 symbols/min [2025-10-03T18:15:43.711605] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:43.744098] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T18:15:43.759922] [DEBUG] [LOCAL ] CTS: Loaded 19508 existing records from primary storage. [2025-10-03T18:15:43.760230] [INFO ] [MAIN ] CTS: Loaded 19508 existing records. [2025-10-03T18:15:43.961089] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:15:43.961314] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-03T18:15:43.961367] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-03T18:15:43.961601] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-03T18:15:43.961691] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-03T18:15:43.995766] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-03T18:15:44.391828] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:44.790694] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-03T18:15:44.891544] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T18:15:44.894616] [INFO ] [REMOTE ] CTRA: Full fetch complete (77662 records). [2025-10-03T18:15:44.894842] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-03T18:15:45.324873] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-03T18:15:45.324962] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-03T18:15:45.325947] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-03T18:15:45.326020] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-03T18:15:45.327750] [DEBUG] [LOCAL ] CTRA: Trimmed 77662 records to 54427 (keeping 200 days of data) [2025-10-03T18:15:45.590686] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-03T18:15:45.709744] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:15:45.750115] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:15:45.768765] [DEBUG] [LOCAL ] CTRA: Primary data saved (54427 records). [2025-10-03T18:15:45.768939] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-03T18:15:45.769030] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRA took 33.1s. Estimated remaining: 4h 10m 27s. Rate: 7.3 symbols/min [2025-10-03T18:15:45.952317] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:45.952510] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-10-03T18:15:45.952553] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-10-03T18:15:45.952695] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-03T18:15:45.952751] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-03T18:15:45.952798] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-03T18:15:45.952834] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-03T18:15:46.353502] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:46.390701] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-03T18:15:46.845076] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T18:15:47.190735] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-03T18:15:47.662320] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:15:47.669431] [INFO ] [REMOTE ] CTRE: Full fetch complete (71215 records). [2025-10-03T18:15:47.669630] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-03T18:15:47.991838] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-03T18:15:48.095069] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-03T18:15:48.095161] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-03T18:15:48.096021] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-03T18:15:48.096091] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-03T18:15:48.097625] [DEBUG] [LOCAL ] CTRE: Trimmed 71215 records to 49988 (keeping 200 days of data) [2025-10-03T18:15:48.426728] [DEBUG] [LOCAL ] CTRE: Primary data saved (49988 records). [2025-10-03T18:15:48.426888] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-03T18:15:48.426991] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTRE took 34.9s. Estimated remaining: 4h 10m 1s. Rate: 7.3 symbols/min [2025-10-03T18:15:48.615932] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:15:48.616345] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-03T18:15:48.616427] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-03T18:15:48.633138] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-03T18:15:48.633226] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-03T18:15:48.633286] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-03T18:15:48.633325] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-03T18:15:48.720561] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T18:15:48.795769] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-03T18:15:49.071129] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:15:49.590726] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-03T18:15:49.764350] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T18:15:50.041346] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T18:15:50.055251] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T18:15:50.390677] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-03T18:15:51.190678] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-03T18:15:51.396217] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T18:15:51.990703] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-03T18:15:52.790695] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-03T18:15:52.911959] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:15:53.433059] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-03T18:15:53.461583] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:15:53.590703] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-03T18:15:54.390690] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-03T18:15:54.689910] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:15:55.190720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-03T18:15:55.817049] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:15:55.990718] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-03T18:15:56.585369] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:15:56.790701] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-03T18:15:57.126526] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:15:57.590725] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-03T18:15:57.902327] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:15:58.390686] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-03T18:15:59.170378] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:15:59.190712] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-03T18:15:59.994255] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-03T18:16:00.002363] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:16:00.373459] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T18:16:00.503918] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T18:16:00.790722] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-03T18:16:01.590755] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-03T18:16:02.390699] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-03T18:16:02.464718] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:16:03.073571] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-03T18:16:03.190725] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-03T18:16:03.990638] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-03T18:16:04.118797] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T18:16:04.207897] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:16:04.280140] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-03T18:16:04.790674] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-03T18:16:05.590718] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-03T18:16:05.932169] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T18:16:06.090578] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T18:16:06.092799] [INFO ] [REMOTE ] CTRI: Full fetch complete (51728 records). [2025-10-03T18:16:06.092960] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-03T18:16:06.093939] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:16:06.094109] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:06.094166] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:06.094217] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-03T18:16:06.094296] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-10-03T18:16:06.094371] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-10-03T18:16:06.094807] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-10-03T18:16:06.095624] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRI took 36.7s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-03T18:16:06.299042] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:06.381021] [DEBUG] [LOCAL ] CUBE: Loaded 51004 existing records from primary storage. [2025-10-03T18:16:06.381482] [INFO ] [MAIN ] CUBE: Loaded 51004 existing records. [2025-10-03T18:16:06.396131] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-03T18:16:06.605862] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:06.606134] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-03T18:16:06.606186] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-03T18:16:06.606593] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-03T18:16:06.606693] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-03T18:16:07.042624] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:07.190776] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-03T18:16:07.990682] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-03T18:16:08.252473] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-03T18:16:08.254902] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:16:08.790708] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-03T18:16:08.860792] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:16:09.590713] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-03T18:16:10.390722] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-03T18:16:10.821700] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T18:16:11.018276] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:16:11.190731] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-03T18:16:11.779103] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:16:11.990724] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-03T18:16:12.790716] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-03T18:16:13.111039] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T18:16:13.207525] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-03T18:16:13.590737] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-03T18:16:14.390637] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-03T18:16:14.459310] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T18:16:14.600020] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:16:15.190718] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-03T18:16:15.698173] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-03T18:16:15.990683] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-03T18:16:16.412321] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:16:16.764600] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:16:16.765903] [INFO ] [REMOTE ] CTS: Full fetch complete (26699 records). [2025-10-03T18:16:16.766047] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-03T18:16:16.766607] [FATAL] [VALIDATOR ] CTS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:16:16.766756] [FATAL] [MAIN ] CTS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:16.766839] [WARN ] [MAIN ] CTS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:16.766941] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-03T18:16:16.767069] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-10-03T18:16:16.767146] [INFO ] [LOCAL ] CTS: Starting deletion of derivative data. [2025-10-03T18:16:16.767422] [DEBUG] [LOCAL ] CTS: Deleted derivative data file. [2025-10-03T18:16:16.767583] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CTS took 33.3s. Estimated remaining: 4h 10m 23s. Rate: 7.3 symbols/min [2025-10-03T18:16:16.795836] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-03T18:16:16.985371] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:17.016258] [DEBUG] [LOCAL ] CUBI: Loaded 27296 existing records from primary storage. [2025-10-03T18:16:17.016782] [INFO ] [MAIN ] CUBI: Loaded 27296 existing records. [2025-10-03T18:16:17.253302] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:17.253600] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-03T18:16:17.253691] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-03T18:16:17.253948] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-03T18:16:17.254006] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-03T18:16:17.595771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-03T18:16:17.639572] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:17.967889] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:16:18.390683] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-03T18:16:18.507518] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:16:18.510271] [INFO ] [REMOTE ] CTVA: Full fetch complete (76991 records). [2025-10-03T18:16:18.510396] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-03T18:16:18.811208] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-03T18:16:18.974485] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-03T18:16:18.974601] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-03T18:16:18.975889] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-03T18:16:18.975988] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-03T18:16:18.980715] [DEBUG] [LOCAL ] CTVA: Trimmed 76991 records to 54019 (keeping 200 days of data) [2025-10-03T18:16:19.194314] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-03T18:16:19.358713] [DEBUG] [LOCAL ] CTVA: Primary data saved (54019 records). [2025-10-03T18:16:19.358877] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-03T18:16:19.358959] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CTVA took 33.6s. Estimated remaining: 4h 9m 56s. Rate: 7.3 symbols/min [2025-10-03T18:16:19.583282] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:19.638665] [DEBUG] [LOCAL ] CUK: Loaded 51371 existing records from primary storage. [2025-10-03T18:16:19.639032] [INFO ] [MAIN ] CUK: Loaded 51371 existing records. [2025-10-03T18:16:19.870042] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:19.870318] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-03T18:16:19.870369] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-03T18:16:19.870759] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-03T18:16:19.870818] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-03T18:16:19.995725] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-03T18:16:20.327797] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:20.415066] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-03T18:16:20.790686] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-03T18:16:21.030546] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:16:21.031294] [INFO ] [REMOTE ] CUBB: Full fetch complete (925 records). [2025-10-03T18:16:21.031367] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-03T18:16:21.240266] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-03T18:16:21.240457] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:16:21.240526] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:16:21.240598] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-03T18:16:21.240693] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-03T18:16:21.240752] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-03T18:16:21.240799] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-03T18:16:21.240861] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBB took 32.8s. Estimated remaining: 4h 9m 27s. Rate: 7.3 symbols/min [2025-10-03T18:16:21.441078] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:21.448743] [DEBUG] [LOCAL ] CULP: Loaded 2954 existing records from primary storage. [2025-10-03T18:16:21.449035] [INFO ] [MAIN ] CULP: Loaded 2954 existing records. [2025-10-03T18:16:21.595854] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-03T18:16:21.662245] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:21.662449] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-03T18:16:21.662518] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-03T18:16:21.662723] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-03T18:16:21.662783] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-03T18:16:22.091101] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:16:22.172161] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:22.390715] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-03T18:16:23.102540] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-03T18:16:23.190639] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-03T18:16:23.462076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:16:23.923051] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:16:23.990735] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-03T18:16:24.574877] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T18:16:24.790691] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-03T18:16:25.590763] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-03T18:16:26.390744] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-03T18:16:26.751070] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:16:26.811441] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T18:16:27.190696] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-03T18:16:27.990744] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-03T18:16:28.143161] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:16:28.581941] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:16:28.790683] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-03T18:16:29.590733] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-03T18:16:29.775179] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:16:29.868713] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:16:30.101092] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T18:16:30.390705] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-03T18:16:31.190727] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-03T18:16:31.990666] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-03T18:16:32.043851] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:16:32.338878] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T18:16:32.790708] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-03T18:16:33.099985] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T18:16:33.590725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-03T18:16:34.078881] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T18:16:34.390746] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-03T18:16:35.190740] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-03T18:16:35.519050] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:16:35.990675] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-03T18:16:36.230320] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:16:36.396461] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:16:36.790709] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-03T18:16:37.590694] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-03T18:16:38.071883] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:16:38.108859] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:16:38.390737] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-03T18:16:38.846178] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:16:39.190718] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-03T18:16:39.421016] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:16:39.423333] [INFO ] [REMOTE ] CUBI: Full fetch complete (39392 records). [2025-10-03T18:16:39.423499] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-03T18:16:39.880269] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T18:16:39.986676] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-03T18:16:39.986781] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-03T18:16:39.987894] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-03T18:16:39.987976] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-03T18:16:39.989189] [DEBUG] [LOCAL ] CUBI: Trimmed 39392 records to 27487 (keeping 200 days of data) [2025-10-03T18:16:39.990692] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-03T18:16:40.195514] [DEBUG] [LOCAL ] CUBI: Primary data saved (27487 records). [2025-10-03T18:16:40.195709] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-03T18:16:40.195919] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CUBI took 23.4s. Estimated remaining: 4h 9m 54s. Rate: 7.3 symbols/min [2025-10-03T18:16:40.443907] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:16:40.491781] [DEBUG] [LOCAL ] CURB: Loaded 32869 existing records from primary storage. [2025-10-03T18:16:40.492093] [INFO ] [MAIN ] CURB: Loaded 32869 existing records. [2025-10-03T18:16:40.598153] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:16:40.711331] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:16:40.711628] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-03T18:16:40.711718] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-03T18:16:40.711953] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-03T18:16:40.712014] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-03T18:16:40.795914] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-03T18:16:41.112007] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:16:41.590733] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-03T18:16:42.390689] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-03T18:16:42.496262] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:16:42.892987] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:16:43.190715] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-03T18:16:43.450424] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:16:43.990714] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-03T18:16:44.790687] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-03T18:16:44.928289] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:16:45.466008] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T18:16:45.590691] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-03T18:16:46.390692] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-03T18:16:46.583014] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T18:16:47.190720] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-03T18:16:47.386816] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:16:47.426226] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T18:16:47.990700] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-03T18:16:48.738012] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T18:16:48.790743] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-03T18:16:49.198332] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T18:16:49.314729] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:16:49.590720] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-03T18:16:50.390712] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-03T18:16:51.147324] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:16:51.154629] [INFO ] [REMOTE ] CUBE: Full fetch complete (73048 records). [2025-10-03T18:16:51.154861] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-03T18:16:51.199215] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-03T18:16:51.599996] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-03T18:16:51.600102] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-03T18:16:51.601176] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-03T18:16:51.601265] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-03T18:16:51.603257] [DEBUG] [LOCAL ] CUBE: Trimmed 73048 records to 51365 (keeping 200 days of data) [2025-10-03T18:16:51.958289] [DEBUG] [LOCAL ] CUBE: Primary data saved (51365 records). [2025-10-03T18:16:51.958491] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-03T18:16:51.959556] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CUBE took 45.9s. Estimated remaining: 4h 9m 57s. Rate: 7.3 symbols/min [2025-10-03T18:16:51.990697] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-03T18:16:52.119915] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-03T18:16:52.458293] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:16:52.658936] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:16:52.790725] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-03T18:16:53.391030] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:16:53.391785] [INFO ] [REMOTE ] CULP: Full fetch complete (4647 records). [2025-10-03T18:16:53.391856] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-03T18:16:53.601098] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-03T18:16:53.798201] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-03T18:16:53.798286] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-03T18:16:53.798511] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-03T18:16:53.798563] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-03T18:16:53.799025] [DEBUG] [LOCAL ] CULP: Trimmed 4647 records to 2970 (keeping 200 days of data) [2025-10-03T18:16:53.818032] [DEBUG] [LOCAL ] CULP: Primary data saved (2970 records). [2025-10-03T18:16:53.818198] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-03T18:16:53.818309] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CULP took 32.6s. Estimated remaining: 4h 9m 28s. Rate: 7.3 symbols/min [2025-10-03T18:16:54.390722] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-03T18:16:55.136383] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:16:55.190687] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-03T18:16:56.227034] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:16:56.238911] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-03T18:16:56.791073] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T18:16:56.799960] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-03T18:16:57.779183] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:16:57.782103] [INFO ] [REMOTE ] CUK: Full fetch complete (73987 records). [2025-10-03T18:16:57.782254] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-03T18:16:58.253017] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-03T18:16:58.253844] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-03T18:16:58.254713] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:16:58.255708] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-03T18:16:58.262699] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-03T18:16:58.263405] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-03T18:16:58.265384] [DEBUG] [LOCAL ] CUK: Trimmed 73987 records to 51758 (keeping 200 days of data) [2025-10-03T18:16:58.600356] [DEBUG] [LOCAL ] CUK: Primary data saved (51758 records). [2025-10-03T18:16:58.600512] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-03T18:16:58.600603] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CUK took 39.2s. Estimated remaining: 4h 9m 8s. Rate: 7.3 symbols/min [2025-10-03T18:16:59.529516] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:16:59.537781] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-03T18:17:01.178054] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:17:01.188267] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-03T18:17:02.511154] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:17:02.519882] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-03T18:17:03.819541] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:17:03.827620] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-03T18:17:04.995425] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:17:04.997531] [INFO ] [REMOTE ] CURB: Full fetch complete (47394 records). [2025-10-03T18:17:04.997636] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-03T18:17:05.458864] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-03T18:17:05.458979] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-03T18:17:05.459661] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-03T18:17:05.459728] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-03T18:17:05.461122] [DEBUG] [LOCAL ] CURB: Trimmed 47394 records to 33201 (keeping 200 days of data) [2025-10-03T18:17:05.754680] [DEBUG] [LOCAL ] CURB: Primary data saved (33201 records). [2025-10-03T18:17:05.754850] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-03T18:17:05.754943] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 25.6s. Estimated remaining: 4h 8m 56s. Rate: 7.3 symbols/min [2025-10-03T18:17:06.669144] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.831250] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.807287] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.831856] [DEBUG] [LOCAL ] CURV: No existing data file found in primary storage. [2025-10-03T18:17:06.833182] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:06.833876] [DEBUG] [LOCAL ] CVE: No existing data file found in primary storage. [2025-10-03T18:17:06.833785] [WARN ] [MAIN ] CURV: No existing data found, performing full refresh instead. [2025-10-03T18:17:06.834061] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-03T18:17:06.834135] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-03T18:17:06.834226] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-03T18:17:06.834342] [WARN ] [MAIN ] CVE: No existing data found, performing full refresh instead. [2025-10-03T18:17:06.834292] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-03T18:17:06.850816] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-03T18:17:06.872583] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-03T18:17:06.916892] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-03T18:17:06.929264] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-03T18:17:07.014459] [DEBUG] [LOCAL ] CVEO: Loaded 15211 existing records from primary storage. [2025-10-03T18:17:07.054763] [INFO ] [MAIN ] CVEO: Loaded 15211 existing records. [2025-10-03T18:17:07.383555] [DEBUG] [LOCAL ] CUZ: Loaded 49712 existing records from primary storage. [2025-10-03T18:17:07.428538] [INFO ] [MAIN ] CUZ: Loaded 49712 existing records. [2025-10-03T18:17:07.876818] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:07.916207] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-03T18:17:07.946605] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-03T18:17:08.081429] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-03T18:17:08.168190] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:08.172601] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-03T18:17:08.192046] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:08.172763] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-03T18:17:08.212251] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:08.203068] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-03T18:17:08.229857] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-03T18:17:08.229573] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-03T18:17:08.256703] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-03T18:17:08.302072] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-03T18:17:09.042431] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:09.048026] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-03T18:17:09.118922] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:09.119306] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-03T18:17:09.921448] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:17:09.930480] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-03T18:17:10.180053] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:17:10.180811] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:17:10.195285] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-03T18:17:10.194745] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-03T18:17:10.852355] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:17:10.862987] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-03T18:17:10.890070] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-03T18:17:10.892422] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-03T18:17:11.049035] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:17:11.055387] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-03T18:17:11.742561] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T18:17:11.745789] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-03T18:17:12.137476] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-03T18:17:12.150151] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-03T18:17:12.167740] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:17:12.173933] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-03T18:17:12.236120] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:17:12.247147] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-03T18:17:12.831052] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:17:12.835197] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-03T18:17:13.308534] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:17:13.409604] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T18:17:13.590625] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-03T18:17:13.634732] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:17:13.779237] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T18:17:14.390704] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-03T18:17:15.190666] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-03T18:17:15.378353] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:17:15.430433] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:17:15.990708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-03T18:17:16.790680] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-03T18:17:17.183350] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T18:17:17.184512] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:17:17.590710] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-03T18:17:18.390733] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-03T18:17:18.488479] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:17:18.653432] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:17:19.174890] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T18:17:19.190610] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-03T18:17:19.990734] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-03T18:17:20.595168] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:17:20.790732] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-03T18:17:21.590704] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-03T18:17:21.886051] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T18:17:22.390727] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-03T18:17:22.650346] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:17:22.938175] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T18:17:23.190708] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-03T18:17:23.598769] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T18:17:23.990723] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-03T18:17:24.628693] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:17:24.790700] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-03T18:17:25.472387] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:17:25.590716] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-03T18:17:25.695829] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-03T18:17:26.390720] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-03T18:17:27.190721] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-03T18:17:27.464152] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:17:27.990667] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-03T18:17:28.062834] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:17:28.601698] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T18:17:28.790719] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-03T18:17:29.590733] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-03T18:17:29.808048] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:17:30.014114] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:17:30.016246] [INFO ] [REMOTE ] CURV: Full fetch complete (38939 records). [2025-10-03T18:17:30.016450] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-03T18:17:30.403246] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-03T18:17:30.435285] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-03T18:17:30.436277] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-03T18:17:30.437016] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-03T18:17:30.437226] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-03T18:17:30.438416] [DEBUG] [LOCAL ] CURV: Trimmed 38939 records to 27147 (keeping 200 days of data) [2025-10-03T18:17:30.599956] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T18:17:30.616366] [DEBUG] [LOCAL ] CURV: Primary data saved (27147 records). [2025-10-03T18:17:30.616503] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-03T18:17:30.616595] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CURV took 24.9s. Estimated remaining: 4h 9m 42s. Rate: 7.2 symbols/min [2025-10-03T18:17:30.796516] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:30.796824] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-03T18:17:30.796883] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-03T18:17:30.797003] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-03T18:17:30.797047] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-03T18:17:30.797119] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-03T18:17:30.797165] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-03T18:17:31.188762] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:31.190633] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-03T18:17:31.990631] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-03T18:17:32.190833] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:17:32.790674] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-03T18:17:32.994185] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:17:33.590737] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-03T18:17:33.939525] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T18:17:34.390684] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-03T18:17:34.477359] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:17:34.478671] [INFO ] [REMOTE ] CVEO: Full fetch complete (20361 records). [2025-10-03T18:17:34.478757] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-03T18:17:34.816349] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T18:17:34.954444] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-03T18:17:34.954523] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-03T18:17:34.954900] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-03T18:17:34.954967] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-03T18:17:34.955609] [DEBUG] [LOCAL ] CVEO: Trimmed 20361 records to 15333 (keeping 200 days of data) [2025-10-03T18:17:35.047272] [DEBUG] [LOCAL ] CVEO: Primary data saved (15333 records). [2025-10-03T18:17:35.047420] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-03T18:17:35.047521] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CVEO took 29.3s. Estimated remaining: 4h 9m 21s. Rate: 7.3 symbols/min [2025-10-03T18:17:35.195836] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-03T18:17:35.248810] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:35.249091] [DEBUG] [LOCAL ] CVLG: No existing data file found in primary storage. [2025-10-03T18:17:35.249147] [WARN ] [MAIN ] CVLG: No existing data found, performing full refresh instead. [2025-10-03T18:17:35.249239] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-03T18:17:35.249281] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-03T18:17:35.249331] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-03T18:17:35.249372] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-03T18:17:35.654762] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:35.990718] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-03T18:17:36.271201] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:17:36.548690] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T18:17:36.790636] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-03T18:17:36.867369] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:17:37.590715] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-03T18:17:38.390728] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-03T18:17:38.463912] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T18:17:38.572059] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:17:39.190712] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-03T18:17:39.867320] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:17:39.870348] [INFO ] [REMOTE ] CUZ: Full fetch complete (70794 records). [2025-10-03T18:17:39.870496] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-03T18:17:39.995737] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-03T18:17:40.004289] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T18:17:40.327482] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-03T18:17:40.327597] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-03T18:17:40.328475] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-03T18:17:40.328540] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-03T18:17:40.330134] [DEBUG] [LOCAL ] CUZ: Trimmed 70794 records to 50071 (keeping 200 days of data) [2025-10-03T18:17:40.659087] [DEBUG] [LOCAL ] CUZ: Primary data saved (50071 records). [2025-10-03T18:17:40.659247] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-03T18:17:40.659363] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CUZ took 34.9s. Estimated remaining: 4h 9m 4s. Rate: 7.3 symbols/min [2025-10-03T18:17:40.793981] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-03T18:17:40.871391] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:40.929436] [DEBUG] [LOCAL ] CVNA: Loaded 53343 existing records from primary storage. [2025-10-03T18:17:40.929861] [INFO ] [MAIN ] CVNA: Loaded 53343 existing records. [2025-10-03T18:17:41.132232] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:41.132517] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-03T18:17:41.132567] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-03T18:17:41.132998] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-03T18:17:41.133061] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-03T18:17:41.549256] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:41.590694] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-03T18:17:41.657674] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T18:17:41.660313] [INFO ] [REMOTE ] CVE: Full fetch complete (77561 records). [2025-10-03T18:17:41.660440] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-03T18:17:41.795311] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:17:42.105700] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-03T18:17:42.105817] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-03T18:17:42.106932] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-03T18:17:42.107003] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-03T18:17:42.109120] [DEBUG] [LOCAL ] CVE: Trimmed 77561 records to 54336 (keeping 200 days of data) [2025-10-03T18:17:42.406998] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-03T18:17:42.468313] [DEBUG] [LOCAL ] CVE: Primary data saved (54336 records). [2025-10-03T18:17:42.468561] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-03T18:17:42.468718] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CVE took 36.7s. Estimated remaining: 4h 8m 35s. Rate: 7.3 symbols/min [2025-10-03T18:17:42.667059] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:42.725621] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-10-03T18:17:42.726142] [INFO ] [MAIN ] CVS: Loaded 54086 existing records. [2025-10-03T18:17:42.910000] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:42.910300] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-03T18:17:42.910351] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-03T18:17:42.910718] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-03T18:17:42.910778] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-03T18:17:43.196617] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-03T18:17:43.280538] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:43.713390] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T18:17:43.990690] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-03T18:17:44.017886] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:17:44.397933] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T18:17:44.790733] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-03T18:17:45.590708] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-03T18:17:45.751740] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:17:46.390733] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-03T18:17:46.485304] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-10-03T18:17:47.190744] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-03T18:17:47.248070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:17:47.509775] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T18:17:47.990696] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-03T18:17:48.790626] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-03T18:17:49.282826] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-03T18:17:49.590743] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-03T18:17:49.785465] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T18:17:50.146911] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-03T18:17:50.390730] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-03T18:17:51.055625] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T18:17:51.190731] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-03T18:17:51.990664] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-03T18:17:52.406242] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:17:52.543008] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T18:17:52.790737] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-03T18:17:53.590741] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-03T18:17:54.390747] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-03T18:17:55.174575] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-10-03T18:17:55.190617] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-03T18:17:55.315525] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:17:55.990686] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-03T18:17:56.601939] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:17:56.779079] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:17:56.780544] [INFO ] [REMOTE ] CVLG: Full fetch complete (21059 records). [2025-10-03T18:17:56.780621] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-03T18:17:56.794971] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-03T18:17:57.204278] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-03T18:17:57.231917] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-03T18:17:57.236011] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-03T18:17:57.236173] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-03T18:17:57.239149] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (4.45 seconds). [2025-10-03T18:17:57.239443] [DEBUG] [LOCAL ] CVLG: Trimmed 21059 records to 15666 (keeping 200 days of data) [2025-10-03T18:17:57.368200] [DEBUG] [LOCAL ] CVLG: Primary data saved (15666 records). [2025-10-03T18:17:57.368363] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-03T18:17:57.368463] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 22.3s. Estimated remaining: 4h 8m 48s. Rate: 7.3 symbols/min [2025-10-03T18:17:57.557533] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:17:57.590722] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-03T18:17:57.635630] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-10-03T18:17:57.636074] [INFO ] [MAIN ] CVX: Loaded 54150 existing records. [2025-10-03T18:17:57.855196] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:17:57.855506] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-03T18:17:57.855566] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-03T18:17:57.856344] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-03T18:17:57.856413] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-03T18:17:58.337310] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:17:58.390746] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-03T18:17:58.581892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:17:58.707345] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (5.12 seconds). [2025-10-03T18:17:59.190741] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-03T18:17:59.771453] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T18:17:59.990718] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-03T18:18:00.734161] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-03T18:18:00.790729] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-03T18:18:01.502952] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-03T18:18:01.590737] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-03T18:18:02.396982] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-03T18:18:02.404441] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-10-03T18:18:03.188080] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-03T18:18:03.198567] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-03T18:18:03.990696] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-03T18:18:04.203255] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-10-03T18:18:04.246375] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:18:04.790745] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-03T18:18:05.052575] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:18:05.590724] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-03T18:18:06.223323] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-03T18:18:06.390692] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-03T18:18:06.537336] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:18:07.190752] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-03T18:18:07.990707] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-03T18:18:08.129047] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-03T18:18:08.694189] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-03T18:18:08.790726] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-03T18:18:08.986567] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:18:09.590730] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-03T18:18:10.225625] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:18:10.390703] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-03T18:18:11.135820] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:18:11.138237] [INFO ] [REMOTE ] CVI: Full fetch complete (67352 records). [2025-10-03T18:18:11.138337] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-03T18:18:11.201688] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-03T18:18:11.336588] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-03T18:18:11.648763] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-10-03T18:18:11.648869] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-10-03T18:18:11.649619] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-10-03T18:18:11.649699] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-10-03T18:18:11.651307] [DEBUG] [LOCAL ] CVI: Trimmed 67352 records to 47178 (keeping 200 days of data) [2025-10-03T18:18:11.957606] [DEBUG] [LOCAL ] CVI: Primary data saved (47178 records). [2025-10-03T18:18:11.957788] [INFO ] [MAIN ] CVI: Full history saved. [2025-10-03T18:18:11.957890] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 41.3s. Estimated remaining: 4h 9m 0s. Rate: 7.2 symbols/min [2025-10-03T18:18:11.994004] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-03T18:18:12.155036] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:12.182271] [DEBUG] [LOCAL ] CW: Loaded 22388 existing records from primary storage. [2025-10-03T18:18:12.182763] [INFO ] [MAIN ] CW: Loaded 22388 existing records. [2025-10-03T18:18:12.398663] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:12.399109] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-03T18:18:12.399201] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-03T18:18:12.399674] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-03T18:18:12.399750] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-03T18:18:12.809056] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:12.810977] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-03T18:18:12.822473] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-03T18:18:13.559417] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T18:18:13.590628] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-03T18:18:14.119944] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:18:14.310178] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-03T18:18:14.390681] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-03T18:18:15.190687] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-03T18:18:15.621494] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:18:15.662589] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T18:18:15.990725] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-03T18:18:16.790740] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-03T18:18:17.301474] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T18:18:17.591898] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-03T18:18:17.600215] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-10-03T18:18:18.390677] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-03T18:18:18.853210] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:18:19.190715] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-03T18:18:19.990751] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-03T18:18:20.075522] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T18:18:20.075837] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:18:20.090389] [INFO ] [REMOTE ] CVNA: Full fetch complete (76656 records). [2025-10-03T18:18:20.091104] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-03T18:18:20.568697] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-03T18:18:20.569278] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T18:18:20.569493] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-03T18:18:20.570711] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-03T18:18:20.576208] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-03T18:18:20.578304] [DEBUG] [LOCAL ] CVNA: Trimmed 76656 records to 53720 (keeping 200 days of data) [2025-10-03T18:18:20.801087] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-03T18:18:20.934506] [DEBUG] [LOCAL ] CVNA: Primary data saved (53720 records). [2025-10-03T18:18:20.934896] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-03T18:18:20.935015] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVNA took 40.3s. Estimated remaining: 4h 8m 54s. Rate: 7.2 symbols/min [2025-10-03T18:18:21.116319] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:21.116513] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-03T18:18:21.116553] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-03T18:18:21.116774] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-03T18:18:21.116817] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-03T18:18:21.116935] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-03T18:18:21.116991] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-03T18:18:21.509998] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:21.590702] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-03T18:18:21.617808] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:18:21.620065] [INFO ] [REMOTE ] CVS: Full fetch complete (77423 records). [2025-10-03T18:18:21.620189] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-03T18:18:21.621092] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:18:21.621190] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:18:21.621235] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:18:21.621306] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-03T18:18:21.621373] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-10-03T18:18:21.621411] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-10-03T18:18:21.621819] [DEBUG] [LOCAL ] CVS: Deleted derivative data file. [2025-10-03T18:18:21.621937] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVS took 39.2s. Estimated remaining: 4h 8m 22s. Rate: 7.3 symbols/min [2025-10-03T18:18:21.811003] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:21.867130] [DEBUG] [LOCAL ] CWEN: Loaded 45415 existing records from primary storage. [2025-10-03T18:18:21.867464] [INFO ] [MAIN ] CWEN: Loaded 45415 existing records. [2025-10-03T18:18:22.059846] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:22.060167] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-03T18:18:22.060325] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-03T18:18:22.066524] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-03T18:18:22.074579] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-03T18:18:22.081173] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T18:18:22.395784] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-03T18:18:22.513262] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:23.190715] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-03T18:18:23.916902] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-03T18:18:23.987026] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:18:23.997673] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-03T18:18:24.520150] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:18:24.790725] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-03T18:18:25.590731] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-03T18:18:26.298446] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T18:18:26.390706] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-03T18:18:26.480159] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:18:26.701003] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:18:27.190752] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-03T18:18:27.990778] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-03T18:18:28.552088] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T18:18:28.783338] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:18:28.797191] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-03T18:18:29.250088] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:18:29.590727] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-03T18:18:30.390781] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-03T18:18:31.176111] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:18:31.185915] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.39 seconds). [2025-10-03T18:18:31.190368] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-03T18:18:31.190617] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-03T18:18:31.190557] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-03T18:18:31.678545] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-03T18:18:31.678724] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-03T18:18:31.679846] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-03T18:18:31.679923] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-03T18:18:31.682506] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54540 (keeping 200 days of data) [2025-10-03T18:18:31.995050] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-03T18:18:32.150020] [DEBUG] [LOCAL ] CVX: Primary data saved (54540 records). [2025-10-03T18:18:32.151117] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-03T18:18:32.152169] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T18:18:32.153848] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CVX took 34.8s. Estimated remaining: 4h 8m 21s. Rate: 7.3 symbols/min [2025-10-03T18:18:32.358878] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:32.423622] [DEBUG] [LOCAL ] CWH: Loaded 51715 existing records from primary storage. [2025-10-03T18:18:32.424079] [INFO ] [MAIN ] CWH: Loaded 51715 existing records. [2025-10-03T18:18:32.602222] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:32.602520] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-03T18:18:32.602574] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-03T18:18:32.604333] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-03T18:18:32.604396] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-03T18:18:32.809541] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-03T18:18:32.999131] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:33.035098] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:18:33.150614] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T18:18:33.590755] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-03T18:18:34.390746] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-03T18:18:34.594693] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:18:35.190625] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-03T18:18:35.367166] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T18:18:35.990688] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-03T18:18:36.152599] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:18:36.769529] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:18:36.790620] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-03T18:18:37.365299] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:18:37.590713] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-03T18:18:38.390729] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-03T18:18:38.531806] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:18:38.863287] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-03T18:18:39.190719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-03T18:18:39.962936] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:18:39.990624] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-03T18:18:40.428970] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:18:40.790720] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-03T18:18:41.591244] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-03T18:18:41.594470] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:18:41.950232] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:18:42.390668] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-03T18:18:43.197590] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-03T18:18:43.205880] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:18:43.990758] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-03T18:18:44.080973] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:18:44.790663] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-03T18:18:44.980052] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:18:45.360196] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:18:45.590724] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-03T18:18:45.691433] [DEBUG] [REMOTE ] CWEN: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-03T18:18:45.691886] [WARN ] [REMOTE ] CWEN: No data returned for month 2025-09 [2025-10-03T18:18:45.692001] [FATAL] [REMOTE ] CWEN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:18:45.692112] [FATAL] [MAIN ] CWEN: Failed to fetch primary data. [2025-10-03T18:18:45.692191] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:18:45.692337] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-03T18:18:45.692473] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-03T18:18:45.692551] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-10-03T18:18:45.692875] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-10-03T18:18:45.693055] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CWEN took 24.1s. Estimated remaining: 4h 8m 29s. Rate: 7.2 symbols/min [2025-10-03T18:18:45.887189] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:45.946170] [DEBUG] [LOCAL ] CWK: Loaded 49782 existing records from primary storage. [2025-10-03T18:18:45.946551] [INFO ] [MAIN ] CWK: Loaded 49782 existing records. [2025-10-03T18:18:46.066712] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:18:46.079544] [INFO ] [REMOTE ] CW: Full fetch complete (33202 records). [2025-10-03T18:18:46.090102] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-03T18:18:46.123505] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:18:46.155287] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:46.155593] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:18:46.155930] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-03T18:18:46.156020] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-03T18:18:46.156106] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:18:46.156257] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-03T18:18:46.156341] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-10-03T18:18:46.156381] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-10-03T18:18:46.156561] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-10-03T18:18:46.156744] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CW took 34.2s. Estimated remaining: 4h 7m 56s. Rate: 7.3 symbols/min [2025-10-03T18:18:46.162176] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-03T18:18:46.195781] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-03T18:18:46.399677] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-03T18:18:46.573923] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:18:46.807521] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:46.823874] [DEBUG] [LOCAL ] CWT: Loaded 28121 existing records from primary storage. [2025-10-03T18:18:46.824251] [INFO ] [MAIN ] CWT: Loaded 28121 existing records. [2025-10-03T18:18:47.015973] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:18:47.016185] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-03T18:18:47.016234] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-03T18:18:47.016479] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-03T18:18:47.016540] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-03T18:18:47.195526] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-03T18:18:47.399704] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:18:47.990674] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-03T18:18:48.380932] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:18:48.790727] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-03T18:18:48.916382] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:18:49.590680] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-03T18:18:49.810744] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:18:50.390635] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-03T18:18:50.492925] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:18:51.116692] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:18:51.190738] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-03T18:18:51.760058] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:18:51.990697] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-03T18:18:52.790680] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-03T18:18:52.831290] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:18:53.579503] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:18:53.590619] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-03T18:18:54.075380] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:18:54.390736] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-03T18:18:55.190511] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:18:55.190788] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-03T18:18:55.990627] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-03T18:18:56.284387] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:18:56.423873] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T18:18:56.790691] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-03T18:18:57.563035] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:18:57.590693] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-03T18:18:58.390724] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-03T18:18:58.575483] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:18:59.190627] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-03T18:18:59.356087] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:18:59.990717] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-03T18:19:00.212476] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:19:00.790692] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-03T18:19:00.917671] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:19:00.921892] [INFO ] [REMOTE ] CWAN: Full fetch complete (75154 records). [2025-10-03T18:19:00.922027] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-03T18:19:01.345944] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-03T18:19:01.346053] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-03T18:19:01.347143] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-03T18:19:01.347217] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-03T18:19:01.348946] [DEBUG] [LOCAL ] CWAN: Trimmed 75154 records to 53184 (keeping 200 days of data) [2025-10-03T18:19:01.590869] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-03T18:19:01.687052] [DEBUG] [LOCAL ] CWAN: Primary data saved (53184 records). [2025-10-03T18:19:01.687198] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-03T18:19:01.687295] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 40.8s. Estimated remaining: 4h 8m 11s. Rate: 7.2 symbols/min [2025-10-03T18:19:01.918034] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:01.923293] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:19:01.998179] [DEBUG] [LOCAL ] CX: Loaded 53213 existing records from primary storage. [2025-10-03T18:19:01.998782] [INFO ] [MAIN ] CX: Loaded 53213 existing records. [2025-10-03T18:19:02.225849] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:02.226152] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-03T18:19:02.226281] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-03T18:19:02.226872] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-03T18:19:02.226933] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-03T18:19:02.410797] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-03T18:19:02.618438] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:03.049613] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T18:19:03.190693] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-03T18:19:03.332931] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:19:03.992157] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-03T18:19:03.994976] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:19:04.621091] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:19:04.623994] [INFO ] [REMOTE ] CWH: Full fetch complete (72989 records). [2025-10-03T18:19:04.624190] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-03T18:19:04.797992] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-03T18:19:05.062493] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-03T18:19:05.062614] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-03T18:19:05.063922] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-03T18:19:05.064010] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-03T18:19:05.065862] [DEBUG] [LOCAL ] CWH: Trimmed 72989 records to 52068 (keeping 200 days of data) [2025-10-03T18:19:05.223698] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:19:05.431592] [DEBUG] [LOCAL ] CWH: Primary data saved (52068 records). [2025-10-03T18:19:05.431779] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-03T18:19:05.432452] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 33.3s. Estimated remaining: 4h 7m 48s. Rate: 7.3 symbols/min [2025-10-03T18:19:05.591246] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-03T18:19:05.614671] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:05.626415] [DEBUG] [LOCAL ] CXE: Loaded 6615 existing records from primary storage. [2025-10-03T18:19:05.626872] [INFO ] [MAIN ] CXE: Loaded 6615 existing records. [2025-10-03T18:19:05.822030] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:05.822291] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-03T18:19:05.822348] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-03T18:19:05.822549] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-03T18:19:05.822621] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-03T18:19:06.203543] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:06.390702] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-03T18:19:06.687503] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:19:07.190671] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-03T18:19:07.300715] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:19:07.337947] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:19:07.990699] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-03T18:19:08.788190] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:19:08.798727] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-03T18:19:08.831820] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:19:09.590706] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-03T18:19:09.998748] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T18:19:10.390714] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-03T18:19:11.190769] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-03T18:19:11.325022] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:19:11.990704] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-03T18:19:12.125923] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:19:12.586930] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:19:12.790746] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-03T18:19:13.527391] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:19:13.590697] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-03T18:19:13.744993] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-03T18:19:14.390704] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-03T18:19:15.190738] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-03T18:19:15.275549] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T18:19:15.969034] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:19:15.990633] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-03T18:19:16.067057] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:19:16.790639] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-03T18:19:16.999388] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:19:17.546089] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:19:17.590695] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-03T18:19:18.390684] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-03T18:19:19.073607] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:19:19.076222] [INFO ] [REMOTE ] CWK: Full fetch complete (71028 records). [2025-10-03T18:19:19.076369] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-03T18:19:19.135691] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T18:19:19.195741] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-03T18:19:19.567360] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-03T18:19:19.567469] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-03T18:19:19.568453] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-03T18:19:19.568526] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-03T18:19:19.573186] [DEBUG] [LOCAL ] CWK: Trimmed 71028 records to 50148 (keeping 200 days of data) [2025-10-03T18:19:19.892926] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T18:19:19.903823] [DEBUG] [LOCAL ] CWK: Primary data saved (50148 records). [2025-10-03T18:19:19.904348] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-03T18:19:19.904497] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 34.2s. Estimated remaining: 4h 7m 59s. Rate: 7.2 symbols/min [2025-10-03T18:19:19.996027] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-03T18:19:20.096532] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:20.103998] [DEBUG] [LOCAL ] CXH: Loaded 4422 existing records from primary storage. [2025-10-03T18:19:20.104226] [INFO ] [MAIN ] CXH: Loaded 4422 existing records. [2025-10-03T18:19:20.297892] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:20.298183] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-03T18:19:20.298247] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-03T18:19:20.298414] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-03T18:19:20.298474] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-03T18:19:20.719489] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:20.790764] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-03T18:19:21.226024] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:19:21.273165] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T18:19:21.590687] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-03T18:19:22.045717] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T18:19:22.390752] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-03T18:19:23.190746] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-03T18:19:23.353397] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T18:19:23.355215] [INFO ] [REMOTE ] CWT: Full fetch complete (40371 records). [2025-10-03T18:19:23.355324] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-03T18:19:23.357023] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:19:23.357116] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:19:23.357160] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:19:23.357225] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-03T18:19:23.357318] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-10-03T18:19:23.357374] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-10-03T18:19:23.357684] [DEBUG] [LOCAL ] CWT: Deleted derivative data file. [2025-10-03T18:19:23.357817] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CWT took 37.2s. Estimated remaining: 4h 7m 36s. Rate: 7.2 symbols/min [2025-10-03T18:19:23.530847] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:23.580574] [DEBUG] [LOCAL ] CXM: Loaded 47964 existing records from primary storage. [2025-10-03T18:19:23.581022] [INFO ] [MAIN ] CXM: Loaded 47964 existing records. [2025-10-03T18:19:23.682559] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:19:23.808172] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:23.808537] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-03T18:19:23.808634] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-03T18:19:23.808978] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-03T18:19:23.809038] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-03T18:19:23.990770] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-03T18:19:24.224807] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:24.748448] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:19:24.790708] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-03T18:19:25.590716] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-03T18:19:26.390696] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-03T18:19:26.790026] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:19:27.000853] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T18:19:27.190632] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-03T18:19:27.309930] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:19:27.990727] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-03T18:19:28.790692] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-03T18:19:28.873513] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:19:28.926540] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T18:19:29.590710] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-03T18:19:30.018141] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T18:19:30.390749] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-03T18:19:30.623318] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:19:31.190729] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-03T18:19:31.777541] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:19:31.990710] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-03T18:19:32.214324] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:19:32.790730] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-03T18:19:33.509233] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T18:19:33.590633] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-03T18:19:34.344494] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-03T18:19:34.390672] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-03T18:19:34.641226] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:19:34.957884] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:19:35.190729] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-03T18:19:35.841746] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:19:35.843154] [INFO ] [REMOTE ] CXE: Full fetch complete (11766 records). [2025-10-03T18:19:35.843250] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-03T18:19:36.001049] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-03T18:19:36.236090] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-03T18:19:36.236176] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-03T18:19:36.236439] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-03T18:19:36.236481] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-03T18:19:36.237069] [DEBUG] [LOCAL ] CXE: Trimmed 11766 records to 6646 (keeping 200 days of data) [2025-10-03T18:19:36.276291] [DEBUG] [LOCAL ] CXE: Primary data saved (6646 records). [2025-10-03T18:19:36.276421] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-03T18:19:36.276519] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CXE took 30.8s. Estimated remaining: 4h 7m 42s. Rate: 7.2 symbols/min [2025-10-03T18:19:36.517361] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:36.517885] [DEBUG] [LOCAL ] CXT: No existing data file found in primary storage. [2025-10-03T18:19:36.517998] [WARN ] [MAIN ] CXT: No existing data found, performing full refresh instead. [2025-10-03T18:19:36.518162] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-03T18:19:36.518220] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-03T18:19:36.518271] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-03T18:19:36.518305] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-03T18:19:36.795235] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-03T18:19:36.886044] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:19:36.927072] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:37.590761] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-03T18:19:38.394045] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-03T18:19:38.400448] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:19:38.931483] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:19:39.190715] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-03T18:19:39.990702] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-03T18:19:40.431687] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T18:19:40.784568] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:19:40.790612] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-03T18:19:40.827662] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:19:41.374252] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T18:19:41.590681] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-03T18:19:42.386053] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T18:19:42.386832] [INFO ] [REMOTE ] CXH: Full fetch complete (5454 records). [2025-10-03T18:19:42.386906] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-03T18:19:42.398584] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-03T18:19:42.816956] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-03T18:19:42.817047] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-03T18:19:42.817214] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-03T18:19:42.817253] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-03T18:19:42.817685] [DEBUG] [LOCAL ] CXH: Trimmed 5454 records to 4450 (keeping 200 days of data) [2025-10-03T18:19:42.843340] [DEBUG] [LOCAL ] CXH: Primary data saved (4450 records). [2025-10-03T18:19:42.843464] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-03T18:19:42.843560] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXH took 22.9s. Estimated remaining: 4h 7m 28s. Rate: 7.2 symbols/min [2025-10-03T18:19:43.046243] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:43.087899] [DEBUG] [LOCAL ] CXW: Loaded 44355 existing records from primary storage. [2025-10-03T18:19:43.088236] [INFO ] [MAIN ] CXW: Loaded 44355 existing records. [2025-10-03T18:19:43.199633] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-03T18:19:43.288032] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:43.288261] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-03T18:19:43.288329] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-03T18:19:43.288709] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-03T18:19:43.288811] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-03T18:19:43.688383] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:43.990713] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-03T18:19:44.067899] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T18:19:44.790684] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-03T18:19:45.006843] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:19:45.071849] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:19:45.590720] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-03T18:19:46.390692] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-03T18:19:46.464405] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:19:47.190699] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-03T18:19:47.318013] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:19:47.738957] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:19:47.742081] [INFO ] [REMOTE ] CX: Full fetch complete (76385 records). [2025-10-03T18:19:47.742232] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-03T18:19:47.995896] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-03T18:19:48.174878] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-03T18:19:48.174969] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-03T18:19:48.175912] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-03T18:19:48.175989] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-03T18:19:48.177706] [DEBUG] [LOCAL ] CX: Trimmed 76385 records to 53593 (keeping 200 days of data) [2025-10-03T18:19:48.527591] [DEBUG] [LOCAL ] CX: Primary data saved (53593 records). [2025-10-03T18:19:48.527811] [INFO ] [MAIN ] CX: Full history saved. [2025-10-03T18:19:48.528064] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CX took 46.8s. Estimated remaining: 4h 7m 12s. Rate: 7.2 symbols/min [2025-10-03T18:19:48.668441] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:19:48.744288] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:48.775406] [DEBUG] [LOCAL ] CYD: Loaded 26748 existing records from primary storage. [2025-10-03T18:19:48.775734] [INFO ] [MAIN ] CYD: Loaded 26748 existing records. [2025-10-03T18:19:48.797785] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-03T18:19:48.968342] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:19:48.968559] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-03T18:19:48.968639] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-03T18:19:48.968980] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-03T18:19:48.969041] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-03T18:19:49.367729] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:19:49.590704] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-03T18:19:49.701149] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:19:50.390997] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-03T18:19:50.499985] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:19:51.134852] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:19:51.194513] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:19:51.193724] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-03T18:19:51.990728] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-03T18:19:52.456889] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:19:52.746442] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:19:52.790678] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-03T18:19:53.590690] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-03T18:19:54.013770] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-03T18:19:54.390768] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-03T18:19:54.604312] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T18:19:55.190684] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-03T18:19:55.990703] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-03T18:19:56.218563] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:19:56.686445] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:19:56.790742] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-03T18:19:57.545765] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:19:57.590624] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-03T18:19:58.126766] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:19:58.390744] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-03T18:19:58.998890] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:19:59.001609] [INFO ] [REMOTE ] CXM: Full fetch complete (68729 records). [2025-10-03T18:19:59.001762] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-03T18:19:59.196215] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-03T18:19:59.443883] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-03T18:19:59.443977] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-03T18:19:59.444791] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-03T18:19:59.444857] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-03T18:19:59.446353] [DEBUG] [LOCAL ] CXM: Trimmed 68729 records to 48291 (keeping 200 days of data) [2025-10-03T18:19:59.761240] [DEBUG] [LOCAL ] CXM: Primary data saved (48291 records). [2025-10-03T18:19:59.761371] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-03T18:19:59.763222] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXM took 36.4s. Estimated remaining: 4h 7m 13s. Rate: 7.2 symbols/min [2025-10-03T18:19:59.895490] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:19:59.974422] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:19:59.999982] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-03T18:20:00.022441] [DEBUG] [LOCAL ] CYH: Loaded 47856 existing records from primary storage. [2025-10-03T18:20:00.022831] [INFO ] [MAIN ] CYH: Loaded 47856 existing records. [2025-10-03T18:20:00.233440] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:00.233683] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-03T18:20:00.233744] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-03T18:20:00.234007] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-03T18:20:00.234098] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-03T18:20:00.638017] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:00.790723] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-03T18:20:01.335332] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T18:20:01.590906] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-03T18:20:01.765810] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:20:02.390710] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-03T18:20:02.504160] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:20:03.190699] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-03T18:20:03.745481] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-03T18:20:03.990672] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-03T18:20:04.100554] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T18:20:04.238805] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:20:04.790716] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-03T18:20:05.590699] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-03T18:20:05.639573] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:20:05.742261] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T18:20:06.390710] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-03T18:20:06.650552] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T18:20:07.190702] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-03T18:20:07.561676] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:20:07.564739] [INFO ] [REMOTE ] CXT: Full fetch complete (45537 records). [2025-10-03T18:20:07.564928] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-03T18:20:07.983220] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-03T18:20:07.983301] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-03T18:20:07.983976] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-03T18:20:07.984043] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-03T18:20:07.985186] [DEBUG] [LOCAL ] CXT: Trimmed 45537 records to 31460 (keeping 200 days of data) [2025-10-03T18:20:08.043193] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-03T18:20:08.197698] [DEBUG] [LOCAL ] CXT: Primary data saved (31460 records). [2025-10-03T18:20:08.197896] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-03T18:20:08.198011] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CXT took 31.9s. Estimated remaining: 4h 7m 5s. Rate: 7.2 symbols/min [2025-10-03T18:20:08.394432] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:08.394796] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-03T18:20:08.394854] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-03T18:20:08.394969] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-03T18:20:08.395013] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-03T18:20:08.395056] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-03T18:20:08.395095] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-03T18:20:08.815535] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:20:08.812492] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-03T18:20:08.849486] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:09.590627] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-03T18:20:09.686549] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:20:10.390637] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-03T18:20:10.504511] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:20:11.190633] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-03T18:20:11.608126] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:20:11.662229] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T18:20:11.990704] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-03T18:20:12.790678] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-03T18:20:13.034253] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T18:20:13.590724] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-03T18:20:14.390713] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-03T18:20:14.906552] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T18:20:14.959320] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:20:15.190722] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-03T18:20:15.563468] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (3.57 seconds). [2025-10-03T18:20:15.782016] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:20:15.990743] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-03T18:20:16.675569] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:20:16.790703] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-03T18:20:17.590704] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-03T18:20:17.660581] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T18:20:18.243990] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:20:18.390727] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-03T18:20:18.965742] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:20:18.967696] [INFO ] [REMOTE ] CYD: Full fetch complete (33515 records). [2025-10-03T18:20:18.967807] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-03T18:20:19.195806] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-03T18:20:19.387344] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-03T18:20:19.387438] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-03T18:20:19.387952] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-03T18:20:19.388020] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-03T18:20:19.389278] [DEBUG] [LOCAL ] CYD: Trimmed 33515 records to 26957 (keeping 200 days of data) [2025-10-03T18:20:19.563960] [DEBUG] [LOCAL ] CYD: Primary data saved (26957 records). [2025-10-03T18:20:19.564097] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-03T18:20:19.564181] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CYD took 31.0s. Estimated remaining: 4h 7m 6s. Rate: 7.2 symbols/min [2025-10-03T18:20:19.767926] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:19.768868] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:20:19.770736] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-10-03T18:20:19.771345] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-10-03T18:20:19.771545] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-03T18:20:19.771631] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-03T18:20:19.771764] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-03T18:20:19.771848] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-03T18:20:19.777422] [INFO ] [REMOTE ] CXW: Full fetch complete (64887 records). [2025-10-03T18:20:19.777538] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-03T18:20:19.995196] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-03T18:20:20.670273] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-03T18:20:20.669875] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:20.670857] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-03T18:20:20.671668] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-03T18:20:20.671740] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-03T18:20:20.673069] [DEBUG] [LOCAL ] CXW: Trimmed 64887 records to 44678 (keeping 200 days of data) [2025-10-03T18:20:20.790769] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-03T18:20:20.934112] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:20:21.014411] [DEBUG] [LOCAL ] CXW: Primary data saved (44678 records). [2025-10-03T18:20:21.014565] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-03T18:20:21.014689] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CXW took 38.2s. Estimated remaining: 4h 6m 37s. Rate: 7.3 symbols/min [2025-10-03T18:20:21.217519] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:21.272362] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-10-03T18:20:21.272755] [INFO ] [MAIN ] DAL: Loaded 54143 existing records. [2025-10-03T18:20:21.468304] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:21.468520] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-03T18:20:21.468573] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-03T18:20:21.468879] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-03T18:20:21.468937] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-03T18:20:21.595894] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-03T18:20:21.887972] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:21.924974] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:20:22.020254] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:20:22.390734] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-03T18:20:23.190729] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-03T18:20:23.495791] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-03T18:20:23.990666] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-03T18:20:24.300821] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:20:24.790669] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-03T18:20:24.972341] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:20:25.195073] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:20:25.590727] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-03T18:20:26.390703] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-03T18:20:26.545842] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T18:20:26.644612] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:20:27.190733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-03T18:20:27.990736] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-03T18:20:28.605907] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:20:28.790621] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-03T18:20:28.816381] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T18:20:28.918183] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:20:29.590721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-03T18:20:30.390731] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-03T18:20:30.692935] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T18:20:31.190733] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-03T18:20:31.440769] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T18:20:31.990733] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-03T18:20:32.206375] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:20:32.341684] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T18:20:32.790732] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-03T18:20:33.590634] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-03T18:20:33.989429] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T18:20:34.346036] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:20:34.390675] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-03T18:20:35.190860] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-03T18:20:35.905336] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-10-03T18:20:35.990733] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-03T18:20:36.165137] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:20:36.790724] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-03T18:20:37.183878] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:20:37.343064] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:20:37.590724] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-03T18:20:38.069067] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:20:38.390742] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-03T18:20:39.161292] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T18:20:39.190746] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-03T18:20:39.943517] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:20:39.990768] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-03T18:20:40.075211] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T18:20:40.078052] [INFO ] [REMOTE ] D: Full fetch complete (77656 records). [2025-10-03T18:20:40.078236] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-03T18:20:40.524507] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-03T18:20:40.524602] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-03T18:20:40.525597] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-03T18:20:40.525744] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-03T18:20:40.527750] [DEBUG] [LOCAL ] D: Trimmed 77656 records to 54424 (keeping 200 days of data) [2025-10-03T18:20:40.792160] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-03T18:20:40.902679] [DEBUG] [LOCAL ] D: Primary data saved (54424 records). [2025-10-03T18:20:40.902868] [INFO ] [MAIN ] D: Full history saved. [2025-10-03T18:20:40.903009] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. D took 32.7s. Estimated remaining: 4h 7m 4s. Rate: 7.2 symbols/min [2025-10-03T18:20:41.097292] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:41.097554] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-10-03T18:20:41.097611] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-10-03T18:20:41.097841] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-03T18:20:41.097928] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-03T18:20:41.098027] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-03T18:20:41.098078] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-03T18:20:41.503023] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:41.590738] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-03T18:20:42.246567] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T18:20:42.390721] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-03T18:20:42.539944] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:20:43.190725] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-03T18:20:43.686831] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-03T18:20:43.990710] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-03T18:20:44.426350] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T18:20:44.534514] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T18:20:44.537972] [INFO ] [REMOTE ] CYH: Full fetch complete (69941 records). [2025-10-03T18:20:44.538206] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-03T18:20:44.804121] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-03T18:20:45.028268] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T18:20:45.079023] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-03T18:20:45.079502] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-03T18:20:45.080484] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-03T18:20:45.080558] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-03T18:20:45.082224] [DEBUG] [LOCAL ] CYH: Trimmed 69941 records to 48183 (keeping 200 days of data) [2025-10-03T18:20:45.374253] [DEBUG] [LOCAL ] CYH: Primary data saved (48183 records). [2025-10-03T18:20:45.374406] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-03T18:20:45.374498] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. CYH took 45.6s. Estimated remaining: 4h 6m 44s. Rate: 7.2 symbols/min [2025-10-03T18:20:45.556235] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:45.556407] [DEBUG] [LOCAL ] DAO: No existing data file found in primary storage. [2025-10-03T18:20:45.556446] [WARN ] [MAIN ] DAO: No existing data found, performing full refresh instead. [2025-10-03T18:20:45.556582] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-03T18:20:45.556626] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-03T18:20:45.556753] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-03T18:20:45.556805] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-03T18:20:45.595959] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-03T18:20:45.958762] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:46.390725] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-03T18:20:46.549036] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:20:47.190633] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-03T18:20:47.519750] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-10-03T18:20:47.567246] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T18:20:47.667915] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T18:20:47.990727] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-03T18:20:48.783528] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:20:48.790608] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-03T18:20:49.590737] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-03T18:20:50.031287] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:20:50.273463] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T18:20:50.274524] [INFO ] [REMOTE ] DAC: Full fetch complete (19392 records). [2025-10-03T18:20:50.274597] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-03T18:20:50.394555] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-03T18:20:50.686064] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-03T18:20:50.686146] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-03T18:20:50.686548] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-03T18:20:50.686591] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-03T18:20:50.687243] [DEBUG] [LOCAL ] DAC: Trimmed 19392 records to 12664 (keeping 200 days of data) [2025-10-03T18:20:50.781082] [DEBUG] [LOCAL ] DAC: Primary data saved (12664 records). [2025-10-03T18:20:50.781265] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-03T18:20:50.781370] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. DAC took 31.2s. Estimated remaining: 4h 6m 27s. Rate: 7.2 symbols/min [2025-10-03T18:20:50.992698] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:20:51.062963] [DEBUG] [LOCAL ] DAR: Loaded 52218 existing records from primary storage. [2025-10-03T18:20:51.063347] [INFO ] [MAIN ] DAR: Loaded 52218 existing records. [2025-10-03T18:20:51.195822] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-03T18:20:51.285289] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:20:51.285504] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-03T18:20:51.285552] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-03T18:20:51.285958] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-03T18:20:51.286019] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-03T18:20:51.731998] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:20:51.897357] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:20:51.990685] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-03T18:20:52.790731] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-03T18:20:53.320011] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T18:20:53.463947] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-03T18:20:53.590730] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-03T18:20:54.390709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-03T18:20:54.547204] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:20:55.190729] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-03T18:20:55.353407] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:20:55.990780] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-03T18:20:56.489160] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-03T18:20:56.795796] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-03T18:20:56.811507] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:20:57.081129] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T18:20:57.590699] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-03T18:20:58.390630] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-03T18:20:58.424168] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:20:58.625380] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T18:20:59.190707] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-03T18:20:59.990699] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-03T18:21:00.482766] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-03T18:21:00.485967] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-03T18:21:00.486193] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-03T18:21:00.800977] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-03T18:21:00.970001] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-03T18:21:00.970299] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-03T18:21:00.971585] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-03T18:21:00.971686] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-03T18:21:00.973336] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54533 (keeping 200 days of data) [2025-10-03T18:21:01.358500] [DEBUG] [LOCAL ] DAL: Primary data saved (54533 records). [2025-10-03T18:21:01.358750] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-03T18:21:01.358914] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAL took 40.3s. Estimated remaining: 4h 6m 26s. Rate: 7.2 symbols/min [2025-10-03T18:21:01.572631] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:01.618100] [DEBUG] [LOCAL ] DAVA: Loaded 41312 existing records from primary storage. [2025-10-03T18:21:01.618427] [INFO ] [MAIN ] DAVA: Loaded 41312 existing records. [2025-10-03T18:21:01.834897] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:01.835474] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-03T18:21:01.835597] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-03T18:21:01.836041] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-03T18:21:01.836161] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-03T18:21:02.037147] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-10-03T18:21:02.153442] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-03T18:21:02.345439] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-03T18:21:02.383175] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:02.393733] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-03T18:21:02.978999] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:21:03.190748] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-03T18:21:03.956183] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:21:03.990633] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-03T18:21:04.417406] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:21:04.790717] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-03T18:21:05.129460] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:21:05.590728] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-03T18:21:05.791106] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:21:06.036523] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:21:06.390727] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-03T18:21:07.190705] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-03T18:21:07.389831] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:21:07.963676] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T18:21:07.990631] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-03T18:21:08.148731] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T18:21:08.790707] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-03T18:21:09.590743] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-03T18:21:09.766715] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:21:10.105768] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T18:21:10.390708] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-03T18:21:10.778843] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:21:11.190696] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-03T18:21:11.625811] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T18:21:11.990707] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-03T18:21:12.266408] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T18:21:12.790717] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-03T18:21:13.579809] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:21:13.590722] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-03T18:21:14.330806] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:21:14.333338] [INFO ] [REMOTE ] DAO: Full fetch complete (32741 records). [2025-10-03T18:21:14.333497] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-03T18:21:14.399336] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-03T18:21:14.725073] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:21:14.852780] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-03T18:21:14.852872] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-03T18:21:14.853456] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-03T18:21:14.853526] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-03T18:21:14.854580] [DEBUG] [LOCAL ] DAO: Trimmed 32741 records to 20992 (keeping 200 days of data) [2025-10-03T18:21:14.982086] [DEBUG] [LOCAL ] DAO: Primary data saved (20992 records). [2025-10-03T18:21:14.982247] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-03T18:21:14.982350] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. DAO took 29.6s. Estimated remaining: 4h 6m 34s. Rate: 7.2 symbols/min [2025-10-03T18:21:15.165455] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:15.195799] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-03T18:21:15.221692] [DEBUG] [LOCAL ] DAY: Loaded 49792 existing records from primary storage. [2025-10-03T18:21:15.222114] [INFO ] [MAIN ] DAY: Loaded 49792 existing records. [2025-10-03T18:21:15.438535] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:15.438827] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-03T18:21:15.438880] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-03T18:21:15.439229] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-03T18:21:15.439289] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-03T18:21:15.870009] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:15.990668] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-03T18:21:16.095297] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:21:16.790662] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-03T18:21:17.043164] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:21:17.590719] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-03T18:21:17.934783] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:21:18.390701] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-03T18:21:18.486180] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:21:18.981282] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:21:18.983255] [INFO ] [REMOTE ] DAN: Full fetch complete (70484 records). [2025-10-03T18:21:18.983367] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-03T18:21:18.984142] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:18.984244] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:18.984309] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:18.984382] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-03T18:21:18.984449] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-03T18:21:18.984486] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-03T18:21:18.984561] [DEBUG] [LOCAL ] DAN: No derivative data file found to delete. [2025-10-03T18:21:18.984669] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAN took 38.1s. Estimated remaining: 4h 6m 13s. Rate: 7.2 symbols/min [2025-10-03T18:21:19.173255] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:19.173465] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-10-03T18:21:19.173522] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-10-03T18:21:19.173664] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-03T18:21:19.173723] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-03T18:21:19.173812] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-03T18:21:19.173863] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-03T18:21:19.196618] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-03T18:21:19.573835] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:19.805401] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:21:19.990719] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-03T18:21:20.790737] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-03T18:21:20.925602] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:21:21.590726] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-03T18:21:21.728375] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:21:22.257833] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:21:22.390716] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-03T18:21:22.880573] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:21:23.190710] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-03T18:21:23.897231] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:21:23.990916] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-03T18:21:24.749553] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:21:24.790721] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-03T18:21:25.295106] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:21:25.590704] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-03T18:21:26.390681] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-03T18:21:26.501375] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:21:27.017970] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:21:27.020695] [INFO ] [REMOTE ] DAR: Full fetch complete (74633 records). [2025-10-03T18:21:27.020831] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-03T18:21:27.192636] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-03T18:21:27.463449] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-03T18:21:27.463542] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-03T18:21:27.464405] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-03T18:21:27.464474] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-03T18:21:27.466042] [DEBUG] [LOCAL ] DAR: Trimmed 74633 records to 52592 (keeping 200 days of data) [2025-10-03T18:21:27.808803] [DEBUG] [LOCAL ] DAR: Primary data saved (52592 records). [2025-10-03T18:21:27.808971] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-03T18:21:27.809134] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAR took 37.0s. Estimated remaining: 4h 6m 6s. Rate: 7.2 symbols/min [2025-10-03T18:21:27.995989] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:27.994323] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-03T18:21:27.996195] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-03T18:21:27.996271] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-03T18:21:27.997264] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-03T18:21:27.997309] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-03T18:21:27.997353] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-03T18:21:27.997413] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-03T18:21:28.426107] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:28.462215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-03T18:21:28.539265] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:21:28.790727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-03T18:21:29.590715] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-03T18:21:29.683199] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:21:29.723067] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T18:21:30.390685] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-03T18:21:31.017197] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:21:31.190727] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-03T18:21:31.515947] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:21:31.990720] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-03T18:21:32.190630] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T18:21:32.790743] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-03T18:21:33.590700] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-03T18:21:33.956256] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:21:34.390634] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-03T18:21:34.678559] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:21:34.884792] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-03T18:21:35.190749] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-03T18:21:35.990679] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-03T18:21:36.100974] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:21:36.758826] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:21:36.761492] [INFO ] [REMOTE ] DAVA: Full fetch complete (56072 records). [2025-10-03T18:21:36.761609] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-03T18:21:36.795773] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-03T18:21:37.196150] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-03T18:21:37.196242] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-03T18:21:37.196936] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-03T18:21:37.197003] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-03T18:21:37.198206] [DEBUG] [LOCAL ] DAVA: Trimmed 56072 records to 41673 (keeping 200 days of data) [2025-10-03T18:21:37.445901] [DEBUG] [LOCAL ] DAVA: Primary data saved (41673 records). [2025-10-03T18:21:37.446036] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-03T18:21:37.446134] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAVA took 36.1s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-03T18:21:37.602237] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-03T18:21:37.636931] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:37.680493] [DEBUG] [LOCAL ] DBI: Loaded 44841 existing records from primary storage. [2025-10-03T18:21:37.680851] [INFO ] [MAIN ] DBI: Loaded 44841 existing records. [2025-10-03T18:21:37.883708] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:37.884460] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-03T18:21:37.884608] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-03T18:21:37.885361] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-03T18:21:37.885521] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-03T18:21:38.216465] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T18:21:38.330611] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-03T18:21:38.344161] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:38.390626] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-03T18:21:39.190677] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-03T18:21:39.236832] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:21:39.990718] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-03T18:21:40.503707] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:21:40.725446] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T18:21:40.790725] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-03T18:21:41.590707] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-03T18:21:41.947573] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:21:42.390691] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-03T18:21:42.692831] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:21:42.731577] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T18:21:43.190736] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-03T18:21:43.742626] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T18:21:43.990631] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-03T18:21:44.314780] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:21:44.790707] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-03T18:21:45.590617] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-03T18:21:45.984610] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:21:46.174086] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:21:46.390696] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-03T18:21:47.025755] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:21:47.190685] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-03T18:21:47.298217] [DEBUG] [REMOTE ] DBI: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-03T18:21:47.298672] [WARN ] [REMOTE ] DBI: No data returned for month 2025-03 [2025-10-03T18:21:47.298762] [FATAL] [REMOTE ] DBI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:21:47.298860] [FATAL] [MAIN ] DBI: Failed to fetch primary data. [2025-10-03T18:21:47.298932] [WARN ] [MAIN ] DBI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:21:47.299014] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-03T18:21:47.299087] [DEBUG] [LOCAL ] DBI: No primary data file found to delete. [2025-10-03T18:21:47.299129] [INFO ] [LOCAL ] DBI: Starting deletion of derivative data. [2025-10-03T18:21:47.299448] [DEBUG] [LOCAL ] DBI: Deleted derivative data file. [2025-10-03T18:21:47.299552] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DBI took 9.9s. Estimated remaining: 4h 5m 58s. Rate: 7.2 symbols/min [2025-10-03T18:21:47.516020] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:47.533049] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T18:21:47.547671] [DEBUG] [LOCAL ] DBL: Loaded 9352 existing records from primary storage. [2025-10-03T18:21:47.547967] [INFO ] [MAIN ] DBL: Loaded 9352 existing records. [2025-10-03T18:21:47.735847] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:47.736084] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-03T18:21:47.736143] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-03T18:21:47.736600] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-03T18:21:47.736694] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-03T18:21:47.995882] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-03T18:21:48.145937] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:48.790735] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-03T18:21:49.590696] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-03T18:21:49.738466] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:21:50.311168] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T18:21:50.312663] [INFO ] [REMOTE ] DBD: Full fetch complete (30820 records). [2025-10-03T18:21:50.312791] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-03T18:21:50.313377] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:50.313473] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:50.313520] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:50.313561] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-03T18:21:50.313712] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-03T18:21:50.313773] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-03T18:21:50.313835] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-03T18:21:50.313943] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DBD took 22.5s. Estimated remaining: 4h 5m 34s. Rate: 7.2 symbols/min [2025-10-03T18:21:50.398967] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-03T18:21:50.533423] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:50.533746] [DEBUG] [LOCAL ] DBRG: No existing data file found in primary storage. [2025-10-03T18:21:50.533823] [WARN ] [MAIN ] DBRG: No existing data found, performing full refresh instead. [2025-10-03T18:21:50.533971] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-03T18:21:50.534068] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-03T18:21:50.534159] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-03T18:21:50.534227] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-03T18:21:50.947868] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:50.991475] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:21:51.190716] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-03T18:21:51.990735] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-03T18:21:52.461414] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-03T18:21:52.790714] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-03T18:21:53.178554] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T18:21:53.590703] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-03T18:21:54.143804] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:21:54.319928] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:21:54.390696] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-03T18:21:55.112850] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:21:55.115253] [INFO ] [REMOTE ] DB: Full fetch complete (74286 records). [2025-10-03T18:21:55.115367] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-03T18:21:55.116474] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:21:55.116566] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:21:55.116613] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:21:55.116686] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-03T18:21:55.116788] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-03T18:21:55.116844] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-10-03T18:21:55.116977] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-10-03T18:21:55.117124] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DB took 36.1s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-03T18:21:55.195759] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-03T18:21:55.312832] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:55.313030] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-10-03T18:21:55.313070] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-10-03T18:21:55.313224] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-03T18:21:55.313302] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-03T18:21:55.313369] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-03T18:21:55.313406] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-03T18:21:55.722226] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:55.797181] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:21:55.799798] [INFO ] [REMOTE ] DAY: Full fetch complete (71525 records). [2025-10-03T18:21:55.799961] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-03T18:21:55.995910] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-03T18:21:56.148666] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:21:56.252494] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-03T18:21:56.252591] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-03T18:21:56.253454] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-03T18:21:56.253532] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-03T18:21:56.255111] [DEBUG] [LOCAL ] DAY: Trimmed 71525 records to 50058 (keeping 200 days of data) [2025-10-03T18:21:56.568525] [DEBUG] [LOCAL ] DAY: Primary data saved (50058 records). [2025-10-03T18:21:56.568747] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-03T18:21:56.569484] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DAY took 41.6s. Estimated remaining: 4h 4m 46s. Rate: 7.3 symbols/min [2025-10-03T18:21:56.766392] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:21:56.784231] [DEBUG] [LOCAL ] DCO: Loaded 13948 existing records from primary storage. [2025-10-03T18:21:56.784498] [INFO ] [MAIN ] DCO: Loaded 13948 existing records. [2025-10-03T18:21:56.796682] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-03T18:21:56.990034] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:21:56.990302] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-03T18:21:56.990353] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-03T18:21:56.990619] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-03T18:21:56.990725] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-03T18:21:57.401234] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:21:57.556017] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T18:21:57.590758] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-03T18:21:57.870934] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:21:58.390729] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-03T18:21:59.190684] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-03T18:21:59.265015] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:21:59.449308] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:21:59.964165] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T18:21:59.990687] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-03T18:22:00.790731] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-03T18:22:00.983064] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T18:22:01.590991] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-03T18:22:01.715158] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-03T18:22:02.390737] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-03T18:22:03.055274] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:22:03.071090] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:22:03.190727] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-03T18:22:03.990739] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-03T18:22:04.610935] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:22:04.626360] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:22:04.790709] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-03T18:22:05.590744] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-03T18:22:06.390738] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-03T18:22:06.552092] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T18:22:07.002416] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:22:07.184452] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:22:07.193328] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-03T18:22:07.978617] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:22:07.990621] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-03T18:22:08.790739] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-03T18:22:08.849461] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:22:09.590705] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-03T18:22:10.390703] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-03T18:22:10.421155] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T18:22:11.190709] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-03T18:22:11.385769] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:22:11.385455] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:22:11.682038] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-03T18:22:11.990726] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-03T18:22:12.790702] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-03T18:22:13.039254] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:22:13.590689] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-03T18:22:13.648420] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-03T18:22:14.390714] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-03T18:22:15.073528] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T18:22:15.190716] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-03T18:22:15.881757] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:22:15.990740] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-03T18:22:16.658204] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T18:22:16.790734] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-03T18:22:17.590706] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-03T18:22:17.622258] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:22:17.887849] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T18:22:18.390675] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-03T18:22:18.957572] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:22:19.190740] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-03T18:22:19.443131] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T18:22:19.960195] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T18:22:19.990742] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-03T18:22:20.790711] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-03T18:22:21.590678] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-03T18:22:21.673277] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:22:22.388811] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:22:22.397051] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-03T18:22:22.801906] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:22:23.190695] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-03T18:22:23.945218] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:22:23.990631] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-03T18:22:24.569525] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-03T18:22:24.790713] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-03T18:22:25.473930] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:22:25.590738] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-03T18:22:25.858450] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:22:25.859444] [INFO ] [REMOTE ] DBL: Full fetch complete (12563 records). [2025-10-03T18:22:25.859535] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-03T18:22:26.267509] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-03T18:22:26.267604] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-03T18:22:26.268149] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-03T18:22:26.268216] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-03T18:22:26.270300] [DEBUG] [LOCAL ] DBL: Trimmed 12563 records to 9400 (keeping 200 days of data) [2025-10-03T18:22:26.334627] [DEBUG] [LOCAL ] DBL: Primary data saved (9400 records). [2025-10-03T18:22:26.334798] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-03T18:22:26.334967] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBL took 39.0s. Estimated remaining: 4h 5m 42s. Rate: 7.2 symbols/min [2025-10-03T18:22:26.395758] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-03T18:22:26.523164] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:26.566974] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:22:26.569303] [INFO ] [REMOTE ] DCI: Full fetch complete (53815 records). [2025-10-03T18:22:26.569481] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-03T18:22:26.707135] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-10-03T18:22:26.728296] [INFO ] [MAIN ] DD: Loaded 53213 existing records. [2025-10-03T18:22:27.136091] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:27.172392] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-03T18:22:27.187603] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-03T18:22:27.204237] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-03T18:22:27.223627] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-03T18:22:27.227251] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-03T18:22:27.227068] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-10-03T18:22:27.232604] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-10-03T18:22:27.252062] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-10-03T18:22:27.252281] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-10-03T18:22:27.349629] [DEBUG] [LOCAL ] DCI: Trimmed 53815 records to 37763 (keeping 200 days of data) [2025-10-03T18:22:27.600749] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:22:27.771836] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:27.910671] [DEBUG] [LOCAL ] DCI: Primary data saved (37763 records). [2025-10-03T18:22:27.910842] [INFO ] [MAIN ] DCI: Full history saved. [2025-10-03T18:22:27.910942] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DCI took 32.8s. Estimated remaining: 4h 5m 14s. Rate: 7.2 symbols/min [2025-10-03T18:22:27.995747] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-03T18:22:28.096466] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:28.148125] [DEBUG] [LOCAL ] DDD: Loaded 51270 existing records from primary storage. [2025-10-03T18:22:28.148459] [INFO ] [MAIN ] DDD: Loaded 51270 existing records. [2025-10-03T18:22:28.338923] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:28.339154] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-03T18:22:28.339205] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-03T18:22:28.339470] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-03T18:22:28.339529] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-03T18:22:28.753886] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:28.790688] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-03T18:22:29.069993] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:22:29.590744] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-03T18:22:29.652216] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:22:29.653390] [INFO ] [REMOTE ] DCO: Full fetch complete (19099 records). [2025-10-03T18:22:29.653508] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-03T18:22:30.105914] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-03T18:22:30.107965] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T18:22:30.118950] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-03T18:22:30.120144] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-03T18:22:30.120214] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-03T18:22:30.121085] [DEBUG] [LOCAL ] DCO: Trimmed 19099 records to 14009 (keeping 200 days of data) [2025-10-03T18:22:30.207967] [DEBUG] [LOCAL ] DCO: Primary data saved (14009 records). [2025-10-03T18:22:30.208134] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-03T18:22:30.208228] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DCO took 33.6s. Estimated remaining: 4h 4m 48s. Rate: 7.2 symbols/min [2025-10-03T18:22:30.390710] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-03T18:22:31.190733] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-03T18:22:31.226845] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T18:22:31.229626] [INFO ] [REMOTE ] DBRG: Full fetch complete (72382 records). [2025-10-03T18:22:31.229801] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-03T18:22:31.673120] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-03T18:22:31.673229] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-03T18:22:31.674149] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-03T18:22:31.674221] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-03T18:22:31.676538] [DEBUG] [LOCAL ] DBRG: Trimmed 72382 records to 50472 (keeping 200 days of data) [2025-10-03T18:22:32.020609] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:22:32.033853] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-03T18:22:32.044676] [DEBUG] [LOCAL ] DBRG: Primary data saved (50472 records). [2025-10-03T18:22:32.044797] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-03T18:22:32.044876] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DBRG took 41.7s. Estimated remaining: 4h 4m 20s. Rate: 7.3 symbols/min [2025-10-03T18:22:33.081090] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:22:33.095311] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-03T18:22:33.751984] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:22:33.762547] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-03T18:22:34.918638] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T18:22:34.930288] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-03T18:22:35.508026] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:22:35.519871] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-03T18:22:36.300610] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:22:36.311743] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-03T18:22:37.205957] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:22:37.218378] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-03T18:22:38.202468] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:22:38.214381] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-03T18:22:38.767618] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:22:38.781821] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-03T18:22:40.212866] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:22:40.224968] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-03T18:22:40.512767] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:22:40.527164] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-03T18:22:42.067950] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:22:42.079909] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-03T18:22:42.518988] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:22:42.531941] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-03T18:22:43.968120] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T18:22:43.980142] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-03T18:22:44.386170] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:22:44.401047] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-03T18:22:45.394519] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T18:22:45.407250] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-03T18:22:46.208116] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:22:46.221880] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-03T18:22:47.258763] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:22:47.270363] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-03T18:22:47.835469] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T18:22:47.839207] [INFO ] [REMOTE ] DD: Full fetch complete (76346 records). [2025-10-03T18:22:47.839354] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-03T18:22:48.322894] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-03T18:22:48.322999] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-03T18:22:48.324225] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-03T18:22:48.324298] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-03T18:22:48.325926] [DEBUG] [LOCAL ] DD: Trimmed 76346 records to 53600 (keeping 200 days of data) [2025-10-03T18:22:48.681105] [DEBUG] [LOCAL ] DD: Primary data saved (53600 records). [2025-10-03T18:22:48.681261] [INFO ] [MAIN ] DD: Full history saved. [2025-10-03T18:22:48.681360] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 22.3s. Estimated remaining: 4h 4m 37s. Rate: 7.2 symbols/min [2025-10-03T18:22:49.230723] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T18:22:49.243112] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-03T18:22:50.933231] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:22:50.936402] [INFO ] [REMOTE ] DDD: Full fetch complete (73692 records). [2025-10-03T18:22:50.936574] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-03T18:22:51.401795] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-03T18:22:51.401895] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-03T18:22:51.403154] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-03T18:22:51.403255] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-03T18:22:51.405509] [DEBUG] [LOCAL ] DDD: Trimmed 73692 records to 51654 (keeping 200 days of data) [2025-10-03T18:22:51.730158] [DEBUG] [LOCAL ] DDD: Primary data saved (51654 records). [2025-10-03T18:22:51.730319] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-03T18:22:51.731895] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 23.8s. Estimated remaining: 4h 4m 13s. Rate: 7.2 symbols/min [2025-10-03T18:22:52.489298] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.457777] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.516043] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-10-03T18:22:52.538294] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-10-03T18:22:52.577667] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.596520] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-03T18:22:52.601518] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:22:52.602772] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-03T18:22:52.602907] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-03T18:22:52.602950] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-03T18:22:52.678441] [DEBUG] [LOCAL ] DDT: Loaded 2086 existing records from primary storage. [2025-10-03T18:22:52.703509] [INFO ] [MAIN ] DDT: Loaded 2086 existing records. [2025-10-03T18:22:52.856599] [DEBUG] [LOCAL ] DDL: Loaded 37057 existing records from primary storage. [2025-10-03T18:22:52.913050] [INFO ] [MAIN ] DDL: Loaded 37057 existing records. [2025-10-03T18:22:53.230173] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:53.259103] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-03T18:22:53.243270] [DEBUG] [LOCAL ] DE: Loaded 47908 existing records from primary storage. [2025-10-03T18:22:53.294601] [INFO ] [MAIN ] DE: Loaded 47908 existing records. [2025-10-03T18:22:53.289309] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-03T18:22:53.360562] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-03T18:22:53.416552] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-03T18:22:53.652376] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:53.701788] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-03T18:22:53.750154] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-03T18:22:53.797199] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:53.818470] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-03T18:22:53.847230] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-03T18:22:53.878941] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-03T18:22:54.141200] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:22:54.156514] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-03T18:22:54.206617] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-03T18:22:54.283213] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-03T18:22:54.322809] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-03T18:22:54.808934] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:54.832336] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-03T18:22:55.033758] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:55.037535] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-03T18:22:55.124233] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:22:55.124538] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-03T18:23:06.824214] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (11.99 seconds). [2025-10-03T18:23:06.825493] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-03T18:23:07.206597] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (13.39 seconds). [2025-10-03T18:23:07.210449] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-03T18:23:07.450137] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T18:23:07.451491] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-03T18:23:08.414472] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (13.38 seconds). [2025-10-03T18:23:08.424504] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-03T18:23:08.510025] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (13.39 seconds). [2025-10-03T18:23:08.520355] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-03T18:23:09.477016] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:23:09.484885] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-03T18:23:10.823875] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T18:23:10.831681] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-03T18:23:12.308544] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T18:23:12.317717] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-03T18:23:12.789260] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (5.34 seconds). [2025-10-03T18:23:12.790870] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-03T18:23:13.449682] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (6.24 seconds). [2025-10-03T18:23:13.453021] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-03T18:23:13.959489] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:23:13.972152] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-03T18:23:13.994794] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T18:23:13.996087] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-03T18:23:14.593623] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T18:23:14.597253] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-03T18:23:14.608491] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-03T18:23:14.610546] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-03T18:23:14.670404] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (6.15 seconds). [2025-10-03T18:23:14.681079] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-03T18:23:14.934309] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T18:23:14.935675] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-03T18:23:15.306356] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-03T18:23:15.307681] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-03T18:23:15.626278] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:23:15.630306] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-03T18:23:15.675785] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:23:15.677202] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-03T18:23:15.944614] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:23:15.955226] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-03T18:23:16.123566] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T18:23:16.124748] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-03T18:23:16.456099] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:23:16.466490] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-03T18:23:16.509728] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-03T18:23:16.511207] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-03T18:23:16.523074] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:23:16.527411] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-03T18:23:16.879315] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T18:23:16.886033] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-03T18:23:16.998175] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-03T18:23:16.998995] [INFO ] [REMOTE ] DDT: Full fetch complete (2872 records). [2025-10-03T18:23:16.999070] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-03T18:23:16.999520] [FATAL] [VALIDATOR ] DDT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:23:16.999678] [FATAL] [MAIN ] DDT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:23:16.999741] [WARN ] [MAIN ] DDT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:23:16.999787] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-03T18:23:16.999844] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-10-03T18:23:16.999886] [INFO ] [LOCAL ] DDT: Starting deletion of derivative data. [2025-10-03T18:23:17.000261] [DEBUG] [LOCAL ] DDT: Deleted derivative data file. [2025-10-03T18:23:17.000357] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 25.3s. Estimated remaining: 4h 4m 55s. Rate: 7.2 symbols/min [2025-10-03T18:23:17.187012] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:17.187211] [DEBUG] [LOCAL ] DEA: No existing data file found in primary storage. [2025-10-03T18:23:17.187256] [WARN ] [MAIN ] DEA: No existing data found, performing full refresh instead. [2025-10-03T18:23:17.187399] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-03T18:23:17.187465] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-03T18:23:17.187532] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-03T18:23:17.187606] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-03T18:23:17.586696] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:17.587105] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-03T18:23:17.629977] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:23:17.633852] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-03T18:23:18.346164] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:23:18.353240] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-03T18:23:18.462089] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T18:23:18.474278] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-03T18:23:18.484051] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:23:18.487930] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-03T18:23:18.969952] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:23:18.980438] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-03T18:23:19.230784] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-03T18:23:19.235474] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-03T18:23:19.702267] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:23:19.709207] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-03T18:23:20.189891] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:23:20.193897] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-03T18:23:20.386777] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:23:20.403771] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-03T18:23:20.591405] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:23:20.601667] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-03T18:23:21.082030] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T18:23:21.086029] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-03T18:23:21.214941] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:23:21.224816] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-03T18:23:21.865724] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:23:21.866751] [INFO ] [REMOTE ] DDS: Full fetch complete (18964 records). [2025-10-03T18:23:21.866860] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-03T18:23:22.032057] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:23:22.129059] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-03T18:23:22.332461] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-03T18:23:22.332735] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-03T18:23:22.333178] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-03T18:23:22.333332] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-03T18:23:22.334532] [DEBUG] [LOCAL ] DDS: Trimmed 18964 records to 13150 (keeping 200 days of data) [2025-10-03T18:23:22.363104] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:23:22.434798] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-03T18:23:22.461937] [DEBUG] [LOCAL ] DDS: Primary data saved (13150 records). [2025-10-03T18:23:22.462071] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-03T18:23:22.462212] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 30.7s. Estimated remaining: 4h 4m 38s. Rate: 7.2 symbols/min [2025-10-03T18:23:22.571558] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:23:22.589711] [INFO ] [REMOTE ] DDL: Full fetch complete (52904 records). [2025-10-03T18:23:22.605231] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-03T18:23:22.638224] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:23:22.667427] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:23:22.667285] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:22.668192] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:23:22.668311] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-03T18:23:22.668411] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-03T18:23:22.668488] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-10-03T18:23:22.668807] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-10-03T18:23:22.668913] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DDL took 30.9s. Estimated remaining: 4h 4m 6s. Rate: 7.2 symbols/min [2025-10-03T18:23:22.869801] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:22.881841] [DEBUG] [LOCAL ] DEC: Loaded 30765 existing records from primary storage. [2025-10-03T18:23:22.882163] [INFO ] [MAIN ] DEC: Loaded 30765 existing records. [2025-10-03T18:23:23.085324] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:23.085610] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-03T18:23:23.085699] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-03T18:23:23.086110] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-03T18:23:23.100178] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-03T18:23:23.247002] [DEBUG] [LOCAL ] DECK: Loaded 53683 existing records from primary storage. [2025-10-03T18:23:23.279194] [INFO ] [MAIN ] DECK: Loaded 53683 existing records. [2025-10-03T18:23:23.691638] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:23.709371] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-03T18:23:23.709468] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-03T18:23:23.735410] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-10-03T18:23:23.758274] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-03T18:23:23.766023] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:23.791562] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-03T18:23:24.201470] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T18:23:24.264517] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:24.276771] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-03T18:23:24.276454] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-03T18:23:24.311030] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:23:24.790711] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-03T18:23:25.049390] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:23:25.590784] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-03T18:23:26.138776] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:23:26.369617] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:23:26.390703] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-03T18:23:26.420172] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:23:26.706715] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T18:23:27.190694] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-03T18:23:27.904904] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T18:23:27.990704] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-03T18:23:28.790906] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-03T18:23:29.111765] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:23:29.295231] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:23:29.590726] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-03T18:23:30.388613] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T18:23:30.397918] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-03T18:23:31.124762] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:23:31.190697] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-03T18:23:31.990904] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-03T18:23:32.490150] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T18:23:32.631341] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T18:23:32.790926] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-03T18:23:33.371427] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T18:23:33.590689] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-03T18:23:34.026945] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T18:23:34.390736] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-03T18:23:35.190711] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-03T18:23:35.339293] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:23:35.990700] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-03T18:23:36.018100] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:23:36.790685] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-03T18:23:37.335466] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-10-03T18:23:37.590674] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-03T18:23:37.646467] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T18:23:37.648971] [INFO ] [REMOTE ] DE: Full fetch complete (69566 records). [2025-10-03T18:23:37.649085] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-03T18:23:38.145242] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-03T18:23:38.145392] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-03T18:23:38.146524] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-03T18:23:38.147155] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-03T18:23:38.148483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:23:38.158453] [DEBUG] [LOCAL ] DE: Trimmed 69566 records to 48234 (keeping 200 days of data) [2025-10-03T18:23:38.393252] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-03T18:23:38.481390] [DEBUG] [LOCAL ] DE: Primary data saved (48234 records). [2025-10-03T18:23:38.481539] [INFO ] [MAIN ] DE: Full history saved. [2025-10-03T18:23:38.481626] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DE took 46.7s. Estimated remaining: 4h 4m 20s. Rate: 7.2 symbols/min [2025-10-03T18:23:38.671109] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:38.718170] [DEBUG] [LOCAL ] DEI: Loaded 48684 existing records from primary storage. [2025-10-03T18:23:38.718509] [INFO ] [MAIN ] DEI: Loaded 48684 existing records. [2025-10-03T18:23:38.924192] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:38.924567] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-03T18:23:38.924633] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-03T18:23:38.925014] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-03T18:23:38.925074] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-03T18:23:39.103291] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T18:23:39.195939] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-03T18:23:39.375238] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:39.824205] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:23:39.990688] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-03T18:23:40.636223] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:23:40.790731] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-03T18:23:41.448158] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:23:41.451255] [INFO ] [REMOTE ] DEA: Full fetch complete (62389 records). [2025-10-03T18:23:41.451428] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-03T18:23:41.595803] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-03T18:23:41.896473] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-03T18:23:41.896566] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-03T18:23:41.897337] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-03T18:23:41.897417] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-03T18:23:41.898873] [DEBUG] [LOCAL ] DEA: Trimmed 62389 records to 41408 (keeping 200 days of data) [2025-10-03T18:23:42.167269] [DEBUG] [LOCAL ] DEA: Primary data saved (41408 records). [2025-10-03T18:23:42.167418] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-03T18:23:42.167547] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEA took 25.2s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-10-03T18:23:42.359595] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:42.392454] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-03T18:23:42.422696] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:23:42.454884] [DEBUG] [LOCAL ] DELL: Loaded 54125 existing records from primary storage. [2025-10-03T18:23:42.455248] [INFO ] [MAIN ] DELL: Loaded 54125 existing records. [2025-10-03T18:23:42.665893] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:23:42.666239] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-03T18:23:42.666465] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-03T18:23:42.666895] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-03T18:23:42.666960] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-03T18:23:42.998417] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T18:23:43.132165] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:43.190691] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-03T18:23:43.990690] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-03T18:23:44.475922] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:23:44.790700] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-03T18:23:45.361365] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T18:23:45.590685] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-03T18:23:45.720800] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-03T18:23:46.390714] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-03T18:23:46.992811] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T18:23:47.190571] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-03T18:23:47.233112] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:23:47.990728] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-03T18:23:48.792701] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-03T18:23:48.817682] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-03T18:23:49.151956] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T18:23:49.509169] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T18:23:49.590693] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-03T18:23:49.797314] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:23:49.800476] [INFO ] [REMOTE ] DEC: Full fetch complete (43460 records). [2025-10-03T18:23:49.800691] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-03T18:23:50.246561] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-03T18:23:50.246687] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-03T18:23:50.247407] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-03T18:23:50.247457] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-03T18:23:50.248733] [DEBUG] [LOCAL ] DEC: Trimmed 43460 records to 31087 (keeping 200 days of data) [2025-10-03T18:23:50.390723] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-03T18:23:50.466151] [DEBUG] [LOCAL ] DEC: Primary data saved (31087 records). [2025-10-03T18:23:50.466349] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-03T18:23:50.466458] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEC took 28.0s. Estimated remaining: 4h 3m 50s. Rate: 7.2 symbols/min [2025-10-03T18:23:50.729640] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:23:50.729902] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-03T18:23:50.729968] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-03T18:23:50.730126] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-03T18:23:50.730192] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-03T18:23:50.730267] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-03T18:23:50.730325] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-03T18:23:51.199524] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-03T18:23:51.235089] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:23:51.391396] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:23:51.990723] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-03T18:23:52.589947] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T18:23:52.790710] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-03T18:23:53.526846] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-10-03T18:23:53.590732] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-03T18:23:53.765779] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T18:23:54.390690] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-03T18:23:54.755841] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T18:23:55.190722] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-03T18:23:55.349241] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:23:55.990682] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-03T18:23:56.540753] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:23:56.790755] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-03T18:23:56.827811] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-03T18:23:57.590723] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-03T18:23:57.997174] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:23:58.378986] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:23:58.390813] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-03T18:23:59.190728] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-03T18:23:59.952088] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T18:23:59.999207] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-03T18:24:00.008240] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:24:00.790701] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-03T18:24:01.430568] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-03T18:24:01.434249] [INFO ] [REMOTE ] DECK: Full fetch complete (76730 records). [2025-10-03T18:24:01.434439] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-03T18:24:01.595883] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-03T18:24:01.935809] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-03T18:24:01.936050] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-03T18:24:01.937392] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-03T18:24:01.937515] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-03T18:24:01.940405] [DEBUG] [LOCAL ] DECK: Trimmed 76730 records to 54072 (keeping 200 days of data) [2025-10-03T18:24:02.097390] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T18:24:02.390742] [DEBUG] [LOCAL ] DECK: Primary data saved (54072 records). [2025-10-03T18:24:02.391131] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-03T18:24:02.392011] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 39.7s. Estimated remaining: 4h 3m 52s. Rate: 7.2 symbols/min [2025-10-03T18:24:02.390904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-03T18:24:02.576618] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:02.613825] [DEBUG] [LOCAL ] DFH: Loaded 32447 existing records from primary storage. [2025-10-03T18:24:02.614146] [INFO ] [MAIN ] DFH: Loaded 32447 existing records. [2025-10-03T18:24:02.807775] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:02.808043] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-03T18:24:02.808094] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-03T18:24:02.808303] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-03T18:24:02.808363] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-03T18:24:03.219941] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:03.220528] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-03T18:24:03.326577] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-03T18:24:03.366263] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T18:24:03.990736] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-03T18:24:04.225140] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:24:04.755276] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:24:04.790716] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-03T18:24:05.590736] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-03T18:24:06.390691] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-03T18:24:06.546010] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:24:07.029814] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (3.04 seconds). [2025-10-03T18:24:07.190710] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-03T18:24:07.345615] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:24:07.542616] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:24:07.990749] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-03T18:24:08.790703] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-03T18:24:09.368183] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:24:09.590713] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-03T18:24:09.747627] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-10-03T18:24:10.198820] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:24:10.201330] [INFO ] [REMOTE ] DEI: Full fetch complete (69701 records). [2025-10-03T18:24:10.201484] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-03T18:24:10.395794] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-03T18:24:10.634255] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-03T18:24:10.634355] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-03T18:24:10.635231] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-03T18:24:10.635304] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-03T18:24:10.636885] [DEBUG] [LOCAL ] DEI: Trimmed 69701 records to 49012 (keeping 200 days of data) [2025-10-03T18:24:10.944745] [DEBUG] [LOCAL ] DEI: Primary data saved (49012 records). [2025-10-03T18:24:10.944887] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-03T18:24:10.945443] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 32.5s. Estimated remaining: 4h 3m 45s. Rate: 7.2 symbols/min [2025-10-03T18:24:11.126864] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:11.151963] [DEBUG] [LOCAL ] DFIN: Loaded 23174 existing records from primary storage. [2025-10-03T18:24:11.152280] [INFO ] [MAIN ] DFIN: Loaded 23174 existing records. [2025-10-03T18:24:11.202356] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-03T18:24:11.361891] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:11.362331] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-03T18:24:11.362457] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-03T18:24:11.362896] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-03T18:24:11.363053] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-03T18:24:11.588533] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T18:24:11.808974] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:11.990710] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-03T18:24:12.685388] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-03T18:24:12.790692] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-03T18:24:12.837064] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:24:13.590631] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-03T18:24:13.831253] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:24:14.390757] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-03T18:24:15.091326] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:24:15.178380] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-03T18:24:15.191139] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-03T18:24:15.990691] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-03T18:24:15.991959] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:24:16.512868] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T18:24:16.790708] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-03T18:24:17.590673] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-03T18:24:17.817058] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T18:24:18.114360] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-03T18:24:18.117242] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-03T18:24:18.117407] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-03T18:24:18.396782] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-03T18:24:18.564984] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-03T18:24:18.565082] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-03T18:24:18.565977] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-03T18:24:18.566046] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-03T18:24:18.567693] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54515 (keeping 200 days of data) [2025-10-03T18:24:18.921888] [DEBUG] [LOCAL ] DELL: Primary data saved (54515 records). [2025-10-03T18:24:18.922065] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-03T18:24:18.922164] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DELL took 36.8s. Estimated remaining: 4h 3m 35s. Rate: 7.2 symbols/min [2025-10-03T18:24:19.121313] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:19.135230] [DEBUG] [LOCAL ] DFP: Loaded 11492 existing records from primary storage. [2025-10-03T18:24:19.135554] [INFO ] [MAIN ] DFP: Loaded 11492 existing records. [2025-10-03T18:24:19.200717] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-03T18:24:19.353756] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:19.354256] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-03T18:24:19.354383] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-03T18:24:19.354609] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-03T18:24:19.354709] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-03T18:24:19.765255] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:19.784873] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:24:19.824026] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T18:24:19.990683] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-03T18:24:20.449458] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T18:24:20.625674] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:24:20.790696] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-03T18:24:21.590726] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-03T18:24:22.390685] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-03T18:24:22.717738] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T18:24:23.188851] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:24:23.191783] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-03T18:24:23.667923] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:24:23.990724] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-03T18:24:24.173214] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:24:24.790692] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-03T18:24:25.576637] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:24:25.590632] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-03T18:24:25.822218] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T18:24:26.390719] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-03T18:24:27.192867] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-03T18:24:27.197322] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:24:27.268346] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:24:27.990726] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-03T18:24:28.613779] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:24:28.790712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-03T18:24:29.120241] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T18:24:29.590702] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-03T18:24:30.151501] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:24:30.154239] [INFO ] [REMOTE ] DEO: Full fetch complete (71509 records). [2025-10-03T18:24:30.154357] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-03T18:24:30.393762] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-03T18:24:30.522717] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-03T18:24:30.617200] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-03T18:24:30.617300] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-03T18:24:30.618249] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-03T18:24:30.618321] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-03T18:24:30.620000] [DEBUG] [LOCAL ] DEO: Trimmed 71509 records to 49783 (keeping 200 days of data) [2025-10-03T18:24:30.939925] [DEBUG] [LOCAL ] DEO: Primary data saved (49783 records). [2025-10-03T18:24:30.940071] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-03T18:24:30.940192] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DEO took 40.5s. Estimated remaining: 4h 3m 38s. Rate: 7.2 symbols/min [2025-10-03T18:24:31.133771] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:31.191157] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-03T18:24:31.193728] [DEBUG] [LOCAL ] DG: Loaded 53672 existing records from primary storage. [2025-10-03T18:24:31.194224] [INFO ] [MAIN ] DG: Loaded 53672 existing records. [2025-10-03T18:24:31.393955] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:31.394214] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-03T18:24:31.394267] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-03T18:24:31.396099] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-03T18:24:31.396167] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-03T18:24:31.517389] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T18:24:31.816803] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:31.990719] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-03T18:24:32.302971] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T18:24:32.790721] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-03T18:24:33.590690] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-03T18:24:33.611524] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T18:24:33.869887] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:24:34.272750] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-03T18:24:34.390702] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-03T18:24:35.190683] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-03T18:24:35.228143] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:24:35.990685] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-03T18:24:36.790671] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-03T18:24:37.153998] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T18:24:37.349259] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:24:37.590627] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-03T18:24:37.986198] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:24:38.352721] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:24:38.390712] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-03T18:24:39.191228] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T18:24:39.190841] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-03T18:24:39.990636] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-03T18:24:40.284795] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:24:40.790623] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-03T18:24:41.003448] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:24:41.005667] [INFO ] [REMOTE ] DFH: Full fetch complete (48546 records). [2025-10-03T18:24:41.005759] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-03T18:24:41.430103] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-03T18:24:41.430202] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-03T18:24:41.430912] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-03T18:24:41.430982] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-03T18:24:41.432198] [DEBUG] [LOCAL ] DFH: Trimmed 48546 records to 32660 (keeping 200 days of data) [2025-10-03T18:24:41.608437] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-03T18:24:41.645782] [DEBUG] [LOCAL ] DFH: Primary data saved (32660 records). [2025-10-03T18:24:41.645979] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-03T18:24:41.646105] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DFH took 39.3s. Estimated remaining: 4h 3m 36s. Rate: 7.2 symbols/min [2025-10-03T18:24:41.787510] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:24:41.811019] [INFO ] [REMOTE ] DFIN: Full fetch complete (33672 records). [2025-10-03T18:24:41.821674] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-03T18:24:41.904893] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:42.331092] [DEBUG] [LOCAL ] DGX: Loaded 45232 existing records from primary storage. [2025-10-03T18:24:42.390624] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-03T18:24:42.388575] [INFO ] [MAIN ] DGX: Loaded 45232 existing records. [2025-10-03T18:24:42.397269] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-03T18:24:42.426493] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-03T18:24:42.441827] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-03T18:24:42.471044] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-03T18:24:42.517479] [DEBUG] [LOCAL ] DFIN: Trimmed 33672 records to 23342 (keeping 200 days of data) [2025-10-03T18:24:42.648526] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:42.692337] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-03T18:24:42.692998] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-03T18:24:42.694559] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:24:42.697984] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-03T18:24:42.699810] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-03T18:24:43.119881] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:43.156760] [DEBUG] [LOCAL ] DFIN: Primary data saved (23342 records). [2025-10-03T18:24:43.156902] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-03T18:24:43.156988] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFIN took 32.2s. Estimated remaining: 4h 3m 9s. Rate: 7.2 symbols/min [2025-10-03T18:24:43.195712] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-03T18:24:43.356607] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:43.386262] [DEBUG] [LOCAL ] DHF: Loaded 21198 existing records from primary storage. [2025-10-03T18:24:43.386912] [INFO ] [MAIN ] DHF: Loaded 21198 existing records. [2025-10-03T18:24:43.731549] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:43.731854] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-03T18:24:43.731929] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-03T18:24:43.732390] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-03T18:24:43.732471] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-03T18:24:43.906563] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T18:24:43.913383] [INFO ] [REMOTE ] DFP: Full fetch complete (16100 records). [2025-10-03T18:24:43.933961] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-03T18:24:43.993627] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-03T18:24:44.539865] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:44.803012] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-03T18:24:44.817061] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-03T18:24:44.817875] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-03T18:24:44.818395] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-03T18:24:44.818507] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-03T18:24:44.819851] [DEBUG] [LOCAL ] DFP: Trimmed 16100 records to 11537 (keeping 200 days of data) [2025-10-03T18:24:44.917718] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-03T18:24:44.948107] [DEBUG] [LOCAL ] DFP: Primary data saved (11537 records). [2025-10-03T18:24:44.948391] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-03T18:24:44.948542] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFP took 26.0s. Estimated remaining: 4h 2m 42s. Rate: 7.2 symbols/min [2025-10-03T18:24:45.133711] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:24:45.197279] [DEBUG] [LOCAL ] DHI: Loaded 53731 existing records from primary storage. [2025-10-03T18:24:45.197682] [INFO ] [MAIN ] DHI: Loaded 53731 existing records. [2025-10-03T18:24:45.396785] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:24:45.397049] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-03T18:24:45.397103] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-03T18:24:45.399067] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-10-03T18:24:45.399133] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-03T18:24:45.592529] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-03T18:24:45.813205] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:24:45.840085] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:24:46.060780] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:24:46.390702] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-03T18:24:47.190685] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-03T18:24:47.676332] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T18:24:47.990735] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-03T18:24:48.369032] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:24:48.728691] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T18:24:48.790737] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-03T18:24:49.122040] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:24:49.590727] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-03T18:24:50.390687] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-03T18:24:50.422295] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:24:51.190684] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-03T18:24:51.420307] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:24:51.636434] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-03T18:24:51.990717] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-03T18:24:52.790724] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-03T18:24:53.064189] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:24:53.093551] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:24:53.590757] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-03T18:24:54.390719] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-03T18:24:54.447933] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:24:55.190685] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-03T18:24:55.655068] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T18:24:55.805896] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T18:24:55.990639] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-03T18:24:56.790666] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-03T18:24:57.135772] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:24:57.590630] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-03T18:24:57.879757] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:24:57.956209] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T18:24:58.390756] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-03T18:24:59.190635] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-03T18:24:59.290193] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:24:59.990628] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-03T18:25:00.385732] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-03T18:25:00.790735] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-03T18:25:01.317356] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:25:01.590715] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-03T18:25:01.713115] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T18:25:02.265317] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T18:25:02.390714] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-03T18:25:03.190694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-03T18:25:03.519233] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:25:03.661149] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T18:25:03.990734] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-03T18:25:04.790682] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-03T18:25:04.874716] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T18:25:05.590755] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-03T18:25:05.824232] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:25:06.193178] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:25:06.390723] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-03T18:25:07.190729] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-03T18:25:07.878573] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-10-03T18:25:07.990733] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-03T18:25:08.225208] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:25:08.790725] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-03T18:25:09.226622] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T18:25:09.590734] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-03T18:25:10.193945] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T18:25:10.283438] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T18:25:10.390693] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-03T18:25:11.190683] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-03T18:25:11.565830] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:25:11.583781] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:25:11.586886] [INFO ] [REMOTE ] DGX: Full fetch complete (65174 records). [2025-10-03T18:25:11.587029] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-03T18:25:11.998770] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-03T18:25:12.068421] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-03T18:25:12.068547] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-03T18:25:12.069470] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-03T18:25:12.069542] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-03T18:25:12.071169] [DEBUG] [LOCAL ] DGX: Trimmed 65174 records to 45574 (keeping 200 days of data) [2025-10-03T18:25:12.370001] [DEBUG] [LOCAL ] DGX: Primary data saved (45574 records). [2025-10-03T18:25:12.370143] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-03T18:25:12.370242] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DGX took 30.7s. Estimated remaining: 4h 3m 28s. Rate: 7.2 symbols/min [2025-10-03T18:25:12.490936] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T18:25:12.581191] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:12.644075] [DEBUG] [LOCAL ] DHR: Loaded 53756 existing records from primary storage. [2025-10-03T18:25:12.644455] [INFO ] [MAIN ] DHR: Loaded 53756 existing records. [2025-10-03T18:25:12.795863] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-03T18:25:12.861906] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:12.862343] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-03T18:25:12.862417] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-03T18:25:12.864242] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-03T18:25:12.864308] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-03T18:25:13.269451] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:13.590702] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-03T18:25:14.079242] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:25:14.082101] [INFO ] [REMOTE ] DG: Full fetch complete (77210 records). [2025-10-03T18:25:14.082239] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-03T18:25:14.403223] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-03T18:25:14.525632] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-03T18:25:14.525791] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-03T18:25:14.526703] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-03T18:25:14.526769] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-03T18:25:14.528373] [DEBUG] [LOCAL ] DG: Trimmed 77210 records to 54057 (keeping 200 days of data) [2025-10-03T18:25:14.913439] [DEBUG] [LOCAL ] DG: Primary data saved (54057 records). [2025-10-03T18:25:14.913689] [INFO ] [MAIN ] DG: Full history saved. [2025-10-03T18:25:14.913841] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 44.0s. Estimated remaining: 4h 3m 3s. Rate: 7.2 symbols/min [2025-10-03T18:25:15.115790] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:15.173353] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-10-03T18:25:15.201088] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-03T18:25:15.202178] [DEBUG] [LOCAL ] DHT: Loaded 48248 existing records from primary storage. [2025-10-03T18:25:15.203228] [INFO ] [MAIN ] DHT: Loaded 48248 existing records. [2025-10-03T18:25:15.400083] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:15.400536] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-03T18:25:15.400689] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-03T18:25:15.402157] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-03T18:25:15.402223] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-03T18:25:15.526519] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T18:25:15.830943] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:15.865140] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-03T18:25:15.990705] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-03T18:25:16.790735] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-03T18:25:17.329719] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:25:17.590718] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-03T18:25:18.138914] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T18:25:18.390681] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-03T18:25:18.431908] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:25:18.434101] [INFO ] [REMOTE ] DHF: Full fetch complete (30166 records). [2025-10-03T18:25:18.434202] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-03T18:25:18.868249] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:25:18.920922] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-03T18:25:18.921008] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-03T18:25:18.921548] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-03T18:25:18.921597] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-03T18:25:18.922519] [DEBUG] [LOCAL ] DHF: Trimmed 30166 records to 21451 (keeping 200 days of data) [2025-10-03T18:25:19.045945] [DEBUG] [LOCAL ] DHF: Primary data saved (21451 records). [2025-10-03T18:25:19.046079] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-03T18:25:19.046190] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DHF took 35.9s. Estimated remaining: 4h 2m 43s. Rate: 7.2 symbols/min [2025-10-03T18:25:19.200776] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-03T18:25:19.229998] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:19.231264] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-10-03T18:25:19.231325] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-10-03T18:25:19.231458] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-03T18:25:19.231510] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-03T18:25:19.231558] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-03T18:25:19.231592] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-03T18:25:19.649604] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:19.903516] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:25:19.990690] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-03T18:25:20.790719] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-03T18:25:20.889851] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:25:20.963722] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T18:25:20.966856] [INFO ] [REMOTE ] DHI: Full fetch complete (76824 records). [2025-10-03T18:25:20.967029] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-03T18:25:20.968248] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:25:20.968383] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:25:20.968474] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:25:20.968572] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-03T18:25:20.968748] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-03T18:25:20.968827] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-10-03T18:25:20.969269] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-10-03T18:25:20.969437] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 36.0s. Estimated remaining: 4h 2m 17s. Rate: 7.2 symbols/min [2025-10-03T18:25:21.170340] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:21.185686] [DEBUG] [LOCAL ] DIAX: Loaded 13011 existing records from primary storage. [2025-10-03T18:25:21.185985] [INFO ] [MAIN ] DIAX: Loaded 13011 existing records. [2025-10-03T18:25:21.389894] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:21.390150] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-03T18:25:21.390217] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-03T18:25:21.390802] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-10-03T18:25:21.390868] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-03T18:25:21.592395] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-03T18:25:21.802005] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:22.390764] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-03T18:25:22.671998] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:25:22.717545] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:25:23.190697] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-03T18:25:23.299454] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T18:25:23.990727] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-03T18:25:24.790632] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-03T18:25:24.830271] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:25:25.590624] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-03T18:25:25.901083] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:25:26.106976] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T18:25:26.390677] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-03T18:25:27.190739] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-03T18:25:27.402852] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:25:27.990633] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-03T18:25:28.330179] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T18:25:28.331139] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:25:28.790719] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-03T18:25:29.590750] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-03T18:25:29.867698] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:25:30.126438] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-03T18:25:30.396447] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-03T18:25:30.400466] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:25:31.190692] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-03T18:25:31.974499] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T18:25:31.990623] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-03T18:25:32.186258] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:25:32.790694] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-03T18:25:33.590633] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-03T18:25:33.699257] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:25:34.080378] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-03T18:25:34.390728] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-03T18:25:34.713564] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T18:25:35.190675] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-03T18:25:35.429733] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T18:25:35.786734] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:25:35.990738] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-03T18:25:36.734454] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T18:25:36.790707] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-03T18:25:37.590639] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-03T18:25:37.648788] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T18:25:38.210984] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:25:38.390698] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-03T18:25:39.190676] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-03T18:25:39.979017] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:25:39.990671] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-03T18:25:40.291393] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:25:40.790671] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-03T18:25:40.866679] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:25:41.590726] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-03T18:25:42.390630] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-03T18:25:42.399535] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:25:42.400638] [INFO ] [REMOTE ] DHX: Full fetch complete (20772 records). [2025-10-03T18:25:42.400765] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-03T18:25:42.812778] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-03T18:25:42.812937] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-03T18:25:42.813506] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-03T18:25:42.813671] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-03T18:25:42.814533] [DEBUG] [LOCAL ] DHX: Trimmed 20772 records to 13198 (keeping 200 days of data) [2025-10-03T18:25:42.892574] [DEBUG] [LOCAL ] DHX: Primary data saved (13198 records). [2025-10-03T18:25:42.892832] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-03T18:25:42.892956] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHX took 23.8s. Estimated remaining: 4h 2m 47s. Rate: 7.2 symbols/min [2025-10-03T18:25:43.054081] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-03T18:25:43.150964] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:43.151753] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:25:43.190685] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-03T18:25:43.204408] [DEBUG] [LOCAL ] DIN: Loaded 37507 existing records from primary storage. [2025-10-03T18:25:43.204761] [INFO ] [MAIN ] DIN: Loaded 37507 existing records. [2025-10-03T18:25:43.405555] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:25:43.405802] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-03T18:25:43.405857] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-03T18:25:43.407151] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-03T18:25:43.407218] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-03T18:25:43.788340] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:43.990715] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-03T18:25:44.191702] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:25:44.790727] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-03T18:25:45.590712] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-03T18:25:45.844428] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:25:46.390707] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-03T18:25:46.575536] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:25:46.621926] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T18:25:47.190729] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-03T18:25:47.990706] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-03T18:25:47.998172] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:25:47.999860] [INFO ] [REMOTE ] DIAX: Full fetch complete (17814 records). [2025-10-03T18:25:48.000077] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-03T18:25:48.411323] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-03T18:25:48.411581] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-03T18:25:48.412190] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-03T18:25:48.412365] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-03T18:25:48.413557] [DEBUG] [LOCAL ] DIAX: Trimmed 17814 records to 13148 (keeping 200 days of data) [2025-10-03T18:25:48.524291] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:25:48.552291] [DEBUG] [LOCAL ] DIAX: Primary data saved (13148 records). [2025-10-03T18:25:48.552422] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-03T18:25:48.552506] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DIAX took 27.6s. Estimated remaining: 4h 2m 31s. Rate: 7.2 symbols/min [2025-10-03T18:25:48.731544] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:48.731764] [DEBUG] [LOCAL ] DINO: No existing data file found in primary storage. [2025-10-03T18:25:48.731811] [WARN ] [MAIN ] DINO: No existing data found, performing full refresh instead. [2025-10-03T18:25:48.731927] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-03T18:25:48.731970] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-03T18:25:48.732016] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-03T18:25:48.732048] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-03T18:25:48.802030] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-03T18:25:49.128661] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:49.590635] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-03T18:25:49.620483] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:25:50.390722] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-03T18:25:50.629125] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-03T18:25:50.632212] [INFO ] [REMOTE ] DHR: Full fetch complete (76887 records). [2025-10-03T18:25:50.632371] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-03T18:25:50.633429] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:25:50.633554] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:25:50.633667] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:25:50.633759] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-03T18:25:50.633848] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-10-03T18:25:50.633954] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-10-03T18:25:50.634279] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-10-03T18:25:50.635989] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 38.3s. Estimated remaining: 4h 2m 5s. Rate: 7.2 symbols/min [2025-10-03T18:25:50.840070] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:25:50.840259] [DEBUG] [LOCAL ] DIS: No existing data file found in primary storage. [2025-10-03T18:25:50.840304] [WARN ] [MAIN ] DIS: No existing data found, performing full refresh instead. [2025-10-03T18:25:50.840440] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-03T18:25:50.840487] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-03T18:25:50.840531] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-03T18:25:50.840565] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-03T18:25:51.190933] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-03T18:25:51.235412] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:25:51.456626] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:25:51.900758] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T18:25:51.990723] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-03T18:25:52.790672] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-03T18:25:52.884430] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T18:25:53.565572] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:25:53.590699] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-03T18:25:54.320283] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:25:54.390728] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-03T18:25:54.974488] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T18:25:55.190727] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-03T18:25:55.990720] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-03T18:25:56.790675] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-03T18:25:56.833284] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:25:56.925953] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-03T18:25:57.563237] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:25:57.590675] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-03T18:25:58.311822] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:25:58.390683] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-03T18:25:59.023451] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:25:59.027638] [INFO ] [REMOTE ] DHT: Full fetch complete (69954 records). [2025-10-03T18:25:59.027879] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-03T18:25:59.203203] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-03T18:25:59.482825] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-03T18:25:59.482929] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-03T18:25:59.483809] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-03T18:25:59.483882] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-03T18:25:59.485503] [DEBUG] [LOCAL ] DHT: Trimmed 69954 records to 48575 (keeping 200 days of data) [2025-10-03T18:25:59.818733] [DEBUG] [LOCAL ] DHT: Primary data saved (48575 records). [2025-10-03T18:25:59.818927] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-03T18:25:59.819049] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DHT took 44.9s. Estimated remaining: 4h 1m 59s. Rate: 7.2 symbols/min [2025-10-03T18:26:00.002939] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-03T18:26:00.038312] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:00.038482] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-03T18:26:00.038522] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-03T18:26:00.038749] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-03T18:26:00.038802] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-03T18:26:00.038846] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-03T18:26:00.038900] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-03T18:26:00.239343] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:26:00.552302] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:00.790726] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-03T18:26:01.590713] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-03T18:26:01.773936] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:26:01.881950] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-10-03T18:26:02.198683] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:26:02.370189] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:26:02.390675] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-03T18:26:02.695620] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-03T18:26:03.190710] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-03T18:26:03.634510] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:26:03.990697] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-03T18:26:04.790755] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-03T18:26:05.590721] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-03T18:26:05.810519] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:26:06.390721] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-03T18:26:06.885196] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T18:26:07.126191] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T18:26:07.190687] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-03T18:26:07.563663] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T18:26:07.990730] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-03T18:26:08.790697] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-03T18:26:09.278578] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:26:09.590674] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-03T18:26:09.639190] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:26:09.686552] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-10-03T18:26:10.390750] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-03T18:26:10.762144] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T18:26:11.078828] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:26:11.190722] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-03T18:26:11.541922] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:26:11.990718] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-03T18:26:12.596419] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:26:12.790725] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-03T18:26:13.590719] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-03T18:26:14.390713] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-03T18:26:14.745373] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:26:15.190738] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-03T18:26:15.803578] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T18:26:15.995751] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-03T18:26:16.009400] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:26:16.790700] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-03T18:26:16.859335] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:26:17.163194] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:26:17.590692] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-03T18:26:18.390706] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-03T18:26:18.526326] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-10-03T18:26:19.190735] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-03T18:26:19.432147] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:26:19.548936] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-03T18:26:19.828195] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T18:26:19.990699] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-03T18:26:20.339665] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T18:26:20.340336] [INFO ] [REMOTE ] DIVY: Full fetch complete (1730 records). [2025-10-03T18:26:20.340406] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-03T18:26:20.543041] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T18:26:20.543261] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:26:20.543337] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:26:20.543453] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-03T18:26:20.543551] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-03T18:26:20.543611] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-03T18:26:20.543717] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-03T18:26:20.543810] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIVY took 20.7s. Estimated remaining: 4h 2m 26s. Rate: 7.2 symbols/min [2025-10-03T18:26:20.739520] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:20.790350] [DEBUG] [LOCAL ] DK: Loaded 49690 existing records from primary storage. [2025-10-03T18:26:20.790686] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-03T18:26:20.790930] [INFO ] [MAIN ] DK: Loaded 49690 existing records. [2025-10-03T18:26:20.993494] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:20.993748] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-03T18:26:20.993805] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-03T18:26:20.995234] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-03T18:26:20.995297] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-03T18:26:21.391056] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:21.590676] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-03T18:26:22.390739] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-03T18:26:23.094229] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-03T18:26:23.190700] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-03T18:26:23.440214] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:26:23.861786] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T18:26:23.864434] [INFO ] [REMOTE ] DINO: Full fetch complete (76678 records). [2025-10-03T18:26:23.864550] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-03T18:26:23.995788] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-03T18:26:24.293029] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-10-03T18:26:24.293133] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-10-03T18:26:24.294074] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-10-03T18:26:24.294145] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-10-03T18:26:24.295904] [DEBUG] [LOCAL ] DINO: Trimmed 76678 records to 53696 (keeping 200 days of data) [2025-10-03T18:26:24.637403] [DEBUG] [LOCAL ] DINO: Primary data saved (53696 records). [2025-10-03T18:26:24.637553] [INFO ] [MAIN ] DINO: Full history saved. [2025-10-03T18:26:24.637635] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DINO took 36.1s. Estimated remaining: 4h 2m 6s. Rate: 7.2 symbols/min [2025-10-03T18:26:24.795944] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-03T18:26:24.825623] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:24.846276] [DEBUG] [LOCAL ] DKL: Loaded 18727 existing records from primary storage. [2025-10-03T18:26:24.846555] [INFO ] [MAIN ] DKL: Loaded 18727 existing records. [2025-10-03T18:26:25.044003] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:25.044373] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-03T18:26:25.044431] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-03T18:26:25.045104] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-03T18:26:25.045166] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-03T18:26:25.443463] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:25.530112] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T18:26:25.590635] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-03T18:26:25.699157] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T18:26:26.390669] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-03T18:26:26.427109] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:26:27.190715] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-03T18:26:27.915910] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-03T18:26:27.930585] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:26:27.934702] [INFO ] [REMOTE ] DIN: Full fetch complete (55228 records). [2025-10-03T18:26:27.934875] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-03T18:26:28.000700] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-03T18:26:28.411691] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-03T18:26:28.412074] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-03T18:26:28.413981] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-03T18:26:28.414196] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-03T18:26:28.416364] [DEBUG] [LOCAL ] DIN: Trimmed 55228 records to 37756 (keeping 200 days of data) [2025-10-03T18:26:28.732686] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:26:28.789229] [DEBUG] [LOCAL ] DIN: Primary data saved (37756 records). [2025-10-03T18:26:28.789441] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-03T18:26:28.789573] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DIN took 45.9s. Estimated remaining: 4h 1m 46s. Rate: 7.2 symbols/min [2025-10-03T18:26:28.795146] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-03T18:26:29.045527] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:29.116942] [DEBUG] [LOCAL ] DKS: Loaded 50084 existing records from primary storage. [2025-10-03T18:26:29.117455] [INFO ] [MAIN ] DKS: Loaded 50084 existing records. [2025-10-03T18:26:29.379635] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:29.379883] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-03T18:26:29.379935] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-03T18:26:29.381455] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-03T18:26:29.381522] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-03T18:26:29.606826] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-03T18:26:29.883364] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:29.899135] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T18:26:29.900725] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T18:26:30.390690] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-03T18:26:31.190684] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-03T18:26:31.990749] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-03T18:26:32.052559] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:26:32.272312] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-10-03T18:26:32.468402] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:26:32.790702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-03T18:26:33.590636] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-03T18:26:33.985809] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:26:34.390690] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-03T18:26:35.056357] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T18:26:35.063960] [INFO ] [REMOTE ] DIS: Full fetch complete (77945 records). [2025-10-03T18:26:35.064603] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-03T18:26:35.195787] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-03T18:26:35.514928] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-03T18:26:35.515172] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-03T18:26:35.516197] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-03T18:26:35.516284] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-03T18:26:35.518572] [DEBUG] [LOCAL ] DIS: Trimmed 77945 records to 54568 (keeping 200 days of data) [2025-10-03T18:26:35.553221] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:26:35.924557] [DEBUG] [LOCAL ] DIS: Primary data saved (54568 records). [2025-10-03T18:26:35.924775] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-03T18:26:35.924889] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DIS took 45.3s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-10-03T18:26:35.993719] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-03T18:26:36.115254] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:36.148890] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:26:36.183511] [DEBUG] [LOCAL ] DLB: Loaded 32228 existing records from primary storage. [2025-10-03T18:26:36.183831] [INFO ] [MAIN ] DLB: Loaded 32228 existing records. [2025-10-03T18:26:36.378914] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:36.379231] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-03T18:26:36.379327] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-03T18:26:36.385471] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-03T18:26:36.394847] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-03T18:26:36.395311] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-03T18:26:36.799525] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:36.795385] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-03T18:26:37.590699] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-03T18:26:37.840449] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:26:38.390726] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-03T18:26:38.437778] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:26:38.702312] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:26:39.190713] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-03T18:26:39.995763] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-03T18:26:40.015964] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:26:40.786193] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T18:26:40.793622] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-03T18:26:41.590705] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-03T18:26:41.885136] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T18:26:42.218226] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:26:42.390686] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-03T18:26:43.190732] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-03T18:26:43.277926] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:26:43.990697] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-03T18:26:44.179696] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:26:44.242334] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T18:26:44.790708] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-03T18:26:45.590682] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-03T18:26:45.868891] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:26:46.390632] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-03T18:26:46.406173] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T18:26:46.664168] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T18:26:47.190729] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-03T18:26:47.759180] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:26:47.990705] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-03T18:26:48.790711] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-03T18:26:48.835379] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:26:49.006569] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:26:49.590729] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-03T18:26:50.390705] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-03T18:26:50.715822] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T18:26:51.182775] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:26:51.185464] [INFO ] [REMOTE ] DK: Full fetch complete (70882 records). [2025-10-03T18:26:51.185620] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-03T18:26:51.198490] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-03T18:26:51.623601] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-03T18:26:51.623852] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-03T18:26:51.624783] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-03T18:26:51.624869] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-03T18:26:51.626528] [DEBUG] [LOCAL ] DK: Trimmed 70882 records to 50047 (keeping 200 days of data) [2025-10-03T18:26:51.879355] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:26:51.980300] [DEBUG] [LOCAL ] DK: Primary data saved (50047 records). [2025-10-03T18:26:51.980497] [INFO ] [MAIN ] DK: Full history saved. [2025-10-03T18:26:51.980618] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DK took 31.4s. Estimated remaining: 4h 1m 48s. Rate: 7.2 symbols/min [2025-10-03T18:26:51.996306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-03T18:26:52.170417] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:26:52.180336] [DEBUG] [LOCAL ] DLNG: Loaded 6130 existing records from primary storage. [2025-10-03T18:26:52.180565] [INFO ] [MAIN ] DLNG: Loaded 6130 existing records. [2025-10-03T18:26:52.375758] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:26:52.377172] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-03T18:26:52.377235] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-03T18:26:52.377940] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-03T18:26:52.378002] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-03T18:26:52.793481] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-03T18:26:52.800357] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:26:53.130862] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:26:53.545464] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:26:53.590725] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-03T18:26:53.725224] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:26:54.390623] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-03T18:26:54.466554] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T18:26:55.190779] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-03T18:26:55.990713] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-03T18:26:56.193032] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T18:26:56.236169] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T18:26:56.790685] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-03T18:26:57.140934] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T18:26:57.590683] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-03T18:26:58.390624] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-03T18:26:58.591727] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:26:58.615261] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:26:59.190686] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-03T18:26:59.722895] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:26:59.990675] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-03T18:27:00.013281] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T18:27:00.790701] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-03T18:27:01.130211] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T18:27:01.590737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-03T18:27:01.909875] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:27:01.911074] [INFO ] [REMOTE ] DKL: Full fetch complete (28582 records). [2025-10-03T18:27:01.911148] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-03T18:27:02.304529] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-03T18:27:02.304608] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-03T18:27:02.305170] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-03T18:27:02.305260] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-03T18:27:02.306129] [DEBUG] [LOCAL ] DKL: Trimmed 28582 records to 18799 (keeping 200 days of data) [2025-10-03T18:27:02.394609] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-03T18:27:02.431267] [DEBUG] [LOCAL ] DKL: Primary data saved (18799 records). [2025-10-03T18:27:02.431418] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-03T18:27:02.431504] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DKL took 37.8s. Estimated remaining: 4h 1m 45s. Rate: 7.2 symbols/min [2025-10-03T18:27:02.621311] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:02.685862] [DEBUG] [LOCAL ] DLR: Loaded 51291 existing records from primary storage. [2025-10-03T18:27:02.686216] [INFO ] [MAIN ] DLR: Loaded 51291 existing records. [2025-10-03T18:27:02.895921] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:02.896142] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-03T18:27:02.896212] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-03T18:27:02.896540] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-03T18:27:02.896601] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-03T18:27:03.199165] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T18:27:03.199256] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-03T18:27:03.311028] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T18:27:03.351521] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:03.990737] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-03T18:27:04.790632] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-03T18:27:04.944249] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T18:27:04.947254] [INFO ] [REMOTE ] DKS: Full fetch complete (71591 records). [2025-10-03T18:27:04.947393] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-03T18:27:05.380894] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-03T18:27:05.381043] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-03T18:27:05.381994] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-03T18:27:05.382187] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-03T18:27:05.383874] [DEBUG] [LOCAL ] DKS: Trimmed 71591 records to 50431 (keeping 200 days of data) [2025-10-03T18:27:05.505279] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:27:05.607319] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-03T18:27:05.758667] [DEBUG] [LOCAL ] DKS: Primary data saved (50431 records). [2025-10-03T18:27:05.758832] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-03T18:27:05.759858] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DKS took 37.0s. Estimated remaining: 4h 1m 23s. Rate: 7.2 symbols/min [2025-10-03T18:27:05.882697] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T18:27:05.965408] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:06.002246] [DEBUG] [LOCAL ] DLX: Loaded 28713 existing records from primary storage. [2025-10-03T18:27:06.002579] [INFO ] [MAIN ] DLX: Loaded 28713 existing records. [2025-10-03T18:27:06.221054] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:06.221269] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-03T18:27:06.221318] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-03T18:27:06.221933] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-03T18:27:06.221996] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-03T18:27:06.392525] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-03T18:27:06.624386] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:06.859781] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T18:27:06.861751] [INFO ] [REMOTE ] DLB: Full fetch complete (46959 records). [2025-10-03T18:27:06.861942] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-03T18:27:07.199805] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-03T18:27:07.300074] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-03T18:27:07.300172] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-03T18:27:07.300923] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-03T18:27:07.300993] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-03T18:27:07.302320] [DEBUG] [LOCAL ] DLB: Trimmed 46959 records to 32449 (keeping 200 days of data) [2025-10-03T18:27:07.424696] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T18:27:07.538273] [DEBUG] [LOCAL ] DLB: Primary data saved (32449 records). [2025-10-03T18:27:07.538428] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-03T18:27:07.538519] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 31.6s. Estimated remaining: 4h 0m 57s. Rate: 7.2 symbols/min [2025-10-03T18:27:07.740863] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:07.763800] [DEBUG] [LOCAL ] DLY: Loaded 20149 existing records from primary storage. [2025-10-03T18:27:07.764059] [INFO ] [MAIN ] DLY: Loaded 20149 existing records. [2025-10-03T18:27:07.947745] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:07.947974] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-03T18:27:07.948023] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-03T18:27:07.948227] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-03T18:27:07.948285] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-03T18:27:07.995891] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-03T18:27:08.321403] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:08.676836] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-03T18:27:08.790678] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-03T18:27:09.129092] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:27:09.403534] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:27:09.590729] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-03T18:27:10.390741] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-03T18:27:10.832630] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:27:10.972579] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T18:27:11.190726] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-03T18:27:11.990715] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-03T18:27:12.305618] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T18:27:12.790701] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-03T18:27:13.399193] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:27:13.590704] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-03T18:27:13.788936] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T18:27:14.390718] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-03T18:27:14.873420] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:27:14.933982] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T18:27:14.934974] [INFO ] [REMOTE ] DLNG: Full fetch complete (11918 records). [2025-10-03T18:27:14.935051] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-03T18:27:15.195822] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-03T18:27:15.327675] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-03T18:27:15.327775] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-03T18:27:15.328121] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-03T18:27:15.328165] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-03T18:27:15.328746] [DEBUG] [LOCAL ] DLNG: Trimmed 11918 records to 6166 (keeping 200 days of data) [2025-10-03T18:27:15.366674] [DEBUG] [LOCAL ] DLNG: Primary data saved (6166 records). [2025-10-03T18:27:15.366857] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-03T18:27:15.366970] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 23.4s. Estimated remaining: 4h 0m 47s. Rate: 7.2 symbols/min [2025-10-03T18:27:15.601987] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:15.609117] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-10-03T18:27:15.609425] [INFO ] [MAIN ] DMA: Loaded 4570 existing records. [2025-10-03T18:27:15.816746] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:15.817003] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-03T18:27:15.817059] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-03T18:27:15.817266] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-03T18:27:15.817326] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-03T18:27:16.011217] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-03T18:27:16.250564] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:16.519973] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T18:27:16.790690] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-03T18:27:17.315061] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T18:27:17.590739] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-03T18:27:18.192929] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T18:27:18.234261] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-03T18:27:18.390691] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-03T18:27:19.190720] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-03T18:27:19.990688] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-03T18:27:20.136726] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:27:20.212010] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:27:20.790761] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-03T18:27:21.281990] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:27:21.590716] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-03T18:27:22.300078] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:27:22.320600] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-03T18:27:22.390709] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-03T18:27:22.956816] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T18:27:23.190719] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-03T18:27:23.990719] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-03T18:27:24.790680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-03T18:27:24.963080] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:27:25.272144] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T18:27:25.293338] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:27:25.590637] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-03T18:27:26.159733] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-03T18:27:26.390730] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-03T18:27:27.077442] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T18:27:27.190675] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-03T18:27:27.710454] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T18:27:27.990717] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-03T18:27:28.790635] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-03T18:27:29.101810] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:27:29.590701] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-03T18:27:30.251607] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T18:27:30.390677] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-03T18:27:30.753086] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:27:31.190713] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-03T18:27:31.717780] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:27:31.990720] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-03T18:27:32.644081] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:27:32.790707] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-03T18:27:32.923747] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:27:33.507697] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:27:33.590681] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-03T18:27:34.390716] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-03T18:27:34.732867] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T18:27:34.987497] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:27:35.190620] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-03T18:27:35.703035] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:27:35.704034] [INFO ] [REMOTE ] DMA: Full fetch complete (6624 records). [2025-10-03T18:27:35.704151] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-03T18:27:35.995855] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-03T18:27:36.091448] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-03T18:27:36.091557] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-03T18:27:36.091891] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-03T18:27:36.091956] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-03T18:27:36.092434] [DEBUG] [LOCAL ] DMA: Trimmed 6624 records to 4595 (keeping 200 days of data) [2025-10-03T18:27:36.121550] [DEBUG] [LOCAL ] DMA: Primary data saved (4595 records). [2025-10-03T18:27:36.121747] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-03T18:27:36.121865] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DMA took 20.8s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-03T18:27:36.308854] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:36.322242] [DEBUG] [LOCAL ] DMB: Loaded 10281 existing records from primary storage. [2025-10-03T18:27:36.322518] [INFO ] [MAIN ] DMB: Loaded 10281 existing records. [2025-10-03T18:27:36.504863] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:36.505169] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-03T18:27:36.505226] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-03T18:27:36.505555] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-03T18:27:36.505628] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-03T18:27:36.795917] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-03T18:27:36.899505] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:36.952814] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:27:37.590706] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-03T18:27:38.390827] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-03T18:27:38.602531] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T18:27:38.913183] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T18:27:39.190714] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-03T18:27:39.291613] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:27:39.990628] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-03T18:27:40.382161] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T18:27:40.790712] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-03T18:27:40.947043] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:27:41.590693] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-03T18:27:41.796454] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-03T18:27:42.390704] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-03T18:27:42.931136] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T18:27:43.190724] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-03T18:27:43.990732] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-03T18:27:44.215869] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:27:44.218192] [INFO ] [REMOTE ] DLX: Full fetch complete (41432 records). [2025-10-03T18:27:44.218412] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-03T18:27:44.592416] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:27:44.697339] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-03T18:27:44.697456] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-03T18:27:44.698443] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-03T18:27:44.698517] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-03T18:27:44.699777] [DEBUG] [LOCAL ] DLX: Trimmed 41432 records to 28911 (keeping 200 days of data) [2025-10-03T18:27:44.794392] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-03T18:27:44.817933] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:27:44.914758] [DEBUG] [LOCAL ] DLX: Primary data saved (28911 records). [2025-10-03T18:27:44.915020] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-03T18:27:44.915183] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 39.2s. Estimated remaining: 4h 1m 6s. Rate: 7.2 symbols/min [2025-10-03T18:27:45.114277] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:45.127249] [DEBUG] [LOCAL ] DMO: Loaded 9961 existing records from primary storage. [2025-10-03T18:27:45.127490] [INFO ] [MAIN ] DMO: Loaded 9961 existing records. [2025-10-03T18:27:45.329221] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:45.329466] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-03T18:27:45.329530] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-03T18:27:45.329793] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-03T18:27:45.329854] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-03T18:27:45.595776] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-03T18:27:45.716864] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:45.883697] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:27:46.390730] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-03T18:27:47.109785] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T18:27:47.162403] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:27:47.190635] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-03T18:27:47.908227] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T18:27:47.990683] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-03T18:27:48.790749] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-03T18:27:48.849261] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:27:49.590719] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-03T18:27:49.637511] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T18:27:50.390716] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-03T18:27:51.190670] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-03T18:27:51.224134] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:27:51.226798] [INFO ] [REMOTE ] DLR: Full fetch complete (74078 records). [2025-10-03T18:27:51.226952] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-03T18:27:51.354986] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-03T18:27:51.705636] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-03T18:27:51.705765] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-03T18:27:51.706741] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-03T18:27:51.706809] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-03T18:27:51.708458] [DEBUG] [LOCAL ] DLR: Trimmed 74078 records to 51668 (keeping 200 days of data) [2025-10-03T18:27:52.004616] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-03T18:27:52.054157] [DEBUG] [LOCAL ] DLR: Primary data saved (51668 records). [2025-10-03T18:27:52.054337] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-03T18:27:52.054458] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLR took 49.6s. Estimated remaining: 4h 0m 54s. Rate: 7.2 symbols/min [2025-10-03T18:27:52.263572] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:52.310284] [DEBUG] [LOCAL ] DNA: Loaded 48642 existing records from primary storage. [2025-10-03T18:27:52.310620] [INFO ] [MAIN ] DNA: Loaded 48642 existing records. [2025-10-03T18:27:52.419969] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:27:52.447036] [INFO ] [REMOTE ] DLY: Full fetch complete (28488 records). [2025-10-03T18:27:52.462703] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-03T18:27:52.608929] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:52.638738] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-03T18:27:52.639212] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-03T18:27:52.665618] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-03T18:27:52.680629] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-03T18:27:52.824556] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-03T18:27:52.937573] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T18:27:53.357218] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:53.357525] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-03T18:27:53.357792] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-03T18:27:53.358827] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-03T18:27:53.358897] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-03T18:27:53.360102] [DEBUG] [LOCAL ] DLY: Trimmed 28488 records to 20380 (keeping 200 days of data) [2025-10-03T18:27:53.487861] [DEBUG] [LOCAL ] DLY: Primary data saved (20380 records). [2025-10-03T18:27:53.487989] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-03T18:27:53.488102] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DLY took 45.9s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-03T18:27:53.595951] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-03T18:27:53.727429] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:53.777391] [DEBUG] [LOCAL ] DNOW: Loaded 44016 existing records from primary storage. [2025-10-03T18:27:53.777734] [INFO ] [MAIN ] DNOW: Loaded 44016 existing records. [2025-10-03T18:27:53.902579] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T18:27:54.002367] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:54.002691] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-03T18:27:54.002766] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-03T18:27:54.003058] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-10-03T18:27:54.003132] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-03T18:27:54.408349] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:54.401461] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-03T18:27:54.410920] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T18:27:55.174684] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T18:27:55.190612] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-03T18:27:55.940150] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-03T18:27:55.990681] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-03T18:27:56.790705] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-03T18:27:56.840764] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:27:57.590673] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-03T18:27:58.207943] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:27:58.326251] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:27:58.327684] [INFO ] [REMOTE ] DMB: Full fetch complete (14995 records). [2025-10-03T18:27:58.327764] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-03T18:27:58.395916] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-03T18:27:58.724945] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-03T18:27:58.725027] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-03T18:27:58.725390] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-03T18:27:58.725432] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-03T18:27:58.725984] [DEBUG] [LOCAL ] DMB: Trimmed 14995 records to 10319 (keeping 200 days of data) [2025-10-03T18:27:58.793693] [DEBUG] [LOCAL ] DMB: Primary data saved (10319 records). [2025-10-03T18:27:58.793846] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-03T18:27:58.793959] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMB took 22.7s. Estimated remaining: 4h 0m 11s. Rate: 7.2 symbols/min [2025-10-03T18:27:58.976808] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:27:59.011989] [DEBUG] [LOCAL ] DNP: Loaded 33447 existing records from primary storage. [2025-10-03T18:27:59.012317] [INFO ] [MAIN ] DNP: Loaded 33447 existing records. [2025-10-03T18:27:59.216315] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:27:59.208439] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-03T18:27:59.217842] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-03T18:27:59.217903] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-03T18:27:59.218422] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-03T18:27:59.218482] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-03T18:27:59.618457] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:27:59.990702] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-03T18:28:00.298765] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T18:28:00.790675] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-03T18:28:01.232965] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:28:01.321137] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:28:01.590695] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-03T18:28:01.696472] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:28:02.390748] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-03T18:28:02.919721] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:28:03.190738] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-03T18:28:03.970333] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:28:03.990620] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-03T18:28:04.704143] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:28:04.790725] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-03T18:28:05.590693] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-03T18:28:06.010407] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:28:06.067772] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:28:06.390721] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-03T18:28:07.197740] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-03T18:28:07.201089] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:28:07.223487] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T18:28:07.990693] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-03T18:28:08.790705] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-03T18:28:09.078411] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:28:09.237792] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T18:28:09.590680] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-03T18:28:09.709574] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:28:10.339619] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T18:28:10.390761] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-03T18:28:11.190700] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-03T18:28:11.994931] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-03T18:28:11.999550] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:28:12.790628] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-03T18:28:13.123800] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-03T18:28:13.590636] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-03T18:28:13.689683] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:28:13.773809] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:28:14.390728] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-03T18:28:15.096449] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T18:28:15.190632] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-03T18:28:15.280013] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:28:15.990686] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-03T18:28:16.234840] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:28:16.790701] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-03T18:28:17.515157] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:28:17.590747] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-03T18:28:18.306829] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:28:18.366781] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T18:28:18.390622] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-03T18:28:19.048418] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T18:28:19.049490] [INFO ] [REMOTE ] DMO: Full fetch complete (14470 records). [2025-10-03T18:28:19.049564] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-03T18:28:19.202931] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-03T18:28:19.450116] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-03T18:28:19.450206] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-03T18:28:19.450562] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-03T18:28:19.450625] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-03T18:28:19.451265] [DEBUG] [LOCAL ] DMO: Trimmed 14470 records to 10026 (keeping 200 days of data) [2025-10-03T18:28:19.514212] [DEBUG] [LOCAL ] DMO: Primary data saved (10026 records). [2025-10-03T18:28:19.514388] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-03T18:28:19.514495] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMO took 34.6s. Estimated remaining: 4h 0m 36s. Rate: 7.2 symbols/min [2025-10-03T18:28:19.694522] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:19.751879] [DEBUG] [LOCAL ] DOC: Loaded 53930 existing records from primary storage. [2025-10-03T18:28:19.752213] [INFO ] [MAIN ] DOC: Loaded 53930 existing records. [2025-10-03T18:28:19.943462] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:19.943728] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-03T18:28:19.943787] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-03T18:28:19.944036] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-03T18:28:19.944096] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-03T18:28:19.995788] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-03T18:28:20.340631] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:20.790698] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-03T18:28:21.036003] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:28:21.422086] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:28:21.590713] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-03T18:28:22.349325] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T18:28:22.390684] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-03T18:28:23.190682] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-03T18:28:23.641125] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-03T18:28:23.990635] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-03T18:28:24.175263] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T18:28:24.368372] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T18:28:24.790704] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-03T18:28:25.590672] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-03T18:28:25.825814] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:28:26.201496] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:28:26.390698] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-03T18:28:27.151373] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T18:28:27.190622] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-03T18:28:27.990638] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-03T18:28:28.079571] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:28:28.649187] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:28:28.790685] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-03T18:28:29.590526] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:28:29.590737] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-03T18:28:30.390701] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-03T18:28:30.677253] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T18:28:30.681098] [INFO ] [REMOTE ] DNA: Full fetch complete (70977 records). [2025-10-03T18:28:30.681276] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-03T18:28:30.960967] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:28:31.062694] [INFO ] [REMOTE ] DNOW: Full fetch complete (62994 records). [2025-10-03T18:28:31.098836] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-03T18:28:31.208194] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-03T18:28:31.517899] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-03T18:28:31.529493] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-03T18:28:31.557305] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-03T18:28:31.593463] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-03T18:28:31.707205] [DEBUG] [LOCAL ] DNA: Trimmed 70977 records to 49019 (keeping 200 days of data) [2025-10-03T18:28:32.030507] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-03T18:28:32.031055] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-03T18:28:32.032791] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-03T18:28:32.033306] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-03T18:28:32.037155] [DEBUG] [LOCAL ] DNOW: Trimmed 62994 records to 44313 (keeping 200 days of data) [2025-10-03T18:28:32.399415] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:28:32.412932] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-03T18:28:32.455032] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T18:28:32.573020] [DEBUG] [LOCAL ] DNA: Primary data saved (49019 records). [2025-10-03T18:28:32.574324] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-03T18:28:32.574477] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNA took 40.5s. Estimated remaining: 4h 0m 41s. Rate: 7.2 symbols/min [2025-10-03T18:28:32.611169] [DEBUG] [LOCAL ] DNOW: Primary data saved (44313 records). [2025-10-03T18:28:32.611357] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-03T18:28:32.612992] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNOW took 39.1s. Estimated remaining: 4h 0m 10s. Rate: 7.2 symbols/min [2025-10-03T18:28:32.790695] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-03T18:28:33.745672] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T18:28:33.754037] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-03T18:28:34.711916] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:28:34.728084] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-03T18:28:34.734674] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T18:28:34.737219] [INFO ] [REMOTE ] DNP: Full fetch complete (49254 records). [2025-10-03T18:28:34.737363] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-03T18:28:35.162851] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-03T18:28:35.162940] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-03T18:28:35.163623] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-03T18:28:35.163706] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-03T18:28:35.164954] [DEBUG] [LOCAL ] DNP: Trimmed 49254 records to 33654 (keeping 200 days of data) [2025-10-03T18:28:35.377193] [DEBUG] [LOCAL ] DNP: Primary data saved (33654 records). [2025-10-03T18:28:35.377344] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-03T18:28:35.377435] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNP took 36.6s. Estimated remaining: 3h 59m 47s. Rate: 7.2 symbols/min [2025-10-03T18:28:36.618820] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T18:28:36.631471] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-03T18:28:38.451638] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:28:38.463123] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-03T18:28:40.434507] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T18:28:40.447074] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-03T18:28:42.386616] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:28:42.398740] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-03T18:28:44.421434] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:28:44.434213] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-03T18:28:46.166914] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:28:46.169666] [INFO ] [REMOTE ] DOC: Full fetch complete (77388 records). [2025-10-03T18:28:46.169794] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-03T18:28:46.615110] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-03T18:28:46.615272] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-03T18:28:46.616179] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-03T18:28:46.616246] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-03T18:28:46.617828] [DEBUG] [LOCAL ] DOC: Trimmed 77388 records to 54318 (keeping 200 days of data) [2025-10-03T18:28:46.969051] [DEBUG] [LOCAL ] DOC: Primary data saved (54318 records). [2025-10-03T18:28:46.969196] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-03T18:28:46.970834] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 27.5s. Estimated remaining: 3h 59m 47s. Rate: 7.2 symbols/min [2025-10-03T18:28:47.679678] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.686582] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.704405] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.809395] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:47.876630] [DEBUG] [LOCAL ] DOUG: Loaded 34608 existing records from primary storage. [2025-10-03T18:28:47.886298] [DEBUG] [LOCAL ] DOCN: Loaded 50952 existing records from primary storage. [2025-10-03T18:28:47.886551] [INFO ] [MAIN ] DOUG: Loaded 34608 existing records. [2025-10-03T18:28:47.892328] [INFO ] [MAIN ] DOCN: Loaded 50952 existing records. [2025-10-03T18:28:48.101761] [DEBUG] [LOCAL ] DOLE: Loaded 38730 existing records from primary storage. [2025-10-03T18:28:48.133955] [INFO ] [MAIN ] DOLE: Loaded 38730 existing records. [2025-10-03T18:28:48.183047] [DEBUG] [LOCAL ] DOCS: Loaded 51492 existing records from primary storage. [2025-10-03T18:28:48.220755] [INFO ] [MAIN ] DOCS: Loaded 51492 existing records. [2025-10-03T18:28:48.425189] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.530171] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.635849] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.635963] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-03T18:28:48.657319] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.662835] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-03T18:28:48.685132] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-03T18:28:48.711422] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-03T18:28:48.695708] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-03T18:28:48.768289] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-03T18:28:48.775111] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.855922] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.855810] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:48.923525] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-03T18:28:48.928919] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-03T18:28:48.912308] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-03T18:28:48.951548] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-03T18:28:48.977445] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-03T18:28:48.977365] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-03T18:28:49.055708] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-03T18:28:50.263014] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.365721] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.348978] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-03T18:28:50.430775] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.386855] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-03T18:28:50.449043] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-03T18:28:50.475306] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:50.475722] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-03T18:28:51.713894] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T18:28:51.721475] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-03T18:28:51.956893] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:28:51.970398] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-03T18:28:52.004592] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:28:52.016282] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-03T18:28:52.045439] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T18:28:52.054570] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-03T18:28:52.127995] [DEBUG] [REMOTE ] DOCS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-03T18:28:52.128389] [WARN ] [REMOTE ] DOCS: No data returned for month 2025-01 [2025-10-03T18:28:52.128514] [FATAL] [REMOTE ] DOCS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:28:52.128708] [FATAL] [MAIN ] DOCS: Failed to fetch primary data. [2025-10-03T18:28:52.128802] [WARN ] [MAIN ] DOCS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:28:52.128892] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-03T18:28:52.128979] [DEBUG] [LOCAL ] DOCS: No primary data file found to delete. [2025-10-03T18:28:52.129034] [INFO ] [LOCAL ] DOCS: Starting deletion of derivative data. [2025-10-03T18:28:52.129439] [DEBUG] [LOCAL ] DOCS: Deleted derivative data file. [2025-10-03T18:28:52.129549] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOCS took 5.2s. Estimated remaining: 3h 59m 30s. Rate: 7.2 symbols/min [2025-10-03T18:28:52.326937] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:28:52.381572] [DEBUG] [LOCAL ] DOV: Loaded 45755 existing records from primary storage. [2025-10-03T18:28:52.381916] [INFO ] [MAIN ] DOV: Loaded 45755 existing records. [2025-10-03T18:28:52.570532] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:28:52.570790] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-03T18:28:52.570843] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-03T18:28:52.572298] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-03T18:28:52.572361] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-03T18:28:52.996058] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T18:28:53.022439] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:28:53.031786] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-03T18:28:53.032342] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-03T18:28:53.430553] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:28:53.438935] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-03T18:28:53.667041] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:28:53.677057] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-03T18:28:54.393266] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:28:54.402877] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-03T18:28:54.478130] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T18:28:54.486895] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-03T18:28:54.800860] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:28:54.809345] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-03T18:28:54.944517] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:28:54.955034] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-03T18:28:55.380948] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T18:28:55.389017] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-03T18:28:56.073503] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:28:56.083172] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-03T18:28:56.195396] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T18:28:56.233566] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:28:56.232001] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-03T18:28:56.245161] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-03T18:28:56.800315] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T18:28:56.809284] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-03T18:28:57.601561] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-03T18:28:57.612256] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-03T18:28:57.676884] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T18:28:57.686368] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-03T18:28:57.716634] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:28:57.730358] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-03T18:28:58.266272] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:28:58.390692] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-03T18:28:59.021310] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T18:28:59.190634] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-03T18:28:59.362422] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:28:59.496687] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:28:59.793508] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:28:59.990710] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-03T18:29:00.173051] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T18:29:00.790707] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-03T18:29:01.590735] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-03T18:29:01.855721] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T18:29:02.390707] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-03T18:29:02.934680] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T18:29:03.190673] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-03T18:29:03.538091] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:29:03.990697] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-03T18:29:04.179248] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:29:04.537217] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T18:29:04.790710] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-03T18:29:05.350064] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:29:05.590683] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-03T18:29:06.300663] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:29:06.390685] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-03T18:29:06.522300] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T18:29:07.190716] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-03T18:29:07.988564] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:29:07.992986] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-03T18:29:08.374738] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:29:08.376537] [INFO ] [REMOTE ] DOUG: Full fetch complete (50991 records). [2025-10-03T18:29:08.376708] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-03T18:29:08.800953] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-03T18:29:08.823252] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-03T18:29:08.823358] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-03T18:29:08.824162] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-03T18:29:08.824278] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-03T18:29:08.826361] [DEBUG] [LOCAL ] DOUG: Trimmed 50991 records to 34792 (keeping 200 days of data) [2025-10-03T18:29:09.032721] [DEBUG] [LOCAL ] DOUG: Primary data saved (34792 records). [2025-10-03T18:29:09.032881] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-03T18:29:09.033037] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOUG took 22.0s. Estimated remaining: 3h 59m 45s. Rate: 7.2 symbols/min [2025-10-03T18:29:09.219946] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:09.277483] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-10-03T18:29:09.277852] [INFO ] [MAIN ] DOW: Loaded 54123 existing records. [2025-10-03T18:29:09.477996] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:09.478305] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-03T18:29:09.478368] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-03T18:29:09.478743] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-03T18:29:09.478802] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-03T18:29:09.592718] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-03T18:29:09.884044] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:09.912628] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T18:29:10.390693] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-03T18:29:10.451471] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:29:11.190688] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-03T18:29:11.604008] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:29:11.990724] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-03T18:29:12.393481] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T18:29:12.486128] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:29:12.790724] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-03T18:29:13.391130] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T18:29:13.393808] [INFO ] [REMOTE ] DOCN: Full fetch complete (71853 records). [2025-10-03T18:29:13.393914] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-03T18:29:13.601796] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-03T18:29:13.823977] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-03T18:29:13.824069] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-03T18:29:13.825023] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-03T18:29:13.825103] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-03T18:29:13.829747] [DEBUG] [LOCAL ] DOCN: Trimmed 71853 records to 51332 (keeping 200 days of data) [2025-10-03T18:29:14.141006] [DEBUG] [LOCAL ] DOCN: Primary data saved (51332 records). [2025-10-03T18:29:14.141172] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-03T18:29:14.141309] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOCN took 27.2s. Estimated remaining: 3h 59m 28s. Rate: 7.2 symbols/min [2025-10-03T18:29:14.345245] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:14.343492] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:29:14.345486] [DEBUG] [LOCAL ] DPG: No existing data file found in primary storage. [2025-10-03T18:29:14.347179] [WARN ] [MAIN ] DPG: No existing data found, performing full refresh instead. [2025-10-03T18:29:14.347808] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-03T18:29:14.347862] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-03T18:29:14.347908] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-03T18:29:14.347941] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-03T18:29:14.348050] [INFO ] [REMOTE ] DOLE: Full fetch complete (53957 records). [2025-10-03T18:29:14.353326] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-03T18:29:14.409596] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-03T18:29:15.129459] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:15.188833] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-03T18:29:15.188957] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-03T18:29:15.189717] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-03T18:29:15.189791] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-03T18:29:15.190672] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-03T18:29:15.192056] [DEBUG] [LOCAL ] DOLE: Trimmed 53957 records to 39011 (keeping 200 days of data) [2025-10-03T18:29:15.438078] [DEBUG] [LOCAL ] DOLE: Primary data saved (39011 records). [2025-10-03T18:29:15.438231] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-03T18:29:15.438327] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOLE took 28.5s. Estimated remaining: 3h 59m 1s. Rate: 7.2 symbols/min [2025-10-03T18:29:15.629045] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:15.665394] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-03T18:29:15.713683] [DEBUG] [LOCAL ] DQ: Loaded 43712 existing records from primary storage. [2025-10-03T18:29:15.714010] [INFO ] [MAIN ] DQ: Loaded 43712 existing records. [2025-10-03T18:29:15.920911] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:15.921136] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-03T18:29:15.921188] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-03T18:29:15.921508] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-03T18:29:15.921567] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-03T18:29:15.997567] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-03T18:29:16.363824] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:16.365685] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:29:16.408158] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T18:29:16.790703] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-03T18:29:17.590731] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-03T18:29:18.286964] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-03T18:29:18.390630] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-03T18:29:18.665956] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:29:19.190692] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-03T18:29:19.246592] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T18:29:19.990686] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-03T18:29:20.015136] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T18:29:20.264045] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:29:20.790697] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-03T18:29:21.528191] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:29:21.590691] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-03T18:29:21.653620] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:29:22.390692] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-03T18:29:23.056903] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T18:29:23.190688] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-03T18:29:23.891738] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T18:29:23.895243] [INFO ] [REMOTE ] DOV: Full fetch complete (64898 records). [2025-10-03T18:29:23.895457] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-03T18:29:23.896621] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:29:23.896776] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:29:23.896858] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:29:23.896959] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-03T18:29:23.897075] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-03T18:29:23.897136] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-10-03T18:29:23.897462] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-10-03T18:29:23.898744] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DOV took 31.8s. Estimated remaining: 3h 58m 53s. Rate: 7.2 symbols/min [2025-10-03T18:29:23.990952] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-03T18:29:24.184449] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:24.185962] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-10-03T18:29:24.187124] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-03T18:29:24.187288] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-10-03T18:29:24.193887] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-03T18:29:24.194092] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-03T18:29:24.194159] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-03T18:29:24.194199] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-03T18:29:24.746954] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:24.790736] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-03T18:29:25.590697] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-03T18:29:25.715408] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:29:26.381744] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-03T18:29:26.395285] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-03T18:29:27.098510] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:29:27.190698] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-03T18:29:27.639742] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:29:27.990714] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-03T18:29:28.790688] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-03T18:29:28.988205] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:29:29.027536] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:29:29.590701] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-03T18:29:29.910205] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:29:30.172048] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:29:30.390676] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-03T18:29:31.190703] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-03T18:29:31.990708] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-03T18:29:32.020688] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:29:32.201224] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:29:32.790696] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-03T18:29:33.590691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-03T18:29:33.726612] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T18:29:34.119716] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:29:34.390704] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-03T18:29:34.487304] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-03T18:29:35.190680] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-03T18:29:35.359320] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:29:35.990730] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-03T18:29:36.732213] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:29:36.733352] [INFO ] [REMOTE ] DPG: Full fetch complete (18997 records). [2025-10-03T18:29:36.733448] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-03T18:29:36.803134] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-03T18:29:37.191771] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-03T18:29:37.191858] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-03T18:29:37.192349] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-03T18:29:37.192415] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-03T18:29:37.193156] [DEBUG] [LOCAL ] DPG: Trimmed 18997 records to 13698 (keeping 200 days of data) [2025-10-03T18:29:37.281545] [DEBUG] [LOCAL ] DPG: Primary data saved (13698 records). [2025-10-03T18:29:37.281737] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-03T18:29:37.281829] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DPG took 23.1s. Estimated remaining: 3h 58m 58s. Rate: 7.2 symbols/min [2025-10-03T18:29:37.477623] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:37.514244] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-03T18:29:37.575276] [DEBUG] [LOCAL ] DRH: Loaded 50844 existing records from primary storage. [2025-10-03T18:29:37.575615] [INFO ] [MAIN ] DRH: Loaded 50844 existing records. [2025-10-03T18:29:37.597159] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-03T18:29:37.773413] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:37.773670] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-03T18:29:37.773745] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-03T18:29:37.775103] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-03T18:29:37.775166] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-03T18:29:38.167199] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:38.390700] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-03T18:29:38.529110] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:29:39.190738] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-03T18:29:39.403379] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:29:39.990709] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-03T18:29:40.140958] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:29:40.790736] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-03T18:29:40.942784] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:29:41.415257] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:29:41.590728] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-03T18:29:42.056236] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:29:42.390705] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-03T18:29:43.190744] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-03T18:29:43.845245] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T18:29:43.879552] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:29:43.990757] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-03T18:29:44.795750] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-03T18:29:44.811134] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:29:45.590722] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-03T18:29:45.924862] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:29:46.198326] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T18:29:46.390691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-03T18:29:47.190730] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-03T18:29:47.398552] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T18:29:47.401702] [INFO ] [REMOTE ] DOW: Full fetch complete (77401 records). [2025-10-03T18:29:47.401881] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-03T18:29:47.402985] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:29:47.403700] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:29:47.403790] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:29:47.403883] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-03T18:29:47.403985] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-10-03T18:29:47.404059] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-10-03T18:29:47.404393] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-10-03T18:29:47.405279] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOW took 38.4s. Estimated remaining: 3h 58m 55s. Rate: 7.2 symbols/min [2025-10-03T18:29:47.616183] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:47.667481] [DEBUG] [LOCAL ] DRI: Loaded 48135 existing records from primary storage. [2025-10-03T18:29:47.667878] [INFO ] [MAIN ] DRI: Loaded 48135 existing records. [2025-10-03T18:29:47.862194] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:47.862504] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-03T18:29:47.862582] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-03T18:29:47.864499] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-03T18:29:47.864616] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-03T18:29:47.991070] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-03T18:29:48.029880] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T18:29:48.292712] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:48.721075] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T18:29:48.790702] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-03T18:29:49.590723] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-03T18:29:49.691518] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:29:50.390632] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-03T18:29:50.440726] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T18:29:51.191392] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-03T18:29:51.191311] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T18:29:51.990717] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-03T18:29:52.610052] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T18:29:52.713268] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T18:29:52.790688] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-03T18:29:53.551090] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T18:29:53.590702] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-03T18:29:54.339749] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:29:54.390638] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-03T18:29:55.197263] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-03T18:29:55.203741] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:29:55.589958] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:29:55.990691] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-03T18:29:56.779411] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:29:56.781870] [INFO ] [REMOTE ] DQ: Full fetch complete (63080 records). [2025-10-03T18:29:56.782002] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-03T18:29:56.796442] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-03T18:29:57.207807] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-03T18:29:57.207917] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-03T18:29:57.209094] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-03T18:29:57.209172] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-03T18:29:57.210737] [DEBUG] [LOCAL ] DQ: Trimmed 63080 records to 44035 (keeping 200 days of data) [2025-10-03T18:29:57.481910] [DEBUG] [LOCAL ] DQ: Primary data saved (44035 records). [2025-10-03T18:29:57.482153] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-03T18:29:57.482361] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DQ took 42.0s. Estimated remaining: 3h 58m 51s. Rate: 7.2 symbols/min [2025-10-03T18:29:57.596703] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-03T18:29:57.711311] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:29:57.713407] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T18:29:57.733737] [DEBUG] [LOCAL ] DRLL: Loaded 9485 existing records from primary storage. [2025-10-03T18:29:57.733976] [INFO ] [MAIN ] DRLL: Loaded 9485 existing records. [2025-10-03T18:29:57.926545] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:29:57.926809] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-03T18:29:57.926860] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-03T18:29:57.927147] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-03T18:29:57.927221] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-03T18:29:58.322369] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:29:58.390701] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-03T18:29:58.438235] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:29:59.047027] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T18:29:59.190627] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-03T18:29:59.575709] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:29:59.990706] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-03T18:30:00.752443] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:30:00.790660] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-03T18:30:01.590741] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-03T18:30:01.865325] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T18:30:02.218331] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T18:30:02.390711] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-03T18:30:03.190693] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-03T18:30:03.317258] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:30:03.319669] [INFO ] [REMOTE ] DRD: Full fetch complete (50036 records). [2025-10-03T18:30:03.319794] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-03T18:30:03.766293] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-03T18:30:03.766420] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-03T18:30:03.767372] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-03T18:30:03.767465] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-03T18:30:03.769297] [DEBUG] [LOCAL ] DRD: Trimmed 50036 records to 37644 (keeping 200 days of data) [2025-10-03T18:30:03.994199] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-03T18:30:04.030156] [DEBUG] [LOCAL ] DRD: Primary data saved (37644 records). [2025-10-03T18:30:04.030332] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-03T18:30:04.030463] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DRD took 40.1s. Estimated remaining: 3h 58m 38s. Rate: 7.2 symbols/min [2025-10-03T18:30:04.230271] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:04.261835] [DEBUG] [LOCAL ] DSL: Loaded 28612 existing records from primary storage. [2025-10-03T18:30:04.262155] [INFO ] [MAIN ] DSL: Loaded 28612 existing records. [2025-10-03T18:30:04.458989] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:04.459377] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-03T18:30:04.459429] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-03T18:30:04.460594] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-03T18:30:04.460684] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-03T18:30:04.665112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T18:30:04.795932] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-03T18:30:04.919511] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:05.071508] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:30:05.325807] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:30:05.590688] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-03T18:30:06.390727] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-03T18:30:06.479045] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:30:06.793985] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-03T18:30:07.190736] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-03T18:30:07.711049] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:30:07.990724] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-03T18:30:08.215631] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:30:08.790707] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-03T18:30:09.590627] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-03T18:30:09.766112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:30:09.897383] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:30:10.390731] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-03T18:30:11.190742] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-03T18:30:11.314905] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:30:11.317466] [INFO ] [REMOTE ] DRH: Full fetch complete (71535 records). [2025-10-03T18:30:11.317612] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-03T18:30:11.318685] [FATAL] [VALIDATOR ] DRH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:30:11.318783] [FATAL] [MAIN ] DRH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:30:11.318828] [WARN ] [MAIN ] DRH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:30:11.318869] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-03T18:30:11.318945] [DEBUG] [LOCAL ] DRH: No primary data file found to delete. [2025-10-03T18:30:11.319070] [INFO ] [LOCAL ] DRH: Starting deletion of derivative data. [2025-10-03T18:30:11.319313] [DEBUG] [LOCAL ] DRH: Deleted derivative data file. [2025-10-03T18:30:11.319428] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRH took 34.0s. Estimated remaining: 3h 58m 27s. Rate: 7.2 symbols/min [2025-10-03T18:30:11.504581] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:11.520706] [DEBUG] [LOCAL ] DSM: Loaded 15196 existing records from primary storage. [2025-10-03T18:30:11.521038] [INFO ] [MAIN ] DSM: Loaded 15196 existing records. [2025-10-03T18:30:11.720909] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:11.721164] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-03T18:30:11.721246] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-03T18:30:11.721988] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-10-03T18:30:11.722051] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-03T18:30:11.992817] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-03T18:30:12.090129] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T18:30:12.174942] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:12.216727] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:30:12.790753] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-03T18:30:13.285865] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:30:13.590730] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-03T18:30:14.390677] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-03T18:30:14.872472] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (2.88 seconds). [2025-10-03T18:30:15.193502] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-03T18:30:15.196357] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:30:15.990774] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-03T18:30:16.614092] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T18:30:16.654434] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T18:30:16.790792] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-03T18:30:17.230096] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-03T18:30:17.590726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-03T18:30:18.382470] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:30:18.385270] [INFO ] [REMOTE ] DRI: Full fetch complete (69594 records). [2025-10-03T18:30:18.385433] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-03T18:30:18.398774] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-03T18:30:18.721660] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:30:18.866952] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-03T18:30:18.867071] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-03T18:30:18.868238] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-03T18:30:18.868306] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-03T18:30:18.869836] [DEBUG] [LOCAL ] DRI: Trimmed 69594 records to 48491 (keeping 200 days of data) [2025-10-03T18:30:19.185303] [DEBUG] [LOCAL ] DRI: Primary data saved (48491 records). [2025-10-03T18:30:19.185451] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-03T18:30:19.186461] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRI took 31.8s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-10-03T18:30:19.197998] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-03T18:30:19.388589] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:19.388883] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-10-03T18:30:19.388941] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-10-03T18:30:19.389054] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-03T18:30:19.389098] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-03T18:30:19.389140] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-03T18:30:19.389173] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-03T18:30:19.699779] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T18:30:19.852745] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:19.990699] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-03T18:30:20.114078] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:30:20.790692] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-03T18:30:21.022977] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:30:21.334305] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T18:30:21.335243] [INFO ] [REMOTE ] DRLL: Full fetch complete (15222 records). [2025-10-03T18:30:21.335318] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-03T18:30:21.335799] [FATAL] [VALIDATOR ] DRLL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:30:21.335889] [FATAL] [MAIN ] DRLL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:30:21.335963] [WARN ] [MAIN ] DRLL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:30:21.336041] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-03T18:30:21.336148] [DEBUG] [LOCAL ] DRLL: No primary data file found to delete. [2025-10-03T18:30:21.336207] [INFO ] [LOCAL ] DRLL: Starting deletion of derivative data. [2025-10-03T18:30:21.336503] [DEBUG] [LOCAL ] DRLL: Deleted derivative data file. [2025-10-03T18:30:21.336636] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DRLL took 23.9s. Estimated remaining: 3h 57m 53s. Rate: 7.2 symbols/min [2025-10-03T18:30:21.527993] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:21.554175] [DEBUG] [LOCAL ] DSU: Loaded 22729 existing records from primary storage. [2025-10-03T18:30:21.554449] [INFO ] [MAIN ] DSU: Loaded 22729 existing records. [2025-10-03T18:30:21.596065] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-03T18:30:21.757594] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:21.757826] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-03T18:30:21.757877] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-03T18:30:21.758165] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-03T18:30:21.758238] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-03T18:30:22.148090] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:22.390689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-03T18:30:22.717695] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T18:30:23.190695] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-03T18:30:23.618209] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-03T18:30:23.724978] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-03T18:30:23.990703] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-03T18:30:24.410460] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:30:24.790699] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-03T18:30:25.590730] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-03T18:30:25.821345] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:30:26.390705] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-03T18:30:26.833016] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:30:26.876183] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T18:30:27.190679] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-03T18:30:27.748821] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T18:30:27.990682] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-03T18:30:28.531799] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:30:28.790684] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-03T18:30:29.590684] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-03T18:30:30.018550] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:30:30.390697] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-03T18:30:30.575089] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-03T18:30:30.820830] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:30:31.190725] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-03T18:30:31.990704] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-03T18:30:32.222418] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T18:30:32.790713] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-03T18:30:33.464218] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:30:33.590699] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-03T18:30:33.986193] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T18:30:34.390698] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-03T18:30:34.410346] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T18:30:35.190682] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-03T18:30:35.212613] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T18:30:35.691854] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T18:30:35.990733] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-03T18:30:36.790703] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-03T18:30:37.354561] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T18:30:37.590691] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-03T18:30:37.894493] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T18:30:38.390622] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-03T18:30:38.467558] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T18:30:39.190706] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-03T18:30:39.530755] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:30:39.990689] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-03T18:30:40.042049] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:30:40.790714] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-03T18:30:41.482381] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:30:41.590727] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-03T18:30:42.081794] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T18:30:42.390741] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-03T18:30:42.427137] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T18:30:42.816823] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T18:30:43.190730] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-03T18:30:43.990702] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-03T18:30:44.032712] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T18:30:44.033856] [INFO ] [REMOTE ] DSM: Full fetch complete (24474 records). [2025-10-03T18:30:44.033939] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-03T18:30:44.433695] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-03T18:30:44.433798] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-03T18:30:44.434324] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-03T18:30:44.434388] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-03T18:30:44.435318] [DEBUG] [LOCAL ] DSM: Trimmed 24474 records to 15256 (keeping 200 days of data) [2025-10-03T18:30:44.526726] [DEBUG] [LOCAL ] DSM: Primary data saved (15256 records). [2025-10-03T18:30:44.526928] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-03T18:30:44.527072] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSM took 33.2s. Estimated remaining: 3h 58m 24s. Rate: 7.2 symbols/min [2025-10-03T18:30:44.769911] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:44.793283] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-03T18:30:44.806976] [DEBUG] [LOCAL ] DSX: Loaded 24147 existing records from primary storage. [2025-10-03T18:30:44.807346] [INFO ] [MAIN ] DSX: Loaded 24147 existing records. [2025-10-03T18:30:44.998787] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:44.999198] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-03T18:30:44.999359] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-03T18:30:44.999771] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-03T18:30:44.999836] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-03T18:30:45.393124] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:30:45.397120] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:45.590748] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-03T18:30:45.863173] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:30:46.219604] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:30:46.390710] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-03T18:30:47.190707] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-03T18:30:47.597525] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:30:47.600923] [INFO ] [REMOTE ] DSL: Full fetch complete (41562 records). [2025-10-03T18:30:47.601206] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-03T18:30:48.005727] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-03T18:30:48.024169] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-03T18:30:48.024276] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-03T18:30:48.025141] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-03T18:30:48.025208] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-03T18:30:48.026573] [DEBUG] [LOCAL ] DSL: Trimmed 41562 records to 28880 (keeping 200 days of data) [2025-10-03T18:30:48.217700] [DEBUG] [LOCAL ] DSL: Primary data saved (28880 records). [2025-10-03T18:30:48.217913] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-03T18:30:48.218023] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DSL took 44.2s. Estimated remaining: 3h 58m 3s. Rate: 7.2 symbols/min [2025-10-03T18:30:48.421576] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:48.423486] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:30:48.497901] [DEBUG] [LOCAL ] DT: Loaded 53316 existing records from primary storage. [2025-10-03T18:30:48.498415] [INFO ] [MAIN ] DT: Loaded 53316 existing records. [2025-10-03T18:30:48.685959] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:48.686311] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-03T18:30:48.686378] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-03T18:30:48.686711] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-03T18:30:48.686775] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-03T18:30:48.793788] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-03T18:30:49.064867] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:49.342269] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-03T18:30:49.590711] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-03T18:30:49.732370] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T18:30:50.095589] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-03T18:30:50.096495] [INFO ] [REMOTE ] DSMC: Full fetch complete (2884 records). [2025-10-03T18:30:50.096578] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-03T18:30:50.399333] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-03T18:30:50.489404] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-10-03T18:30:50.489545] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-10-03T18:30:50.489697] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-10-03T18:30:50.489762] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-10-03T18:30:50.490118] [DEBUG] [LOCAL ] DSMC: Trimmed 2884 records to 1903 (keeping 200 days of data) [2025-10-03T18:30:50.502552] [DEBUG] [LOCAL ] DSMC: Primary data saved (1903 records). [2025-10-03T18:30:50.502661] [INFO ] [MAIN ] DSMC: Full history saved. [2025-10-03T18:30:50.502770] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSMC took 31.3s. Estimated remaining: 3h 57m 39s. Rate: 7.2 symbols/min [2025-10-03T18:30:50.685994] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:30:50.701758] [DEBUG] [LOCAL ] DTB: Loaded 4947 existing records from primary storage. [2025-10-03T18:30:50.702052] [INFO ] [MAIN ] DTB: Loaded 4947 existing records. [2025-10-03T18:30:50.891008] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:30:50.891219] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-03T18:30:50.891268] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-03T18:30:50.891495] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-03T18:30:50.891554] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-03T18:30:51.195901] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-03T18:30:51.284762] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:30:51.609144] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:30:51.990724] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-03T18:30:52.790808] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-03T18:30:53.340877] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T18:30:53.354231] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:30:53.590767] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-03T18:30:53.629390] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T18:30:54.390736] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-03T18:30:54.861349] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T18:30:55.190754] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-03T18:30:55.734475] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:30:55.990747] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-03T18:30:56.578092] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:30:56.790722] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-03T18:30:56.915349] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T18:30:57.155158] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T18:30:57.590719] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-03T18:30:58.205927] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T18:30:58.390701] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-03T18:30:58.939158] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T18:30:59.190725] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-03T18:30:59.783551] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:30:59.990715] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-03T18:31:00.790728] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-03T18:31:01.322846] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T18:31:01.438257] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:31:01.590741] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-03T18:31:02.390724] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-03T18:31:02.668066] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T18:31:03.190720] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-03T18:31:03.211438] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T18:31:03.990685] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-03T18:31:04.530787] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T18:31:04.790723] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-03T18:31:05.010188] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:31:05.590703] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-03T18:31:06.194725] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:31:06.390703] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-03T18:31:06.758845] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:31:06.889489] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-03T18:31:07.190775] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-03T18:31:07.990758] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-03T18:31:08.790679] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-03T18:31:08.993544] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:31:09.217937] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:31:09.367847] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:31:09.369095] [INFO ] [REMOTE ] DTB: Full fetch complete (6824 records). [2025-10-03T18:31:09.369175] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-03T18:31:09.369705] [FATAL] [VALIDATOR ] DTB: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:31:09.369796] [FATAL] [MAIN ] DTB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:09.369843] [WARN ] [MAIN ] DTB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:09.369886] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-03T18:31:09.369970] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-03T18:31:09.370027] [INFO ] [LOCAL ] DTB: Starting deletion of derivative data. [2025-10-03T18:31:09.370269] [DEBUG] [LOCAL ] DTB: Deleted derivative data file. [2025-10-03T18:31:09.370390] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DTB took 18.9s. Estimated remaining: 3h 57m 59s. Rate: 7.2 symbols/min [2025-10-03T18:31:09.581773] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:09.590672] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-03T18:31:09.654951] [DEBUG] [LOCAL ] DTE: Loaded 48040 existing records from primary storage. [2025-10-03T18:31:09.655459] [INFO ] [MAIN ] DTE: Loaded 48040 existing records. [2025-10-03T18:31:09.836048] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:09.836355] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-03T18:31:09.836411] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-03T18:31:09.836837] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-03T18:31:09.836901] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-03T18:31:10.236238] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:10.390764] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-03T18:31:11.190739] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-03T18:31:11.747579] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T18:31:11.762614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T18:31:11.990731] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-03T18:31:12.790634] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-03T18:31:13.010171] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:31:13.131087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:31:13.590728] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-03T18:31:13.952689] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T18:31:13.954440] [INFO ] [REMOTE ] DSU: Full fetch complete (32859 records). [2025-10-03T18:31:13.954520] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-03T18:31:14.365585] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-03T18:31:14.365724] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-03T18:31:14.366574] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-03T18:31:14.366667] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-03T18:31:14.367986] [DEBUG] [LOCAL ] DSU: Trimmed 32859 records to 22916 (keeping 200 days of data) [2025-10-03T18:31:14.430902] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-03T18:31:14.527609] [DEBUG] [LOCAL ] DSU: Primary data saved (22916 records). [2025-10-03T18:31:14.527815] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-03T18:31:14.527921] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DSU took 53.2s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-03T18:31:14.678702] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T18:31:14.740042] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:14.740318] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-03T18:31:14.740358] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-03T18:31:14.740492] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-03T18:31:14.740538] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-03T18:31:14.740582] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-03T18:31:14.740617] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-03T18:31:15.122712] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:15.190688] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-03T18:31:15.990668] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-03T18:31:16.094056] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:31:16.138710] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:31:16.790729] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-03T18:31:16.999881] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:31:17.001320] [INFO ] [REMOTE ] DSX: Full fetch complete (36316 records). [2025-10-03T18:31:17.001410] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-03T18:31:17.002006] [FATAL] [VALIDATOR ] DSX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:31:17.002116] [FATAL] [MAIN ] DSX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:17.002163] [WARN ] [MAIN ] DSX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:17.002233] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-03T18:31:17.002308] [DEBUG] [LOCAL ] DSX: No primary data file found to delete. [2025-10-03T18:31:17.002344] [INFO ] [LOCAL ] DSX: Starting deletion of derivative data. [2025-10-03T18:31:17.002552] [DEBUG] [LOCAL ] DSX: Deleted derivative data file. [2025-10-03T18:31:17.002672] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DSX took 32.5s. Estimated remaining: 3h 57m 18s. Rate: 7.2 symbols/min [2025-10-03T18:31:17.179965] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:17.180264] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-10-03T18:31:17.180321] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-10-03T18:31:17.180452] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-03T18:31:17.180496] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-03T18:31:17.180538] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-03T18:31:17.180572] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-03T18:31:17.572329] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:17.590754] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-03T18:31:18.063251] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:31:18.353857] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:31:18.390669] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-03T18:31:19.190686] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-03T18:31:19.286301] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:31:19.990726] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-03T18:31:20.641910] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:31:20.790636] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-03T18:31:20.980567] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:31:21.227055] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T18:31:21.590697] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-03T18:31:22.215520] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-03T18:31:22.390695] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-03T18:31:23.190774] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-03T18:31:23.786127] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T18:31:23.990777] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-03T18:31:24.340817] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T18:31:24.533876] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:31:24.790710] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-03T18:31:25.221323] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:31:25.590702] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-03T18:31:25.881062] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-03T18:31:26.390754] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-03T18:31:26.762118] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:31:27.190795] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-03T18:31:27.956132] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:31:27.990637] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-03T18:31:28.637974] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:31:28.790735] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-03T18:31:29.476828] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T18:31:29.590715] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-03T18:31:30.390778] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-03T18:31:30.744091] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:31:31.190761] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-03T18:31:31.332417] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:31:31.726272] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T18:31:31.990725] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-03T18:31:32.790681] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-03T18:31:33.564800] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:31:33.590712] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-03T18:31:33.854600] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T18:31:34.262046] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T18:31:34.390740] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-03T18:31:35.182250] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:31:35.190620] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-03T18:31:35.808261] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:31:35.990713] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-03T18:31:36.790695] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-03T18:31:37.408373] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T18:31:37.409263] [INFO ] [REMOTE ] DTF: Full fetch complete (2061 records). [2025-10-03T18:31:37.409390] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-03T18:31:37.598587] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-03T18:31:37.624427] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-03T18:31:37.625662] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:31:37.625849] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:31:37.625931] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-03T18:31:37.626035] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-03T18:31:37.626092] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-03T18:31:37.626171] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-03T18:31:37.626301] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DTF took 23.1s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-03T18:31:37.819745] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:37.820097] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-03T18:31:37.820176] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-03T18:31:37.820329] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-03T18:31:37.820395] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-03T18:31:37.820514] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-03T18:31:37.820743] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-03T18:31:38.171801] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-03T18:31:38.259563] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:38.390714] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-03T18:31:38.596597] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:31:38.597030] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-03T18:31:38.597156] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:31:38.597263] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-03T18:31:38.597339] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:31:38.597420] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-03T18:31:38.597526] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-03T18:31:38.597590] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-03T18:31:38.597721] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-03T18:31:38.597795] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTK took 1.0s. Estimated remaining: 3h 57m 15s. Rate: 7.2 symbols/min [2025-10-03T18:31:38.807405] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:38.862538] [DEBUG] [LOCAL ] DTM: Loaded 44445 existing records from primary storage. [2025-10-03T18:31:38.862890] [INFO ] [MAIN ] DTM: Loaded 44445 existing records. [2025-10-03T18:31:39.082559] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:39.083028] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-03T18:31:39.083084] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-03T18:31:39.083630] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-03T18:31:39.083740] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-03T18:31:39.195831] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-03T18:31:39.505476] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:39.538054] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:31:39.975981] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T18:31:39.976919] [INFO ] [REMOTE ] DTG: Full fetch complete (8949 records). [2025-10-03T18:31:39.977017] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-03T18:31:39.999352] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-03T18:31:40.369074] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-03T18:31:40.369160] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-03T18:31:40.369387] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-03T18:31:40.369426] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-03T18:31:40.369929] [DEBUG] [LOCAL ] DTG: Trimmed 8949 records to 6011 (keeping 200 days of data) [2025-10-03T18:31:40.411041] [DEBUG] [LOCAL ] DTG: Primary data saved (6011 records). [2025-10-03T18:31:40.411197] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-03T18:31:40.411286] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTG took 23.4s. Estimated remaining: 3h 56m 49s. Rate: 7.2 symbols/min [2025-10-03T18:31:40.593280] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:40.604062] [DEBUG] [LOCAL ] DTW: Loaded 4936 existing records from primary storage. [2025-10-03T18:31:40.604269] [INFO ] [MAIN ] DTW: Loaded 4936 existing records. [2025-10-03T18:31:40.806389] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-03T18:31:40.814020] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:40.814325] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-03T18:31:40.814381] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-03T18:31:40.814572] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-03T18:31:40.814631] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-03T18:31:41.231962] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:41.539071] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T18:31:41.590710] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-03T18:31:42.390744] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-03T18:31:42.482997] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:31:42.553619] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T18:31:43.190724] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-03T18:31:43.860993] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T18:31:43.990684] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-03T18:31:44.311564] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:31:44.479829] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:31:44.790703] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-03T18:31:45.427358] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:31:45.590686] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-03T18:31:46.390707] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-03T18:31:47.190733] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-03T18:31:47.529562] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:31:47.784210] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:31:47.813681] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T18:31:47.990709] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-03T18:31:48.790736] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-03T18:31:49.424979] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:31:49.594717] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-03T18:31:49.600272] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:31:50.390716] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-03T18:31:50.983142] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:31:51.190686] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-03T18:31:51.216174] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-03T18:31:51.219798] [INFO ] [REMOTE ] DT: Full fetch complete (76673 records). [2025-10-03T18:31:51.219946] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-03T18:31:51.682732] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-03T18:31:51.682827] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-03T18:31:51.683788] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-03T18:31:51.683858] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-03T18:31:51.685601] [DEBUG] [LOCAL ] DT: Trimmed 76673 records to 53705 (keeping 200 days of data) [2025-10-03T18:31:52.004499] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-03T18:31:52.059862] [DEBUG] [LOCAL ] DT: Primary data saved (53705 records). [2025-10-03T18:31:52.060042] [INFO ] [MAIN ] DT: Full history saved. [2025-10-03T18:31:52.061349] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DT took 1m 4s. Estimated remaining: 3h 56m 50s. Rate: 7.2 symbols/min [2025-10-03T18:31:52.251846] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:31:52.326363] [DEBUG] [LOCAL ] DUK: Loaded 53845 existing records from primary storage. [2025-10-03T18:31:52.326812] [INFO ] [MAIN ] DUK: Loaded 53845 existing records. [2025-10-03T18:31:52.533189] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:31:52.533414] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-03T18:31:52.533463] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-03T18:31:52.533801] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-10-03T18:31:52.533861] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-03T18:31:52.794993] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-03T18:31:52.949019] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:31:52.987420] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T18:31:52.988792] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:31:53.590734] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-03T18:31:54.390668] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-03T18:31:54.507369] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T18:31:55.190635] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-03T18:31:55.301593] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T18:31:55.990683] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-03T18:31:56.153706] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:31:56.617411] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T18:31:56.790699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-03T18:31:56.939776] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:31:57.590698] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-03T18:31:58.390685] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-03T18:31:58.587528] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:31:58.986449] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T18:31:58.988872] [INFO ] [REMOTE ] DTE: Full fetch complete (68899 records). [2025-10-03T18:31:58.988982] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-03T18:31:59.199269] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-03T18:31:59.438770] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-03T18:31:59.438867] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-03T18:31:59.440250] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-03T18:31:59.440355] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-03T18:31:59.442568] [DEBUG] [LOCAL ] DTE: Trimmed 68899 records to 48375 (keeping 200 days of data) [2025-10-03T18:31:59.798491] [DEBUG] [LOCAL ] DTE: Primary data saved (48375 records). [2025-10-03T18:31:59.798682] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-03T18:31:59.799465] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTE took 50.4s. Estimated remaining: 3h 56m 40s. Rate: 7.2 symbols/min [2025-10-03T18:31:59.995627] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-03T18:31:59.988401] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:32:00.038331] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:00.045379] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-03T18:32:00.059159] [DEBUG] [LOCAL ] DUKB: Loaded 6410 existing records from primary storage. [2025-10-03T18:32:00.059421] [INFO ] [MAIN ] DUKB: Loaded 6410 existing records. [2025-10-03T18:32:00.248805] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:00.249050] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-03T18:32:00.249099] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-03T18:32:00.249300] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-10-03T18:32:00.249358] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-03T18:32:00.642562] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:00.790705] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-03T18:32:01.590701] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-03T18:32:01.732693] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T18:32:01.733566] [INFO ] [REMOTE ] DTW: Full fetch complete (7536 records). [2025-10-03T18:32:01.733662] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-03T18:32:01.734136] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:32:01.734239] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:32:01.734289] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:32:01.734384] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-03T18:32:01.734469] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-03T18:32:01.734543] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-03T18:32:01.734834] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-03T18:32:01.734954] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTW took 21.3s. Estimated remaining: 3h 56m 15s. Rate: 7.2 symbols/min [2025-10-03T18:32:01.978014] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:01.980303] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T18:32:02.049280] [DEBUG] [LOCAL ] DV: Loaded 51670 existing records from primary storage. [2025-10-03T18:32:02.049636] [INFO ] [MAIN ] DV: Loaded 51670 existing records. [2025-10-03T18:32:02.244884] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:02.245138] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-03T18:32:02.245207] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-03T18:32:02.245458] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-03T18:32:02.245518] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-03T18:32:02.395802] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-03T18:32:02.647537] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:03.190715] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-03T18:32:03.225616] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:32:03.990731] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-03T18:32:04.790668] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-03T18:32:05.112628] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:32:05.590715] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-03T18:32:05.603298] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T18:32:06.104309] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-03T18:32:06.390675] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-03T18:32:07.153244] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:32:07.190633] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-03T18:32:07.735596] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (5.34 seconds). [2025-10-03T18:32:07.990699] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-03T18:32:08.659457] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T18:32:08.790759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-03T18:32:09.590741] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-03T18:32:09.608137] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T18:32:09.905707] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-10-03T18:32:10.390692] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-03T18:32:10.502378] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-03T18:32:11.190708] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-03T18:32:11.850742] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T18:32:11.990704] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-03T18:32:12.080233] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:32:12.371428] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:32:12.790697] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-03T18:32:12.849962] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:32:13.590686] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-03T18:32:14.390709] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-03T18:32:14.902990] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-03T18:32:15.028516] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T18:32:15.190680] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-03T18:32:15.803495] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T18:32:15.990694] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-03T18:32:16.790699] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-03T18:32:16.932609] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-03T18:32:17.312931] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T18:32:17.315014] [INFO ] [REMOTE ] DTM: Full fetch complete (64494 records). [2025-10-03T18:32:17.315258] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-03T18:32:17.316935] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:32:17.317161] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:32:17.317284] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:32:17.317402] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-03T18:32:17.317513] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-03T18:32:17.317589] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-10-03T18:32:17.317950] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-10-03T18:32:17.318099] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DTM took 38.7s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-03T18:32:17.507592] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:17.547371] [DEBUG] [LOCAL ] DVA: Loaded 41335 existing records from primary storage. [2025-10-03T18:32:17.547689] [INFO ] [MAIN ] DVA: Loaded 41335 existing records. [2025-10-03T18:32:17.595788] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-03T18:32:17.738217] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:17.738452] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-03T18:32:17.738504] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-03T18:32:17.738796] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-03T18:32:17.738864] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-03T18:32:18.150224] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:18.210922] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:32:18.352238] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:32:18.390633] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-03T18:32:19.190734] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-03T18:32:19.990724] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-03T18:32:20.239505] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:32:20.790629] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-03T18:32:21.041626] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:32:21.590672] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-03T18:32:22.346761] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T18:32:22.348627] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T18:32:22.390683] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-03T18:32:22.570366] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:32:23.190719] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-03T18:32:23.990664] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-03T18:32:24.335195] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:32:24.764696] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:32:24.790624] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-03T18:32:25.590673] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-03T18:32:25.707479] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T18:32:26.292798] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-03T18:32:26.390681] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-03T18:32:26.473677] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:32:27.190722] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-03T18:32:27.990723] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-03T18:32:28.232305] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-03T18:32:28.790671] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-03T18:32:28.859835] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:32:28.891841] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:32:29.590673] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-03T18:32:30.044731] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T18:32:30.359809] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:32:30.362412] [INFO ] [REMOTE ] DV: Full fetch complete (73542 records). [2025-10-03T18:32:30.362563] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-03T18:32:30.395782] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-03T18:32:30.793744] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-03T18:32:30.793844] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-03T18:32:30.794688] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-03T18:32:30.794755] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-03T18:32:30.796273] [DEBUG] [LOCAL ] DV: Trimmed 73542 records to 52046 (keeping 200 days of data) [2025-10-03T18:32:31.126334] [DEBUG] [LOCAL ] DV: Primary data saved (52046 records). [2025-10-03T18:32:31.126511] [INFO ] [MAIN ] DV: Full history saved. [2025-10-03T18:32:31.126637] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DV took 29.4s. Estimated remaining: 3h 56m 31s. Rate: 7.2 symbols/min [2025-10-03T18:32:31.200339] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-03T18:32:31.319807] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:31.369751] [DEBUG] [LOCAL ] DVN: Loaded 54089 existing records from primary storage. [2025-10-03T18:32:31.370137] [INFO ] [MAIN ] DVN: Loaded 54089 existing records. [2025-10-03T18:32:31.560683] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:31.560935] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-03T18:32:31.560991] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-03T18:32:31.561214] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-03T18:32:31.561276] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-03T18:32:31.960581] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:31.990689] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-03T18:32:32.372244] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T18:32:32.595338] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:32:32.790617] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-03T18:32:33.022484] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T18:32:33.026051] [INFO ] [REMOTE ] DUK: Full fetch complete (77403 records). [2025-10-03T18:32:33.026187] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-03T18:32:33.463183] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-03T18:32:33.463325] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-03T18:32:33.464384] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-03T18:32:33.464465] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-03T18:32:33.466291] [DEBUG] [LOCAL ] DUK: Trimmed 77403 records to 54233 (keeping 200 days of data) [2025-10-03T18:32:33.590814] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-03T18:32:33.829774] [DEBUG] [LOCAL ] DUK: Primary data saved (54233 records). [2025-10-03T18:32:33.829927] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-03T18:32:33.830766] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 41.8s. Estimated remaining: 3h 56m 9s. Rate: 7.2 symbols/min [2025-10-03T18:32:34.011991] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:34.066006] [DEBUG] [LOCAL ] DX: Loaded 52848 existing records from primary storage. [2025-10-03T18:32:34.066362] [INFO ] [MAIN ] DX: Loaded 52848 existing records. [2025-10-03T18:32:34.248688] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-03T18:32:34.270771] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:34.274525] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-03T18:32:34.275074] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-03T18:32:34.275524] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-03T18:32:34.275601] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-03T18:32:34.394433] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-03T18:32:34.553729] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:32:34.743718] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:35.190741] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-03T18:32:35.990718] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-03T18:32:36.705736] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:32:36.790695] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-03T18:32:36.811824] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T18:32:36.812693] [INFO ] [REMOTE ] DUKB: Full fetch complete (9473 records). [2025-10-03T18:32:36.812837] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-03T18:32:37.186784] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-10-03T18:32:37.273507] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-03T18:32:37.273591] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-03T18:32:37.273850] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-03T18:32:37.273911] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-03T18:32:37.274441] [DEBUG] [LOCAL ] DUKB: Trimmed 9473 records to 6427 (keeping 200 days of data) [2025-10-03T18:32:37.314712] [DEBUG] [LOCAL ] DUKB: Primary data saved (6427 records). [2025-10-03T18:32:37.314853] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-03T18:32:37.314972] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DUKB took 37.5s. Estimated remaining: 3h 55m 48s. Rate: 7.2 symbols/min [2025-10-03T18:32:37.507529] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:37.507764] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-10-03T18:32:37.507813] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-10-03T18:32:37.507936] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-03T18:32:37.507980] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-03T18:32:37.508025] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-03T18:32:37.508061] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-03T18:32:37.595847] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-03T18:32:37.900256] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:38.390634] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-03T18:32:38.721940] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:32:39.190716] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-03T18:32:39.851937] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T18:32:39.935275] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:32:39.990745] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-03T18:32:40.790705] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-03T18:32:40.859291] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:32:41.590747] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-03T18:32:41.955995] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-03T18:32:42.390633] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-03T18:32:42.474962] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T18:32:43.190674] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-03T18:32:43.287635] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T18:32:43.990708] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-03T18:32:44.417669] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:32:44.457367] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T18:32:44.790705] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-03T18:32:45.558074] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:32:45.590673] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-03T18:32:46.390726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-03T18:32:46.896263] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:32:47.190743] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-03T18:32:47.403930] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:32:47.654840] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T18:32:47.657224] [INFO ] [REMOTE ] DVA: Full fetch complete (59859 records). [2025-10-03T18:32:47.657398] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-03T18:32:47.994989] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-03T18:32:48.097731] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-03T18:32:48.097829] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-03T18:32:48.098668] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-03T18:32:48.098736] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-03T18:32:48.100065] [DEBUG] [LOCAL ] DVA: Trimmed 59859 records to 41630 (keeping 200 days of data) [2025-10-03T18:32:48.358634] [DEBUG] [LOCAL ] DVA: Primary data saved (41630 records). [2025-10-03T18:32:48.358795] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-03T18:32:48.358893] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DVA took 31.0s. Estimated remaining: 3h 55m 47s. Rate: 7.2 symbols/min [2025-10-03T18:32:48.565942] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:32:48.604779] [DEBUG] [LOCAL ] DXYZ: Loaded 37235 existing records from primary storage. [2025-10-03T18:32:48.605081] [INFO ] [MAIN ] DXYZ: Loaded 37235 existing records. [2025-10-03T18:32:48.791726] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:32:48.791957] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-03T18:32:48.792209] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-03T18:32:48.793133] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-03T18:32:48.793459] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-03T18:32:48.793518] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-03T18:32:49.177147] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:32:49.213826] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:32:49.590690] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-03T18:32:50.165426] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-03T18:32:50.390707] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-03T18:32:50.468983] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:32:51.190734] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-03T18:32:51.990694] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-03T18:32:52.058577] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-03T18:32:52.257882] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T18:32:52.790706] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-03T18:32:53.099022] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T18:32:53.590697] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-03T18:32:53.638576] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:32:54.390716] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-03T18:32:55.038320] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-10-03T18:32:55.190705] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-03T18:32:55.543830] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T18:32:55.584022] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T18:32:55.990736] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-03T18:32:56.790678] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-03T18:32:57.203624] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-03T18:32:57.305206] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T18:32:57.590732] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-03T18:32:58.402762] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-03T18:32:58.408826] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:32:58.842196] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T18:32:59.190704] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-03T18:32:59.990697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-03T18:33:00.130370] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T18:33:00.790739] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-03T18:33:01.590745] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-03T18:33:02.052068] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-10-03T18:33:02.119720] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:33:02.390698] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-03T18:33:03.190699] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-03T18:33:03.737179] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-03T18:33:03.990683] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-03T18:33:04.118665] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-03T18:33:04.790735] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-03T18:33:05.027692] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:33:05.476505] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (3.09 seconds). [2025-10-03T18:33:05.590723] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-03T18:33:06.390680] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-03T18:33:06.849102] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:33:07.190704] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-03T18:33:07.364401] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (3.37 seconds). [2025-10-03T18:33:07.514012] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-03T18:33:07.990679] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-03T18:33:08.389994] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T18:33:08.790741] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-03T18:33:09.590700] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-03T18:33:10.013421] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:33:10.224671] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-03T18:33:10.228690] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-03T18:33:10.228883] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-03T18:33:10.394165] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-03T18:33:10.600299] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T18:33:10.639680] [INFO ] [REMOTE ] DX: Full fetch complete (75478 records). [2025-10-03T18:33:10.656605] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-03T18:33:10.767749] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-03T18:33:10.808355] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-03T18:33:10.823507] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-03T18:33:10.829508] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-03T18:33:10.906437] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54479 (keeping 200 days of data) [2025-10-03T18:33:11.175460] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:33:11.222768] [INFO ] [REMOTE ] DXC: Full fetch complete (69415 records). [2025-10-03T18:33:11.239120] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-03T18:33:11.326935] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-03T18:33:11.351629] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-03T18:33:11.364875] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-03T18:33:11.378153] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-03T18:33:11.468779] [DEBUG] [LOCAL ] DX: Trimmed 75478 records to 53234 (keeping 200 days of data) [2025-10-03T18:33:12.036611] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-03T18:33:12.037237] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-03T18:33:12.039326] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-03T18:33:12.041115] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-03T18:33:12.050168] [DEBUG] [LOCAL ] DXC: Trimmed 69415 records to 50520 (keeping 200 days of data) [2025-10-03T18:33:12.547516] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-03T18:33:12.625979] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-03T18:33:12.874835] [DEBUG] [LOCAL ] DVN: Primary data saved (54479 records). [2025-10-03T18:33:12.875751] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-03T18:33:12.876471] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DVN took 41.7s. Estimated remaining: 3h 56m 19s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.118822] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.190377] [DEBUG] [LOCAL ] DX: Primary data saved (53234 records). [2025-10-03T18:33:13.194676] [INFO ] [MAIN ] DX: Full history saved. [2025-10-03T18:33:13.194562] [DEBUG] [LOCAL ] DXC: Primary data saved (50520 records). [2025-10-03T18:33:13.194819] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-03T18:33:13.196945] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DX took 39.4s. Estimated remaining: 3h 55m 51s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.197371] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DXC took 35.9s. Estimated remaining: 3h 55m 21s. Rate: 7.2 symbols/min [2025-10-03T18:33:13.440958] [DEBUG] [LOCAL ] DY: Loaded 29225 existing records from primary storage. [2025-10-03T18:33:13.445558] [INFO ] [MAIN ] DY: Loaded 29225 existing records. [2025-10-03T18:33:13.620881] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.702037] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:13.852827] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:13.853306] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-03T18:33:13.853381] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-03T18:33:13.853696] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-03T18:33:13.853782] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-03T18:33:14.055206] [DEBUG] [LOCAL ] EAF: Loaded 42985 existing records from primary storage. [2025-10-03T18:33:14.037195] [DEBUG] [LOCAL ] E: Loaded 33524 existing records from primary storage. [2025-10-03T18:33:14.079729] [INFO ] [MAIN ] E: Loaded 33524 existing records. [2025-10-03T18:33:14.105221] [INFO ] [MAIN ] EAF: Loaded 42985 existing records. [2025-10-03T18:33:14.690310] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:14.720616] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:14.738352] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-03T18:33:14.745125] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:14.745587] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-03T18:33:14.746010] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-03T18:33:14.745809] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-03T18:33:14.747377] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-03T18:33:14.747786] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-03T18:33:14.747852] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-03T18:33:14.747894] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-03T18:33:14.767488] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-03T18:33:15.494779] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:15.513862] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-03T18:33:15.555098] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.93 seconds). [2025-10-03T18:33:15.590692] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:15.598887] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-03T18:33:15.600502] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-03T18:33:16.690837] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:33:16.703147] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-03T18:33:17.305314] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:33:17.313934] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-03T18:33:17.726732] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T18:33:17.737974] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-03T18:33:17.801450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:33:17.809780] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-03T18:33:18.331529] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T18:33:18.390697] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-03T18:33:18.654467] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:33:19.197200] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-03T18:33:19.216937] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T18:33:19.716362] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:33:19.851450] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-03T18:33:19.990690] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-03T18:33:20.550775] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:33:20.790698] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-03T18:33:21.590703] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-03T18:33:21.991078] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T18:33:21.994136] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57779 records). [2025-10-03T18:33:21.994281] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-03T18:33:22.410089] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-03T18:33:22.452350] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-03T18:33:22.455953] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-03T18:33:22.456917] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-03T18:33:22.457417] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-03T18:33:22.458602] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:33:22.469584] [DEBUG] [LOCAL ] DXYZ: Trimmed 57779 records to 37604 (keeping 200 days of data) [2025-10-03T18:33:22.711053] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37604 records). [2025-10-03T18:33:22.711219] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-03T18:33:22.711342] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DXYZ took 34.4s. Estimated remaining: 3h 55m 16s. Rate: 7.2 symbols/min [2025-10-03T18:33:22.903876] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:22.904145] [DEBUG] [LOCAL ] EAI: No existing data file found in primary storage. [2025-10-03T18:33:22.904205] [WARN ] [MAIN ] EAI: No existing data found, performing full refresh instead. [2025-10-03T18:33:22.904321] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-03T18:33:22.904365] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-03T18:33:22.904410] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-03T18:33:22.904444] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-03T18:33:23.194230] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-03T18:33:23.252931] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:33:23.344594] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:23.934520] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T18:33:23.990715] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-03T18:33:24.744274] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:33:24.790715] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-03T18:33:25.590684] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-03T18:33:25.622128] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T18:33:25.656467] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:33:26.390691] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-03T18:33:26.979495] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:33:27.094904] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:33:27.190746] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-03T18:33:27.990708] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-03T18:33:28.800253] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-03T18:33:28.806414] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:33:29.150597] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T18:33:29.275799] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T18:33:29.590733] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-03T18:33:30.390713] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-03T18:33:31.093367] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:33:31.190702] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-03T18:33:31.661127] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:33:31.990732] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-03T18:33:32.594453] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T18:33:32.598787] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:33:32.790715] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-03T18:33:33.549506] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:33:33.590697] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-03T18:33:34.245350] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:33:34.390685] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-03T18:33:34.993560] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:33:35.190722] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-03T18:33:35.990701] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-03T18:33:36.461970] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:33:36.648708] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T18:33:36.790723] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-03T18:33:37.590707] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-03T18:33:38.111851] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:33:38.390736] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-03T18:33:38.999282] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T18:33:39.064070] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:33:39.190729] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-03T18:33:39.990729] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-03T18:33:40.555301] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T18:33:40.587283] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:33:40.790706] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-03T18:33:41.396491] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:33:41.590717] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-03T18:33:42.390723] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-03T18:33:43.190679] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-03T18:33:43.468983] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T18:33:43.470426] [INFO ] [REMOTE ] DY: Full fetch complete (44341 records). [2025-10-03T18:33:43.470509] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-03T18:33:43.735890] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T18:33:43.759600] [INFO ] [REMOTE ] EAI: Full fetch complete (6127 records). [2025-10-03T18:33:43.770991] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-03T18:33:43.821859] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-03T18:33:43.846018] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:33:43.880413] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:33:43.883466] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:33:43.883554] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-03T18:33:43.884007] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-03T18:33:43.889465] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-03T18:33:43.910076] [DEBUG] [LOCAL ] EAI: No derivative data file found to delete. [2025-10-03T18:33:43.910199] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. EAI took 21.2s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-03T18:33:43.990677] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-03T18:33:44.068999] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-03T18:33:44.092517] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-03T18:33:44.097089] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-03T18:33:44.102971] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-03T18:33:44.147131] [DEBUG] [LOCAL ] DY: Trimmed 44341 records to 29368 (keeping 200 days of data) [2025-10-03T18:33:44.175518] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:44.305860] [DEBUG] [LOCAL ] EARN: Loaded 29843 existing records from primary storage. [2025-10-03T18:33:44.307184] [INFO ] [MAIN ] EARN: Loaded 29843 existing records. [2025-10-03T18:33:44.522591] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:44.524292] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-03T18:33:44.525280] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-03T18:33:44.525951] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-03T18:33:44.526032] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-03T18:33:44.798488] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-03T18:33:44.963558] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:44.976238] [DEBUG] [LOCAL ] DY: Primary data saved (29368 records). [2025-10-03T18:33:44.976406] [INFO ] [MAIN ] DY: Full history saved. [2025-10-03T18:33:44.976505] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. DY took 32.1s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-10-03T18:33:45.162612] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:45.210200] [DEBUG] [LOCAL ] EAT: Loaded 50148 existing records from primary storage. [2025-10-03T18:33:45.210562] [INFO ] [MAIN ] EAT: Loaded 50148 existing records. [2025-10-03T18:33:45.403476] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:33:45.403774] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-03T18:33:45.403832] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-03T18:33:45.404067] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-03T18:33:45.404127] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-03T18:33:45.597902] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-03T18:33:45.820899] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:45.814372] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T18:33:46.327455] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T18:33:46.390694] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-03T18:33:47.190634] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-03T18:33:47.445295] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:33:47.720818] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:33:47.990728] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-03T18:33:48.790672] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-03T18:33:49.233578] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-03T18:33:49.312963] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:33:49.590698] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-03T18:33:49.934141] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:33:49.936298] [INFO ] [REMOTE ] E: Full fetch complete (48030 records). [2025-10-03T18:33:49.936409] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-03T18:33:49.937204] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:33:49.937316] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:33:49.937372] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:33:49.937597] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-03T18:33:49.937720] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-10-03T18:33:49.937784] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-10-03T18:33:49.938073] [DEBUG] [LOCAL ] E: Deleted derivative data file. [2025-10-03T18:33:49.938192] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. E took 36.7s. Estimated remaining: 3h 54m 57s. Rate: 7.2 symbols/min [2025-10-03T18:33:50.133837] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:33:50.134029] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-10-03T18:33:50.134084] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-10-03T18:33:50.134201] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-03T18:33:50.134243] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-03T18:33:50.134289] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-03T18:33:50.134322] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-03T18:33:50.399349] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-03T18:33:50.512957] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:33:51.040353] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:33:51.190725] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-03T18:33:51.701727] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:33:51.990705] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-03T18:33:52.790685] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-03T18:33:53.045131] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-03T18:33:53.520763] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:33:53.590742] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-03T18:33:54.390635] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-03T18:33:54.683692] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:33:54.685728] [INFO ] [REMOTE ] EAF: Full fetch complete (63459 records). [2025-10-03T18:33:54.712552] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-03T18:33:54.723573] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T18:33:55.145908] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-03T18:33:55.145996] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-03T18:33:55.146829] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-03T18:33:55.146899] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-03T18:33:55.148368] [DEBUG] [LOCAL ] EAF: Trimmed 63459 records to 43181 (keeping 200 days of data) [2025-10-03T18:33:55.195803] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-03T18:33:55.397805] [DEBUG] [LOCAL ] EAF: Primary data saved (43181 records). [2025-10-03T18:33:55.397941] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-03T18:33:55.398090] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EAF took 42.2s. Estimated remaining: 3h 54m 41s. Rate: 7.2 symbols/min [2025-10-03T18:33:55.796206] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:33:55.990685] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-03T18:33:56.714974] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:33:56.790697] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-03T18:33:57.590742] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-03T18:33:57.798927] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:33:58.242510] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T18:33:58.390702] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-03T18:33:58.861918] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:33:59.190702] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-03T18:33:59.990697] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-03T18:34:00.071286] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:34:00.545251] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:34:00.790685] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-03T18:34:01.590732] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-03T18:34:02.187585] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-03T18:34:02.390671] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-03T18:34:02.498699] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T18:34:02.847783] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:34:03.190707] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-03T18:34:03.990723] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-03T18:34:04.723242] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-03T18:34:04.757035] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:34:04.790747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-03T18:34:05.590751] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-03T18:34:05.647544] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:34:06.390625] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-03T18:34:06.415366] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T18:34:07.190690] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-03T18:34:07.927979] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:34:07.990715] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-03T18:34:08.238815] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-10-03T18:34:08.439458] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T18:34:08.790738] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-03T18:34:09.528995] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T18:34:09.590703] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-03T18:34:10.390699] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-03T18:34:10.518339] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T18:34:10.805767] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:34:10.809311] [INFO ] [REMOTE ] EARN: Full fetch complete (45937 records). [2025-10-03T18:34:10.809440] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-03T18:34:11.204019] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-03T18:34:11.223223] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-03T18:34:11.223299] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-03T18:34:11.224048] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-03T18:34:11.224206] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-03T18:34:11.225522] [DEBUG] [LOCAL ] EARN: Trimmed 45937 records to 30021 (keeping 200 days of data) [2025-10-03T18:34:11.415405] [DEBUG] [LOCAL ] EARN: Primary data saved (30021 records). [2025-10-03T18:34:11.415547] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-03T18:34:11.415687] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EARN took 27.5s. Estimated remaining: 3h 54m 52s. Rate: 7.2 symbols/min [2025-10-03T18:34:11.680266] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:34:11.990685] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-03T18:34:13.197001] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:34:13.211274] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-03T18:34:13.458952] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:34:13.590711] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-03T18:34:14.793810] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T18:34:14.798731] [INFO ] [REMOTE ] EB: Full fetch complete (56095 records). [2025-10-03T18:34:14.798906] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-03T18:34:15.146879] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:34:15.199749] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-03T18:34:15.281122] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-03T18:34:15.281209] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-03T18:34:15.281926] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-03T18:34:15.281993] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-03T18:34:15.283210] [DEBUG] [LOCAL ] EB: Trimmed 56095 records to 37650 (keeping 200 days of data) [2025-10-03T18:34:15.504992] [DEBUG] [LOCAL ] EB: Primary data saved (37650 records). [2025-10-03T18:34:15.505139] [INFO ] [MAIN ] EB: Full history saved. [2025-10-03T18:34:15.505217] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EB took 25.6s. Estimated remaining: 3h 54m 33s. Rate: 7.2 symbols/min [2025-10-03T18:34:17.282943] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-03T18:34:17.294774] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-03T18:34:18.659371] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:34:18.662218] [INFO ] [REMOTE ] EAT: Full fetch complete (71667 records). [2025-10-03T18:34:18.662419] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-03T18:34:18.663449] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:34:18.663612] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:34:18.663717] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:34:18.663842] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-03T18:34:18.663943] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-10-03T18:34:18.663998] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-10-03T18:34:18.664285] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-10-03T18:34:18.664423] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 33.7s. Estimated remaining: 3h 54m 12s. Rate: 7.2 symbols/min [2025-10-03T18:34:19.344001] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.423520] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.466335] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-10-03T18:34:19.467748] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.497742] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:19.478360] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-10-03T18:34:19.499152] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-03T18:34:19.499358] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-03T18:34:19.499521] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-03T18:34:19.499634] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-03T18:34:19.499865] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-03T18:34:19.499971] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-03T18:34:19.500026] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-03T18:34:19.499788] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-03T18:34:19.505320] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-03T18:34:19.523990] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-03T18:34:20.040506] [DEBUG] [LOCAL ] EBR: Loaded 43379 existing records from primary storage. [2025-10-03T18:34:20.158832] [INFO ] [MAIN ] EBR: Loaded 43379 existing records. [2025-10-03T18:34:20.180555] [DEBUG] [LOCAL ] EC: Loaded 49591 existing records from primary storage. [2025-10-03T18:34:20.274592] [INFO ] [MAIN ] EC: Loaded 49591 existing records. [2025-10-03T18:34:20.540423] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:20.586436] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-03T18:34:20.755110] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:20.787796] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-03T18:34:20.781793] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:20.788043] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-03T18:34:20.798845] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-03T18:34:20.804115] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-03T18:34:20.832034] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-03T18:34:20.900001] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:20.952615] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-03T18:34:20.958718] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-03T18:34:20.964249] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-03T18:34:20.986770] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-03T18:34:21.592874] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:21.603638] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-03T18:34:21.669064] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:21.669372] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-03T18:34:22.162637] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:34:22.166604] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-03T18:34:22.365218] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T18:34:22.375320] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-03T18:34:22.817873] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T18:34:22.822091] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-03T18:34:23.472613] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T18:34:23.483731] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-03T18:34:23.503006] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:34:23.508298] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-03T18:34:23.622796] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T18:34:23.632207] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-03T18:34:23.786968] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T18:34:23.990748] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-03T18:34:24.607581] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:34:24.790718] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-03T18:34:24.968964] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:34:25.189704] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:34:25.576505] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:34:25.590621] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-03T18:34:25.856282] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:34:26.390696] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-03T18:34:26.963696] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T18:34:27.190727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-03T18:34:27.990686] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-03T18:34:28.205011] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:34:28.790696] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-03T18:34:28.852731] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:34:29.090954] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:34:29.590743] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-03T18:34:30.149472] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T18:34:30.390720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-03T18:34:31.190703] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-03T18:34:31.442757] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:34:31.991723] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T18:34:31.991800] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-03T18:34:32.231303] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:34:32.790689] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-03T18:34:33.590684] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-03T18:34:33.759800] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:34:34.105847] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T18:34:34.390634] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-03T18:34:34.702530] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T18:34:35.190743] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-03T18:34:35.990782] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-03T18:34:36.253102] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:34:36.797485] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-03T18:34:36.803858] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:34:37.491051] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:34:37.590720] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-03T18:34:37.851068] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T18:34:38.390711] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-03T18:34:39.133563] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:34:39.190713] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-03T18:34:39.990633] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-03T18:34:40.220851] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:34:40.790686] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-03T18:34:40.964834] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:34:41.490281] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:34:41.590739] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-03T18:34:42.390680] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-03T18:34:42.582101] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T18:34:42.628103] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T18:34:43.190729] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-03T18:34:43.990697] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-03T18:34:44.012087] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-03T18:34:44.013824] [INFO ] [REMOTE ] EBF: Full fetch complete (27501 records). [2025-10-03T18:34:44.014024] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-03T18:34:44.500147] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-10-03T18:34:44.500376] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-10-03T18:34:44.501101] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-10-03T18:34:44.501215] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-10-03T18:34:44.503464] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-03T18:34:44.516711] [DEBUG] [LOCAL ] EBF: Trimmed 27501 records to 19506 (keeping 200 days of data) [2025-10-03T18:34:44.641768] [DEBUG] [LOCAL ] EBF: Primary data saved (19506 records). [2025-10-03T18:34:44.641921] [INFO ] [MAIN ] EBF: Full history saved. [2025-10-03T18:34:44.642029] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBF took 26.0s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-10-03T18:34:44.797001] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-03T18:34:44.827254] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:44.827505] [DEBUG] [LOCAL ] ECAT: No existing data file found in primary storage. [2025-10-03T18:34:44.827553] [WARN ] [MAIN ] ECAT: No existing data found, performing full refresh instead. [2025-10-03T18:34:44.827696] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-03T18:34:44.827753] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-03T18:34:44.827799] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-03T18:34:44.827834] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-03T18:34:45.222468] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:45.590632] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-03T18:34:45.829957] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:34:46.390682] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-03T18:34:46.556586] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:34:46.995470] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:34:47.190708] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-03T18:34:47.990634] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-03T18:34:48.188203] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:34:48.790735] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-03T18:34:48.840516] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T18:34:49.223864] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:34:49.590694] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-03T18:34:50.002551] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:34:50.004966] [INFO ] [REMOTE ] EBS: Full fetch complete (67311 records). [2025-10-03T18:34:50.005098] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-03T18:34:50.391677] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-03T18:34:50.433728] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-03T18:34:50.433947] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-03T18:34:50.434896] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-03T18:34:50.435019] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-03T18:34:50.436765] [DEBUG] [LOCAL ] EBS: Trimmed 67311 records to 47245 (keeping 200 days of data) [2025-10-03T18:34:50.712931] [DEBUG] [LOCAL ] EBS: Primary data saved (47245 records). [2025-10-03T18:34:50.713087] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-03T18:34:50.713226] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. EBS took 32.0s. Estimated remaining: 3h 54m 34s. Rate: 7.2 symbols/min [2025-10-03T18:34:50.920038] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T18:34:50.921780] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:50.971349] [DEBUG] [LOCAL ] ECC: Loaded 43668 existing records from primary storage. [2025-10-03T18:34:50.971680] [INFO ] [MAIN ] ECC: Loaded 43668 existing records. [2025-10-03T18:34:51.164072] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:34:51.164337] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-03T18:34:51.164394] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-03T18:34:51.166153] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-03T18:34:51.166221] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-03T18:34:51.198242] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-03T18:34:51.556427] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:51.977605] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:34:51.980144] [INFO ] [REMOTE ] EC: Full fetch complete (71919 records). [2025-10-03T18:34:51.980260] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-03T18:34:51.995759] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-03T18:34:52.439503] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-03T18:34:52.439623] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-03T18:34:52.440623] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-03T18:34:52.440884] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-03T18:34:52.442881] [DEBUG] [LOCAL ] EC: Trimmed 71919 records to 49923 (keeping 200 days of data) [2025-10-03T18:34:52.561433] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T18:34:52.776915] [DEBUG] [LOCAL ] EC: Primary data saved (49923 records). [2025-10-03T18:34:52.777051] [INFO ] [MAIN ] EC: Full history saved. [2025-10-03T18:34:52.777158] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EC took 34.1s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-10-03T18:34:52.799632] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-03T18:34:53.002966] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:53.003144] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-03T18:34:53.003182] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-03T18:34:53.003300] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-03T18:34:53.003342] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-03T18:34:53.003383] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-03T18:34:53.003415] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-03T18:34:53.389062] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:53.590681] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-03T18:34:53.633436] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:34:54.082134] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:34:54.192224] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T18:34:54.390726] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-03T18:34:55.190700] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-03T18:34:55.770855] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:34:55.773248] [INFO ] [REMOTE ] EBR: Full fetch complete (62610 records). [2025-10-03T18:34:55.773346] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-03T18:34:55.998102] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-03T18:34:56.189811] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-03T18:34:56.189906] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-03T18:34:56.190775] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-03T18:34:56.190840] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-03T18:34:56.192172] [DEBUG] [LOCAL ] EBR: Trimmed 62610 records to 43694 (keeping 200 days of data) [2025-10-03T18:34:56.451722] [DEBUG] [LOCAL ] EBR: Primary data saved (43694 records). [2025-10-03T18:34:56.451854] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-03T18:34:56.451938] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EBR took 37.8s. Estimated remaining: 3h 53m 50s. Rate: 7.2 symbols/min [2025-10-03T18:34:56.637488] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:34:56.637675] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-03T18:34:56.637731] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-03T18:34:56.637845] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-03T18:34:56.637889] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-03T18:34:56.637933] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-03T18:34:56.637968] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-03T18:34:56.797952] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-03T18:34:57.031961] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:34:57.050892] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-03T18:34:57.112669] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:34:57.182497] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-03T18:34:57.590688] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-03T18:34:57.973708] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:34:58.390746] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-03T18:34:59.190705] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-03T18:34:59.799888] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:34:59.948456] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:34:59.990632] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-03T18:35:00.790726] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-03T18:35:01.542819] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:35:01.544846] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:35:01.590719] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-03T18:35:02.390762] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-03T18:35:03.190699] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-03T18:35:03.354092] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T18:35:03.770990] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:35:03.875773] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T18:35:03.990691] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-03T18:35:04.790674] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-03T18:35:05.484312] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T18:35:05.590634] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-03T18:35:05.819675] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T18:35:05.945886] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-03T18:35:06.390752] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-03T18:35:07.190632] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-03T18:35:07.656637] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:35:07.990692] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-03T18:35:08.527121] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T18:35:08.790694] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-03T18:35:08.994629] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T18:35:09.590694] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-03T18:35:09.936183] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T18:35:10.176803] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T18:35:10.390708] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-03T18:35:11.027983] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T18:35:11.190700] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-03T18:35:11.626229] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T18:35:11.990713] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-03T18:35:12.790705] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-03T18:35:13.239559] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T18:35:13.421525] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:35:13.590727] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-03T18:35:14.062470] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T18:35:14.390715] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-03T18:35:14.838517] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:35:15.190706] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-03T18:35:15.584564] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:35:15.585317] [INFO ] [REMOTE ] ECCU: Full fetch complete (4487 records). [2025-10-03T18:35:15.585398] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-03T18:35:15.585844] [FATAL] [VALIDATOR ] ECCU: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:35:15.585933] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:15.585979] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:15.586045] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-03T18:35:15.586118] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-03T18:35:15.586157] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-03T18:35:15.586225] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-03T18:35:15.586335] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCU took 19.1s. Estimated remaining: 3h 54m 8s. Rate: 7.2 symbols/min [2025-10-03T18:35:15.773490] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:15.773743] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-03T18:35:15.773796] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-03T18:35:15.773924] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-03T18:35:15.773991] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-03T18:35:15.774047] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-03T18:35:15.774095] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-03T18:35:15.998430] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-03T18:35:16.171892] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:16.791037] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-03T18:35:17.342621] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T18:35:17.590729] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-03T18:35:17.740536] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T18:35:18.025353] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:35:18.390697] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-03T18:35:19.190705] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-03T18:35:19.990720] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-03T18:35:20.321589] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:35:20.357564] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T18:35:20.675698] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:35:20.790722] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-03T18:35:21.447178] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:35:21.590726] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-03T18:35:22.323489] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:35:22.390732] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-03T18:35:23.190731] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-03T18:35:23.586724] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-03T18:35:23.618260] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:35:23.620825] [INFO ] [REMOTE ] ECAT: Full fetch complete (42917 records). [2025-10-03T18:35:23.620974] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-03T18:35:23.995810] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-03T18:35:24.115916] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-10-03T18:35:24.116068] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-10-03T18:35:24.116789] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-10-03T18:35:24.116869] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-10-03T18:35:24.118531] [DEBUG] [LOCAL ] ECAT: Trimmed 42917 records to 29940 (keeping 200 days of data) [2025-10-03T18:35:24.309859] [DEBUG] [LOCAL ] ECAT: Primary data saved (29940 records). [2025-10-03T18:35:24.310006] [INFO ] [MAIN ] ECAT: Full history saved. [2025-10-03T18:35:24.310131] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECAT took 39.7s. Estimated remaining: 3h 54m 1s. Rate: 7.2 symbols/min [2025-10-03T18:35:24.446155] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T18:35:24.508743] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:24.508927] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-03T18:35:24.508984] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-03T18:35:24.509096] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-03T18:35:24.509138] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-03T18:35:24.509179] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-03T18:35:24.509210] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-03T18:35:24.795875] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-03T18:35:24.895955] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:25.078821] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-03T18:35:25.590679] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-03T18:35:26.016374] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T18:35:26.390741] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-03T18:35:26.790970] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-03T18:35:27.190715] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-03T18:35:27.895568] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-03T18:35:27.990729] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-03T18:35:28.507123] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T18:35:28.790749] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-03T18:35:29.136495] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:35:29.590731] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-03T18:35:30.143407] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T18:35:30.144128] [INFO ] [REMOTE ] ECCC: Full fetch complete (1297 records). [2025-10-03T18:35:30.144220] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-03T18:35:30.342076] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T18:35:30.342293] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:30.342366] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:30.342441] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-03T18:35:30.342509] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-03T18:35:30.342548] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-03T18:35:30.342592] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-03T18:35:30.342672] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECCC took 37.6s. Estimated remaining: 3h 53m 47s. Rate: 7.2 symbols/min [2025-10-03T18:35:30.395742] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-03T18:35:30.530893] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:30.568573] [DEBUG] [LOCAL ] ECG: Loaded 34056 existing records from primary storage. [2025-10-03T18:35:30.569054] [INFO ] [MAIN ] ECG: Loaded 34056 existing records. [2025-10-03T18:35:30.764202] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:30.766322] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-03T18:35:30.766861] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-03T18:35:30.767924] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-03T18:35:30.768188] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-03T18:35:30.768273] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-03T18:35:31.170957] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:31.190695] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-03T18:35:31.990727] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-03T18:35:32.512638] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T18:35:32.799155] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-03T18:35:32.804706] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T18:35:33.215631] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T18:35:33.590705] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-03T18:35:34.390721] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-03T18:35:34.802494] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T18:35:35.138617] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T18:35:35.190696] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-03T18:35:35.503872] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-03T18:35:35.990700] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-03T18:35:36.790715] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-03T18:35:37.231095] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T18:35:37.231808] [INFO ] [REMOTE ] ECCW: Full fetch complete (1411 records). [2025-10-03T18:35:37.231879] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-03T18:35:37.422702] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-03T18:35:37.423118] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:37.423244] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:37.423457] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-03T18:35:37.423603] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-03T18:35:37.423734] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-03T18:35:37.423864] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-03T18:35:37.423996] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCW took 21.8s. Estimated remaining: 3h 53m 36s. Rate: 7.2 symbols/min [2025-10-03T18:35:37.596341] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-03T18:35:37.634022] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:37.637058] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:35:37.688716] [DEBUG] [LOCAL ] ECL: Loaded 47096 existing records from primary storage. [2025-10-03T18:35:37.689051] [INFO ] [MAIN ] ECL: Loaded 47096 existing records. [2025-10-03T18:35:37.883740] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:37.883959] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-03T18:35:37.884060] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-03T18:35:37.884381] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-03T18:35:37.884441] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-03T18:35:38.272741] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:38.390768] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-03T18:35:38.937881] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-03T18:35:39.153436] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:35:39.157414] [INFO ] [REMOTE ] ECC: Full fetch complete (61033 records). [2025-10-03T18:35:39.157584] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-03T18:35:39.199068] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-03T18:35:39.598169] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-03T18:35:39.598284] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-03T18:35:39.599255] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-03T18:35:39.599325] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-03T18:35:39.600796] [DEBUG] [LOCAL ] ECC: Trimmed 61033 records to 43966 (keeping 200 days of data) [2025-10-03T18:35:39.690612] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:35:39.874338] [DEBUG] [LOCAL ] ECC: Primary data saved (43966 records). [2025-10-03T18:35:39.874486] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-03T18:35:39.875202] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECC took 49.2s. Estimated remaining: 3h 53m 13s. Rate: 7.2 symbols/min [2025-10-03T18:35:39.995771] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-03T18:35:40.062082] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:40.083389] [DEBUG] [LOCAL ] ECO: Loaded 18558 existing records from primary storage. [2025-10-03T18:35:40.083708] [INFO ] [MAIN ] ECO: Loaded 18558 existing records. [2025-10-03T18:35:40.273307] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:35:40.273543] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-03T18:35:40.273591] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-03T18:35:40.273840] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-03T18:35:40.273898] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-03T18:35:40.389977] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T18:35:40.666173] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:35:40.790659] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-03T18:35:41.142097] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:35:41.590706] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-03T18:35:42.390729] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-03T18:35:42.762383] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T18:35:42.876673] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T18:35:43.190729] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-03T18:35:43.990696] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-03T18:35:44.738477] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:35:44.790673] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-03T18:35:45.590677] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-03T18:35:45.667499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T18:35:46.290278] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:35:46.390736] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-03T18:35:47.119233] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:35:47.190738] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-03T18:35:47.991121] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-03T18:35:47.996257] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:35:48.470045] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:35:48.790749] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-03T18:35:49.590634] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-03T18:35:49.742713] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:35:50.041593] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T18:35:50.193699] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T18:35:50.390703] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-03T18:35:51.190693] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-03T18:35:51.511677] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:35:51.990688] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-03T18:35:52.790632] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-03T18:35:52.986673] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-03T18:35:53.171775] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T18:35:53.590731] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-03T18:35:54.098166] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T18:35:54.274721] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-03T18:35:54.390724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-03T18:35:55.190737] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-03T18:35:55.661804] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T18:35:55.990697] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-03T18:35:56.216489] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T18:35:56.790693] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-03T18:35:57.064875] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:35:57.590702] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-03T18:35:58.390726] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-03T18:35:58.802830] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T18:35:58.847257] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T18:35:59.190685] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-03T18:35:59.561028] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T18:35:59.562331] [INFO ] [REMOTE ] ECCX: Full fetch complete (1506 records). [2025-10-03T18:35:59.562409] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-03T18:35:59.773956] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-03T18:35:59.774363] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:35:59.774567] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:35:59.774785] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-03T18:35:59.774889] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-03T18:35:59.775002] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-03T18:35:59.775158] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-03T18:35:59.775260] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECCX took 35.5s. Estimated remaining: 3h 53m 33s. Rate: 7.2 symbols/min [2025-10-03T18:35:59.971166] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:35:59.993251] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-03T18:35:59.997500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T18:36:00.049548] [DEBUG] [LOCAL ] ECVT: Loaded 43382 existing records from primary storage. [2025-10-03T18:36:00.049993] [INFO ] [MAIN ] ECVT: Loaded 43382 existing records. [2025-10-03T18:36:00.256349] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:00.256598] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-03T18:36:00.256713] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-03T18:36:00.257055] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-03T18:36:00.257116] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-03T18:36:00.638266] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:00.790734] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-03T18:36:01.590691] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-03T18:36:01.812350] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T18:36:02.315596] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:36:02.390670] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-03T18:36:02.606084] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T18:36:03.190683] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-03T18:36:03.703301] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-03T18:36:03.990712] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-03T18:36:04.790686] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-03T18:36:04.843918] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:36:05.064072] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:36:05.066087] [INFO ] [REMOTE ] ECG: Full fetch complete (51312 records). [2025-10-03T18:36:05.066183] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-03T18:36:05.496049] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-03T18:36:05.496183] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-03T18:36:05.496993] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-03T18:36:05.497075] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-03T18:36:05.498307] [DEBUG] [LOCAL ] ECG: Trimmed 51312 records to 34260 (keeping 200 days of data) [2025-10-03T18:36:05.592889] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-03T18:36:05.718570] [DEBUG] [LOCAL ] ECG: Primary data saved (34260 records). [2025-10-03T18:36:05.718754] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-03T18:36:05.718941] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECG took 35.4s. Estimated remaining: 3h 53m 19s. Rate: 7.2 symbols/min [2025-10-03T18:36:05.897182] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:05.956783] [DEBUG] [LOCAL ] ED: Loaded 53131 existing records from primary storage. [2025-10-03T18:36:05.957132] [INFO ] [MAIN ] ED: Loaded 53131 existing records. [2025-10-03T18:36:06.185810] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:06.186081] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-03T18:36:06.186231] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-03T18:36:06.188741] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-03T18:36:06.188811] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-03T18:36:06.395794] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-03T18:36:06.700121] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:06.737876] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-03T18:36:06.767313] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:36:07.190724] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-03T18:36:07.813624] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:36:07.990668] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-03T18:36:08.790633] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-03T18:36:08.957017] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:36:09.020736] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:36:09.590708] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-03T18:36:10.390685] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-03T18:36:10.925528] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T18:36:11.190715] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-03T18:36:11.310852] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T18:36:11.695106] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T18:36:11.990716] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-03T18:36:12.790736] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-03T18:36:13.007298] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T18:36:13.590700] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-03T18:36:13.777553] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:36:14.306359] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:36:14.390731] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-03T18:36:15.190742] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-03T18:36:15.397437] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:36:15.400891] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:36:15.411390] [INFO ] [REMOTE ] ECO: Full fetch complete (28865 records). [2025-10-03T18:36:15.412182] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-03T18:36:15.820288] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-03T18:36:15.820372] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-03T18:36:15.820908] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-03T18:36:15.820982] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-03T18:36:15.821854] [DEBUG] [LOCAL ] ECO: Trimmed 28865 records to 18643 (keeping 200 days of data) [2025-10-03T18:36:15.943968] [DEBUG] [LOCAL ] ECO: Primary data saved (18643 records). [2025-10-03T18:36:15.944128] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-03T18:36:15.944222] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECO took 36.1s. Estimated remaining: 3h 53m 15s. Rate: 7.2 symbols/min [2025-10-03T18:36:15.995885] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-03T18:36:16.134101] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:16.163931] [DEBUG] [LOCAL ] EDD: Loaded 27357 existing records from primary storage. [2025-10-03T18:36:16.164263] [INFO ] [MAIN ] EDD: Loaded 27357 existing records. [2025-10-03T18:36:16.387217] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:16.387435] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-03T18:36:16.387486] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-03T18:36:16.388166] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-03T18:36:16.388234] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-03T18:36:16.792452] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-03T18:36:16.792375] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:17.024207] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:36:17.590671] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-03T18:36:17.940447] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T18:36:18.163506] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:36:18.170045] [INFO ] [REMOTE ] ECL: Full fetch complete (68040 records). [2025-10-03T18:36:18.170199] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-03T18:36:18.398786] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-03T18:36:18.601782] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-03T18:36:18.601906] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-03T18:36:18.602796] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-03T18:36:18.602864] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-03T18:36:18.604307] [DEBUG] [LOCAL ] ECL: Trimmed 68040 records to 47436 (keeping 200 days of data) [2025-10-03T18:36:18.927823] [DEBUG] [LOCAL ] ECL: Primary data saved (47436 records). [2025-10-03T18:36:18.927976] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-03T18:36:18.928064] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 41.5s. Estimated remaining: 3h 52m 53s. Rate: 7.2 symbols/min [2025-10-03T18:36:19.119882] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:19.134342] [DEBUG] [LOCAL ] EDF: Loaded 13420 existing records from primary storage. [2025-10-03T18:36:19.134662] [INFO ] [MAIN ] EDF: Loaded 13420 existing records. [2025-10-03T18:36:19.194409] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-03T18:36:19.337526] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:19.337984] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-03T18:36:19.338140] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-03T18:36:19.338968] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-03T18:36:19.339105] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-03T18:36:19.749545] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T18:36:19.783361] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:19.990699] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-03T18:36:20.071388] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:36:20.790700] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-03T18:36:20.935136] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:36:21.590737] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-03T18:36:21.942215] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:36:22.174923] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:36:22.313596] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T18:36:22.390699] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-03T18:36:23.190705] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-03T18:36:23.917942] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T18:36:23.990670] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-03T18:36:24.209039] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T18:36:24.790710] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-03T18:36:25.475365] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T18:36:25.520142] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:36:25.590690] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-03T18:36:26.390733] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-03T18:36:26.871345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T18:36:27.190719] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-03T18:36:27.844881] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T18:36:27.847411] [INFO ] [REMOTE ] ECVT: Full fetch complete (60268 records). [2025-10-03T18:36:27.847542] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-03T18:36:27.995928] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-03T18:36:28.337692] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-03T18:36:28.337850] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-03T18:36:28.338815] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-03T18:36:28.338885] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-03T18:36:28.341127] [DEBUG] [LOCAL ] ECVT: Trimmed 60268 records to 43747 (keeping 200 days of data) [2025-10-03T18:36:28.610972] [DEBUG] [LOCAL ] ECVT: Primary data saved (43747 records). [2025-10-03T18:36:28.611120] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-03T18:36:28.613555] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. ECVT took 28.8s. Estimated remaining: 3h 52m 48s. Rate: 7.2 symbols/min [2025-10-03T18:36:28.796724] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-03T18:36:28.809111] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:28.834995] [DEBUG] [LOCAL ] EDN: Loaded 18336 existing records from primary storage. [2025-10-03T18:36:28.835256] [INFO ] [MAIN ] EDN: Loaded 18336 existing records. [2025-10-03T18:36:29.038826] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:29.039505] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-03T18:36:29.039599] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-03T18:36:29.040409] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-03T18:36:29.040556] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-03T18:36:29.373546] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-03T18:36:29.400889] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:36:29.521029] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:29.590634] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-03T18:36:29.856228] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:36:30.390693] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-03T18:36:31.190632] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-03T18:36:31.395112] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:36:31.830300] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:36:31.990738] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-03T18:36:32.602427] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:36:32.790709] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-03T18:36:33.070982] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:36:33.590711] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-03T18:36:34.190510] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:36:34.390698] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-03T18:36:34.518696] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T18:36:35.190670] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-03T18:36:35.990669] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-03T18:36:36.252602] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T18:36:36.490859] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:36:36.790715] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-03T18:36:36.864096] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:36:37.590726] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-03T18:36:38.390660] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-03T18:36:38.537099] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:36:38.564539] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T18:36:39.190701] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-03T18:36:39.534029] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:36:39.990680] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-03T18:36:40.302469] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:36:40.790723] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-03T18:36:41.051768] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:36:41.590674] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-03T18:36:41.738113] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:36:42.390686] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-03T18:36:42.757547] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:36:43.190688] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-03T18:36:43.627916] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:36:43.990711] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-03T18:36:44.083334] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T18:36:44.790720] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-03T18:36:45.485203] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:36:45.590721] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-03T18:36:46.390672] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-03T18:36:46.552791] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:36:46.806252] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T18:36:47.190634] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-03T18:36:47.663589] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T18:36:47.990711] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-03T18:36:48.773063] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:36:48.775828] [INFO ] [REMOTE ] ED: Full fetch complete (76323 records). [2025-10-03T18:36:48.775982] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-03T18:36:48.799146] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-03T18:36:49.195268] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:36:49.220455] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-03T18:36:49.224530] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-03T18:36:49.225572] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-03T18:36:49.226211] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-03T18:36:49.227789] [DEBUG] [LOCAL ] ED: Trimmed 76323 records to 53511 (keeping 200 days of data) [2025-10-03T18:36:49.579709] [DEBUG] [LOCAL ] ED: Primary data saved (53511 records). [2025-10-03T18:36:49.579854] [INFO ] [MAIN ] ED: Full history saved. [2025-10-03T18:36:49.579943] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. ED took 43.9s. Estimated remaining: 3h 53m 11s. Rate: 7.2 symbols/min [2025-10-03T18:36:49.597691] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-03T18:36:49.774404] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:49.817804] [DEBUG] [LOCAL ] EDU: Loaded 45267 existing records from primary storage. [2025-10-03T18:36:49.818150] [INFO ] [MAIN ] EDU: Loaded 45267 existing records. [2025-10-03T18:36:50.018623] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:50.019013] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-03T18:36:50.019077] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-03T18:36:50.025444] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-03T18:36:50.037203] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-03T18:36:50.038048] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T18:36:50.401593] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-03T18:36:50.447031] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:50.713041] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T18:36:51.190690] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-03T18:36:51.631548] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:36:51.990715] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-03T18:36:52.164485] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:36:52.790700] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-03T18:36:52.939981] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:36:52.941414] [INFO ] [REMOTE ] EDN: Full fetch complete (30027 records). [2025-10-03T18:36:52.941491] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-03T18:36:53.366592] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-03T18:36:53.366716] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-03T18:36:53.367299] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-03T18:36:53.367367] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-03T18:36:53.368346] [DEBUG] [LOCAL ] EDN: Trimmed 30027 records to 18464 (keeping 200 days of data) [2025-10-03T18:36:53.479380] [DEBUG] [LOCAL ] EDN: Primary data saved (18464 records). [2025-10-03T18:36:53.479539] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-03T18:36:53.479669] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDN took 24.9s. Estimated remaining: 3h 52m 51s. Rate: 7.2 symbols/min [2025-10-03T18:36:53.597187] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-03T18:36:53.673500] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:53.710976] [DEBUG] [LOCAL ] EE: Loaded 32660 existing records from primary storage. [2025-10-03T18:36:53.711330] [INFO ] [MAIN ] EE: Loaded 32660 existing records. [2025-10-03T18:36:53.904214] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:36:53.932722] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:36:53.934951] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-03T18:36:53.935068] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-03T18:36:53.935690] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-03T18:36:53.935780] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-03T18:36:53.945368] [INFO ] [REMOTE ] EDD: Full fetch complete (38855 records). [2025-10-03T18:36:54.022715] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-03T18:36:54.399682] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-03T18:36:54.730040] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:54.801389] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-03T18:36:54.801469] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-03T18:36:54.802137] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-03T18:36:54.802202] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-03T18:36:54.803116] [DEBUG] [LOCAL ] EDD: Trimmed 38855 records to 27540 (keeping 200 days of data) [2025-10-03T18:36:54.973183] [DEBUG] [LOCAL ] EDD: Primary data saved (27540 records). [2025-10-03T18:36:54.973330] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-03T18:36:54.973457] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDD took 39.0s. Estimated remaining: 3h 52m 27s. Rate: 7.2 symbols/min [2025-10-03T18:36:55.157345] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:55.157592] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-03T18:36:55.157850] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-03T18:36:55.158108] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-03T18:36:55.158158] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-03T18:36:55.158202] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-03T18:36:55.158234] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-03T18:36:55.203575] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-03T18:36:55.409168] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:36:55.451018] [INFO ] [REMOTE ] EDF: Full fetch complete (20806 records). [2025-10-03T18:36:55.470824] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-03T18:36:55.626415] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:55.763664] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-03T18:36:56.006224] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-03T18:36:56.053753] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-03T18:36:56.053837] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-03T18:36:56.054263] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-03T18:36:56.054305] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-03T18:36:56.054943] [DEBUG] [LOCAL ] EDF: Trimmed 20806 records to 13491 (keeping 200 days of data) [2025-10-03T18:36:56.145167] [DEBUG] [LOCAL ] EDF: Primary data saved (13491 records). [2025-10-03T18:36:56.145312] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-03T18:36:56.145420] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. EDF took 37.2s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-10-03T18:36:56.335927] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:36:56.336050] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-03T18:36:56.336087] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-03T18:36:56.336171] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-03T18:36:56.336211] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-03T18:36:56.336252] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-03T18:36:56.336284] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-03T18:36:56.751240] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:36:56.756308] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T18:36:56.776359] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T18:36:56.790603] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-03T18:36:57.590634] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-03T18:36:58.025675] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:36:58.077196] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T18:36:58.390688] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-03T18:36:58.915637] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-03T18:36:59.190732] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-03T18:36:59.769985] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T18:36:59.990737] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-03T18:37:00.790715] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-03T18:37:01.464161] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-03T18:37:01.590690] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-03T18:37:01.948213] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T18:37:02.390633] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-03T18:37:02.715735] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T18:37:03.190680] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-03T18:37:03.990665] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-03T18:37:04.087632] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:37:04.118687] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T18:37:04.455529] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T18:37:04.790706] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-03T18:37:05.262027] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-03T18:37:05.590691] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-03T18:37:06.157948] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T18:37:06.390693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-03T18:37:07.190687] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-03T18:37:07.839324] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T18:37:07.910598] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:37:07.990679] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-03T18:37:08.315942] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T18:37:08.790693] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-03T18:37:09.256399] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T18:37:09.257143] [INFO ] [REMOTE ] EEA: Full fetch complete (3902 records). [2025-10-03T18:37:09.257233] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-03T18:37:09.486336] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:37:09.486596] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:09.486718] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:09.486797] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-03T18:37:09.486866] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-03T18:37:09.486935] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-03T18:37:09.486996] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-03T18:37:09.487109] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EEA took 14.5s. Estimated remaining: 3h 52m 5s. Rate: 7.2 symbols/min [2025-10-03T18:37:09.599209] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-03T18:37:09.681797] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:09.729272] [DEBUG] [LOCAL ] EFC: Loaded 46536 existing records from primary storage. [2025-10-03T18:37:09.729634] [INFO ] [MAIN ] EFC: Loaded 46536 existing records. [2025-10-03T18:37:09.925428] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:09.925735] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-03T18:37:09.925788] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-03T18:37:09.926068] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-03T18:37:09.926156] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-03T18:37:10.297315] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:10.390680] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-03T18:37:10.981711] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:37:11.190710] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-03T18:37:11.990630] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-03T18:37:12.281882] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T18:37:12.417616] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:37:12.790697] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-03T18:37:13.285629] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:37:13.590680] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-03T18:37:13.703884] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T18:37:14.390735] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-03T18:37:15.098852] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T18:37:15.190706] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-03T18:37:15.986532] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-03T18:37:15.991684] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-03T18:37:16.790718] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-03T18:37:17.401563] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:37:17.422423] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T18:37:17.590676] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-03T18:37:17.830596] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:37:18.239825] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:37:18.390727] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-03T18:37:19.161898] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T18:37:19.190682] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-03T18:37:19.990709] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-03T18:37:20.345214] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T18:37:20.790685] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-03T18:37:21.590723] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-03T18:37:22.343772] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:37:22.390693] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-03T18:37:22.429012] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-03T18:37:23.190703] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-03T18:37:23.434533] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T18:37:23.967828] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T18:37:23.990705] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-03T18:37:24.080685] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-03T18:37:24.790684] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-03T18:37:25.211525] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:37:25.485064] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T18:37:25.590688] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-03T18:37:26.390698] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-03T18:37:26.601836] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T18:37:26.603305] [INFO ] [REMOTE ] EE: Full fetch complete (43461 records). [2025-10-03T18:37:26.603380] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-03T18:37:26.604087] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:37:26.604179] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:26.604225] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:26.604298] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-03T18:37:26.604364] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-10-03T18:37:26.604419] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-10-03T18:37:26.604834] [DEBUG] [LOCAL ] EE: Deleted derivative data file. [2025-10-03T18:37:26.604972] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EE took 33.1s. Estimated remaining: 3h 52m 17s. Rate: 7.2 symbols/min [2025-10-03T18:37:26.794436] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:26.814165] [DEBUG] [LOCAL ] EFR: Loaded 14752 existing records from primary storage. [2025-10-03T18:37:26.814410] [INFO ] [MAIN ] EFR: Loaded 14752 existing records. [2025-10-03T18:37:26.970775] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T18:37:26.992617] [INFO ] [REMOTE ] EEX: Full fetch complete (19136 records). [2025-10-03T18:37:27.016036] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:27.016145] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-03T18:37:27.016460] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-03T18:37:27.016587] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-03T18:37:27.017053] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:37:27.017180] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:37:27.017260] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:37:27.017340] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-03T18:37:27.017409] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-03T18:37:27.017462] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-03T18:37:27.017521] [DEBUG] [LOCAL ] EEX: No derivative data file found to delete. [2025-10-03T18:37:27.017683] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-03T18:37:27.017614] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EEX took 30.9s. Estimated remaining: 3h 51m 50s. Rate: 7.2 symbols/min [2025-10-03T18:37:27.017860] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-03T18:37:27.198307] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-03T18:37:27.400116] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:27.579992] [DEBUG] [LOCAL ] EFT: Loaded 13189 existing records from primary storage. [2025-10-03T18:37:27.591905] [INFO ] [MAIN ] EFT: Loaded 13189 existing records. [2025-10-03T18:37:27.614841] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:27.803829] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:27.804054] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-03T18:37:27.804101] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-03T18:37:27.805243] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-03T18:37:27.805304] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-03T18:37:27.995770] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-03T18:37:28.179785] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:28.490589] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:37:28.790730] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-03T18:37:29.584818] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:37:29.593874] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-03T18:37:30.390702] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-03T18:37:30.478343] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:37:30.931998] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:37:31.190724] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-03T18:37:31.990710] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-03T18:37:32.051682] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:37:32.658612] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:37:32.790623] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-03T18:37:33.103198] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T18:37:33.546041] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T18:37:33.590703] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-03T18:37:34.390746] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-03T18:37:35.195713] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-03T18:37:35.212448] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T18:37:35.583596] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:37:35.990726] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-03T18:37:36.205737] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T18:37:36.790741] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-03T18:37:37.590681] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-03T18:37:37.654491] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T18:37:38.384394] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T18:37:38.390611] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-03T18:37:38.487714] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T18:37:39.179070] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:37:39.190634] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-03T18:37:39.990686] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-03T18:37:40.719386] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:37:40.790687] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-03T18:37:40.960016] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T18:37:41.590738] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-03T18:37:42.245755] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:37:42.249090] [INFO ] [REMOTE ] EDU: Full fetch complete (66457 records). [2025-10-03T18:37:42.249211] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-03T18:37:42.395821] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-03T18:37:42.690183] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-03T18:37:42.690305] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-03T18:37:42.691208] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-03T18:37:42.691282] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-03T18:37:42.692703] [DEBUG] [LOCAL ] EDU: Trimmed 66457 records to 45595 (keeping 200 days of data) [2025-10-03T18:37:42.972810] [DEBUG] [LOCAL ] EDU: Primary data saved (45595 records). [2025-10-03T18:37:42.972951] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-03T18:37:42.973061] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EDU took 53.4s. Estimated remaining: 3h 52m 0s. Rate: 7.2 symbols/min [2025-10-03T18:37:43.166992] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:43.192820] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-03T18:37:43.214321] [DEBUG] [LOCAL ] EFX: Loaded 44908 existing records from primary storage. [2025-10-03T18:37:43.214703] [INFO ] [MAIN ] EFX: Loaded 44908 existing records. [2025-10-03T18:37:43.435298] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:43.459382] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-03T18:37:43.464873] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-03T18:37:43.475250] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T18:37:43.476391] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-03T18:37:43.476169] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T18:37:43.476563] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-03T18:37:43.904470] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:43.990683] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-03T18:37:44.069088] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:37:44.790746] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-03T18:37:45.341308] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:37:45.590721] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-03T18:37:45.632255] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T18:37:46.190600] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:37:46.390693] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-03T18:37:47.190711] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-03T18:37:47.392705] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:37:47.990707] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-03T18:37:48.790674] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-03T18:37:48.993824] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:37:49.058609] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:37:49.590693] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-03T18:37:50.157464] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:37:50.390693] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-03T18:37:51.190694] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-03T18:37:51.328609] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T18:37:51.331016] [INFO ] [REMOTE ] EFC: Full fetch complete (66542 records). [2025-10-03T18:37:51.331169] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-03T18:37:51.851870] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-03T18:37:51.851977] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-03T18:37:51.852925] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-03T18:37:51.853005] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-03T18:37:51.854951] [DEBUG] [LOCAL ] EFC: Trimmed 66542 records to 46894 (keeping 200 days of data) [2025-10-03T18:37:51.991410] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-03T18:37:52.160684] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-03T18:37:52.162524] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T18:37:52.262555] [DEBUG] [LOCAL ] EFC: Primary data saved (46894 records). [2025-10-03T18:37:52.262750] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-03T18:37:52.263537] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFC took 42.8s. Estimated remaining: 3h 51m 54s. Rate: 7.2 symbols/min [2025-10-03T18:37:52.475543] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:52.475777] [DEBUG] [LOCAL ] EFXT: No existing data file found in primary storage. [2025-10-03T18:37:52.475835] [WARN ] [MAIN ] EFXT: No existing data found, performing full refresh instead. [2025-10-03T18:37:52.475958] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-03T18:37:52.476006] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-03T18:37:52.476106] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-03T18:37:52.476186] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-03T18:37:52.795907] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-03T18:37:52.909787] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:53.062681] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T18:37:53.590691] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-03T18:37:54.390624] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-03T18:37:54.590782] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:37:54.670812] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:37:55.190725] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-03T18:37:55.995718] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-03T18:37:55.999990] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:37:56.790629] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-03T18:37:57.050188] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:37:57.050691] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T18:37:57.498868] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T18:37:57.500133] [INFO ] [REMOTE ] EFR: Full fetch complete (19042 records). [2025-10-03T18:37:57.500210] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-03T18:37:57.595780] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-03T18:37:57.907416] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-03T18:37:57.907537] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-03T18:37:57.908044] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-03T18:37:57.908112] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-03T18:37:57.908797] [DEBUG] [LOCAL ] EFR: Trimmed 19042 records to 14886 (keeping 200 days of data) [2025-10-03T18:37:58.000854] [DEBUG] [LOCAL ] EFR: Primary data saved (14886 records). [2025-10-03T18:37:58.001018] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-03T18:37:58.001154] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 31.4s. Estimated remaining: 3h 51m 39s. Rate: 7.2 symbols/min [2025-10-03T18:37:58.182806] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:37:58.212389] [DEBUG] [LOCAL ] EG: Loaded 28356 existing records from primary storage. [2025-10-03T18:37:58.212707] [INFO ] [MAIN ] EG: Loaded 28356 existing records. [2025-10-03T18:37:58.400488] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-03T18:37:58.407060] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:37:58.408133] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-03T18:37:58.408191] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-03T18:37:58.408418] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-03T18:37:58.408476] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-03T18:37:58.697586] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:37:58.835715] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:37:59.190704] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-03T18:37:59.951238] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T18:37:59.990693] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-03T18:38:00.790732] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-03T18:38:00.838633] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:38:01.450588] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:38:01.590713] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-03T18:38:02.390703] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-03T18:38:02.448503] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:38:03.149157] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:38:03.190631] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-03T18:38:03.671098] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T18:38:03.990685] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-03T18:38:04.568675] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:38:04.790689] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-03T18:38:05.305502] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T18:38:05.590685] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-03T18:38:05.900797] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:38:06.390685] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-03T18:38:07.190683] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-03T18:38:07.214325] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:38:07.990722] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-03T18:38:08.171526] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:38:08.696637] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:38:08.790685] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-03T18:38:08.973059] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T18:38:09.590731] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-03T18:38:10.390715] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-03T18:38:10.460473] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:38:10.507293] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T18:38:11.190720] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-03T18:38:11.990723] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-03T18:38:12.067041] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T18:38:12.727755] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-03T18:38:12.729193] [INFO ] [REMOTE ] EFT: Full fetch complete (17971 records). [2025-10-03T18:38:12.729283] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-03T18:38:12.796734] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-03T18:38:12.939087] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:38:13.170716] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-03T18:38:13.170805] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-03T18:38:13.171196] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-03T18:38:13.171236] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-03T18:38:13.171820] [DEBUG] [LOCAL ] EFT: Trimmed 17971 records to 13268 (keeping 200 days of data) [2025-10-03T18:38:13.255740] [DEBUG] [LOCAL ] EFT: Primary data saved (13268 records). [2025-10-03T18:38:13.255888] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-03T18:38:13.255993] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EFT took 46.2s. Estimated remaining: 3h 51m 47s. Rate: 7.2 symbols/min [2025-10-03T18:38:13.443843] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:13.504143] [DEBUG] [LOCAL ] EGO: Loaded 51982 existing records from primary storage. [2025-10-03T18:38:13.504546] [INFO ] [MAIN ] EGO: Loaded 51982 existing records. [2025-10-03T18:38:13.595836] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-03T18:38:13.700396] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:13.700624] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-03T18:38:13.700723] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-03T18:38:13.701071] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-03T18:38:13.701142] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-03T18:38:14.107824] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:14.390674] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-03T18:38:14.464445] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:38:14.469578] [INFO ] [REMOTE ] EFX: Full fetch complete (64208 records). [2025-10-03T18:38:14.469787] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-03T18:38:14.470723] [FATAL] [VALIDATOR ] EFX: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:38:14.470822] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:38:14.470867] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:38:14.470908] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-03T18:38:14.470996] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-10-03T18:38:14.471055] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-10-03T18:38:14.471320] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-10-03T18:38:14.471448] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 31.5s. Estimated remaining: 3h 51m 22s. Rate: 7.2 symbols/min [2025-10-03T18:38:14.661016] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:14.702554] [DEBUG] [LOCAL ] EGP: Loaded 31092 existing records from primary storage. [2025-10-03T18:38:14.702866] [INFO ] [MAIN ] EGP: Loaded 31092 existing records. [2025-10-03T18:38:14.895552] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:14.895770] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-03T18:38:14.895839] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-03T18:38:14.896518] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-03T18:38:14.896579] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-03T18:38:15.033715] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T18:38:15.198612] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-03T18:38:15.312451] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:15.990634] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-03T18:38:16.089215] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T18:38:16.568010] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:38:16.790694] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-03T18:38:17.519446] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:38:17.590672] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-03T18:38:18.311468] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:38:18.390726] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-03T18:38:19.077804] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:38:19.190637] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-03T18:38:19.513205] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:38:19.990729] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-03T18:38:20.765049] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T18:38:20.790635] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-03T18:38:21.355490] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:38:21.590706] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-03T18:38:22.392968] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-03T18:38:22.398964] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:38:22.464148] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T18:38:23.190704] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-03T18:38:23.777952] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:38:23.990711] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-03T18:38:24.790728] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-03T18:38:25.165871] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:38:25.184028] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T18:38:25.186097] [INFO ] [REMOTE ] EFXT: Full fetch complete (44187 records). [2025-10-03T18:38:25.186185] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-03T18:38:25.597123] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-03T18:38:25.616977] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-03T18:38:25.617063] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-03T18:38:25.617790] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-03T18:38:25.617966] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-03T18:38:25.619048] [DEBUG] [LOCAL ] EFXT: Trimmed 44187 records to 29657 (keeping 200 days of data) [2025-10-03T18:38:25.804968] [DEBUG] [LOCAL ] EFXT: Primary data saved (29657 records). [2025-10-03T18:38:25.805133] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-03T18:38:25.805241] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 33.5s. Estimated remaining: 3h 51m 21s. Rate: 7.2 symbols/min [2025-10-03T18:38:25.986831] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:26.037502] [DEBUG] [LOCAL ] EGY: Loaded 42435 existing records from primary storage. [2025-10-03T18:38:26.037883] [INFO ] [MAIN ] EGY: Loaded 42435 existing records. [2025-10-03T18:38:26.275148] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:26.275610] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-03T18:38:26.275723] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-03T18:38:26.276398] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-03T18:38:26.276480] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-03T18:38:26.401629] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-03T18:38:26.439816] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:38:26.701241] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:27.091554] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:38:27.190743] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-03T18:38:27.653196] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T18:38:27.990742] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-03T18:38:28.790750] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-03T18:38:28.977878] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:38:29.590674] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-03T18:38:29.660360] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T18:38:30.048708] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-03T18:38:30.390694] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-03T18:38:31.154811] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:38:31.190631] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-03T18:38:31.533603] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:38:31.535356] [INFO ] [REMOTE ] EG: Full fetch complete (43510 records). [2025-10-03T18:38:31.535540] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-03T18:38:31.966783] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-03T18:38:31.966875] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-03T18:38:31.967563] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-03T18:38:31.967683] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-03T18:38:31.968783] [DEBUG] [LOCAL ] EG: Trimmed 43510 records to 28480 (keeping 200 days of data) [2025-10-03T18:38:32.030744] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-03T18:38:32.161355] [DEBUG] [LOCAL ] EG: Primary data saved (28480 records). [2025-10-03T18:38:32.161495] [INFO ] [MAIN ] EG: Full history saved. [2025-10-03T18:38:32.161578] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EG took 34.2s. Estimated remaining: 3h 51m 8s. Rate: 7.2 symbols/min [2025-10-03T18:38:32.353041] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:32.384506] [DEBUG] [LOCAL ] EHAB: Loaded 29810 existing records from primary storage. [2025-10-03T18:38:32.384828] [INFO ] [MAIN ] EHAB: Loaded 29810 existing records. [2025-10-03T18:38:32.592311] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:32.592545] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-03T18:38:32.592594] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-03T18:38:32.592928] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-03T18:38:32.592990] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-03T18:38:32.797090] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-03T18:38:32.951088] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T18:38:33.061595] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:33.590672] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-03T18:38:33.744550] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T18:38:34.403582] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-03T18:38:34.407134] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:38:34.984332] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:38:35.190730] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-03T18:38:35.660638] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T18:38:35.990705] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-03T18:38:36.584324] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T18:38:36.790703] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-03T18:38:37.590676] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-03T18:38:37.826043] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T18:38:37.884702] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T18:38:38.390685] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-03T18:38:38.820306] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T18:38:39.190705] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-03T18:38:39.990677] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-03T18:38:40.142951] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T18:38:40.790630] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-03T18:38:40.820930] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T18:38:40.907128] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T18:38:41.590709] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-03T18:38:42.277845] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T18:38:42.390736] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-03T18:38:43.171493] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:38:43.190621] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-03T18:38:43.990761] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-03T18:38:44.225462] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-03T18:38:44.497888] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T18:38:44.500720] [INFO ] [REMOTE ] EGO: Full fetch complete (73742 records). [2025-10-03T18:38:44.500867] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-03T18:38:44.795793] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-03T18:38:44.946160] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-03T18:38:44.946255] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-03T18:38:44.947205] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-03T18:38:44.947278] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-03T18:38:44.949117] [DEBUG] [LOCAL ] EGO: Trimmed 73742 records to 52369 (keeping 200 days of data) [2025-10-03T18:38:45.269407] [DEBUG] [LOCAL ] EGO: Primary data saved (52369 records). [2025-10-03T18:38:45.269547] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-03T18:38:45.269631] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGO took 32.0s. Estimated remaining: 3h 51m 11s. Rate: 7.2 symbols/min [2025-10-03T18:38:45.467599] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:45.487587] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:38:45.533841] [DEBUG] [LOCAL ] EHC: Loaded 41398 existing records from primary storage. [2025-10-03T18:38:45.534167] [INFO ] [MAIN ] EHC: Loaded 41398 existing records. [2025-10-03T18:38:45.600596] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-03T18:38:45.727821] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:45.728037] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-03T18:38:45.728088] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-03T18:38:45.729413] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-03T18:38:45.729476] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-03T18:38:46.106969] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:46.390693] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-03T18:38:46.429902] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:38:47.190631] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-03T18:38:47.217265] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T18:38:47.657735] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:38:47.990734] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-03T18:38:48.752759] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T18:38:48.790626] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-03T18:38:49.115241] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:38:49.116924] [INFO ] [REMOTE ] EGP: Full fetch complete (45450 records). [2025-10-03T18:38:49.117016] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-03T18:38:49.541255] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-03T18:38:49.541337] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-03T18:38:49.541963] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-03T18:38:49.542027] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-03T18:38:49.543167] [DEBUG] [LOCAL ] EGP: Trimmed 45450 records to 31284 (keeping 200 days of data) [2025-10-03T18:38:49.606591] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-03T18:38:49.755746] [DEBUG] [LOCAL ] EGP: Primary data saved (31284 records). [2025-10-03T18:38:49.755888] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-03T18:38:49.755974] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EGP took 35.3s. Estimated remaining: 3h 50m 53s. Rate: 7.2 symbols/min [2025-10-03T18:38:49.955782] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:49.968153] [DEBUG] [LOCAL ] EHI: Loaded 10681 existing records from primary storage. [2025-10-03T18:38:49.968398] [INFO ] [MAIN ] EHI: Loaded 10681 existing records. [2025-10-03T18:38:50.181319] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:50.181542] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-03T18:38:50.181589] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-03T18:38:50.181803] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-03T18:38:50.181862] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-03T18:38:50.396311] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-03T18:38:50.531851] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:38:50.623068] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:51.099872] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:38:51.190668] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-03T18:38:51.990669] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-03T18:38:52.228489] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:38:52.431338] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T18:38:52.790683] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-03T18:38:53.495834] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:38:53.590694] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-03T18:38:53.726778] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T18:38:54.390709] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-03T18:38:55.065003] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T18:38:55.190718] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-03T18:38:55.294960] [DEBUG] [REMOTE ] EGY: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T18:38:55.295288] [WARN ] [REMOTE ] EGY: No data returned for month 2025-08 [2025-10-03T18:38:55.295382] [FATAL] [REMOTE ] EGY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:38:55.295517] [FATAL] [MAIN ] EGY: Failed to fetch primary data. [2025-10-03T18:38:55.295592] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:38:55.295703] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-03T18:38:55.295781] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-03T18:38:55.295822] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-03T18:38:55.296056] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-03T18:38:55.296582] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 29.5s. Estimated remaining: 3h 50m 38s. Rate: 7.2 symbols/min [2025-10-03T18:38:55.489869] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:38:55.515688] [DEBUG] [LOCAL ] EIC: Loaded 23651 existing records from primary storage. [2025-10-03T18:38:55.516030] [INFO ] [MAIN ] EIC: Loaded 23651 existing records. [2025-10-03T18:38:55.724953] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:38:55.725280] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-03T18:38:55.725483] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-03T18:38:55.741620] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-10-03T18:38:55.742174] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-03T18:38:55.742920] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-03T18:38:55.995713] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-03T18:38:56.155717] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:38:56.790690] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-03T18:38:56.963040] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T18:38:57.590698] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-03T18:38:58.194362] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:38:58.390690] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-03T18:38:58.867476] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T18:38:59.190721] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-03T18:38:59.558616] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-03T18:38:59.990695] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-03T18:39:00.557529] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:39:00.761313] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-03T18:39:00.790717] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-03T18:39:01.590698] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-03T18:39:02.390685] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-03T18:39:02.893864] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T18:39:03.031544] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-03T18:39:03.034296] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:39:03.190735] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-03T18:39:03.990638] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-03T18:39:04.454409] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T18:39:04.790676] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-03T18:39:05.066492] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:39:05.590626] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-03T18:39:05.663266] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:39:06.390685] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-03T18:39:07.106241] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:39:07.190692] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-03T18:39:07.246277] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T18:39:07.947459] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T18:39:07.990585] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-03T18:39:08.790714] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-03T18:39:09.031386] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T18:39:09.032964] [INFO ] [REMOTE ] EHAB: Full fetch complete (41057 records). [2025-10-03T18:39:09.033087] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-03T18:39:09.427558] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-03T18:39:09.427716] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-03T18:39:09.428395] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-03T18:39:09.428471] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-03T18:39:09.429683] [DEBUG] [LOCAL ] EHAB: Trimmed 41057 records to 29954 (keeping 200 days of data) [2025-10-03T18:39:09.593707] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-03T18:39:09.603175] [DEBUG] [LOCAL ] EHAB: Primary data saved (29954 records). [2025-10-03T18:39:09.604051] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-03T18:39:09.604156] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHAB took 37.4s. Estimated remaining: 3h 50m 44s. Rate: 7.2 symbols/min [2025-10-03T18:39:09.790305] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:09.790530] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-03T18:39:09.790571] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-03T18:39:09.790753] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-03T18:39:09.790795] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-03T18:39:09.790839] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-03T18:39:09.791106] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-03T18:39:10.235704] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:10.237552] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T18:39:10.390715] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-03T18:39:11.010330] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:39:11.190722] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-03T18:39:11.235096] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:39:11.990713] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-03T18:39:12.535894] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-03T18:39:12.790744] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-03T18:39:12.992525] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:39:13.590687] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-03T18:39:14.005251] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:39:14.390714] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-03T18:39:14.884832] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T18:39:15.190687] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-03T18:39:15.282493] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T18:39:15.530567] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:39:15.990690] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-03T18:39:16.790756] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-03T18:39:17.080216] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T18:39:17.590711] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-03T18:39:18.246773] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:39:18.329280] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:39:18.390740] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-03T18:39:19.190732] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-03T18:39:19.990702] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-03T18:39:20.282983] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:39:20.549263] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T18:39:20.790705] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-03T18:39:21.253066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T18:39:21.388139] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-03T18:39:21.390532] [INFO ] [REMOTE ] EHC: Full fetch complete (58926 records). [2025-10-03T18:39:21.390766] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-03T18:39:21.596453] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-03T18:39:21.828663] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-03T18:39:21.828763] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-03T18:39:21.829505] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-03T18:39:21.829553] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-03T18:39:21.830945] [DEBUG] [LOCAL ] EHC: Trimmed 58926 records to 41700 (keeping 200 days of data) [2025-10-03T18:39:22.115323] [DEBUG] [LOCAL ] EHC: Primary data saved (41700 records). [2025-10-03T18:39:22.115509] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-03T18:39:22.115638] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHC took 36.8s. Estimated remaining: 3h 50m 45s. Rate: 7.2 symbols/min [2025-10-03T18:39:22.300814] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:22.300986] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-03T18:39:22.301028] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-03T18:39:22.301149] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-03T18:39:22.301192] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-03T18:39:22.301235] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-03T18:39:22.301289] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-03T18:39:22.395873] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-03T18:39:22.707405] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:22.883798] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:39:22.959290] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:39:23.190718] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-03T18:39:23.597391] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T18:39:23.990725] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-03T18:39:24.340257] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-03T18:39:24.790691] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-03T18:39:25.369778] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-03T18:39:25.590724] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-03T18:39:26.390690] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-03T18:39:26.670042] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:39:26.809213] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T18:39:27.190725] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-03T18:39:27.575447] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-03T18:39:27.990714] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-03T18:39:28.325801] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T18:39:28.790692] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-03T18:39:29.590738] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-03T18:39:29.724123] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:39:29.968601] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T18:39:29.969314] [INFO ] [REMOTE ] EICA: Full fetch complete (1297 records). [2025-10-03T18:39:29.969428] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-03T18:39:30.171141] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-10-03T18:39:30.171420] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:30.171515] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:30.171604] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-03T18:39:30.171729] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-03T18:39:30.171800] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-03T18:39:30.171862] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-03T18:39:30.171959] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EICA took 20.6s. Estimated remaining: 3h 50m 36s. Rate: 7.2 symbols/min [2025-10-03T18:39:30.357699] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:30.357913] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-03T18:39:30.357970] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-03T18:39:30.358085] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-03T18:39:30.358130] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-03T18:39:30.358172] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-03T18:39:30.358205] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-03T18:39:30.395727] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-03T18:39:30.752480] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:30.881948] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T18:39:31.190718] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-03T18:39:31.990711] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-03T18:39:32.270035] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T18:39:32.667781] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T18:39:32.790721] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-03T18:39:33.205180] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T18:39:33.590741] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-03T18:39:34.013808] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-03T18:39:34.390727] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-03T18:39:34.821111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:39:35.190710] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-03T18:39:35.990704] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-03T18:39:36.262481] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:39:36.263821] [INFO ] [REMOTE ] EIC: Full fetch complete (34806 records). [2025-10-03T18:39:36.263929] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-03T18:39:36.698296] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-03T18:39:36.698465] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-03T18:39:36.699102] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-03T18:39:36.699168] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-03T18:39:36.700104] [DEBUG] [LOCAL ] EIC: Trimmed 34806 records to 23785 (keeping 200 days of data) [2025-10-03T18:39:36.793204] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-03T18:39:36.862160] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T18:39:36.870957] [DEBUG] [LOCAL ] EIC: Primary data saved (23785 records). [2025-10-03T18:39:36.871112] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-03T18:39:36.871205] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EIC took 41.6s. Estimated remaining: 3h 50m 24s. Rate: 7.2 symbols/min [2025-10-03T18:39:37.055972] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:37.078356] [DEBUG] [LOCAL ] EIG: Loaded 20444 existing records from primary storage. [2025-10-03T18:39:37.078698] [INFO ] [MAIN ] EIG: Loaded 20444 existing records. [2025-10-03T18:39:37.196231] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-03T18:39:37.277558] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:39:37.277825] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-03T18:39:37.277918] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-03T18:39:37.278193] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-03T18:39:37.278255] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-03T18:39:37.594992] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-03T18:39:37.680111] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:38.191357] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:39:38.390715] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-03T18:39:38.852081] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-03T18:39:39.190730] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-03T18:39:39.631807] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:39:39.990703] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-03T18:39:40.638922] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T18:39:40.790676] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-03T18:39:41.590712] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-03T18:39:41.855895] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T18:39:41.857450] [INFO ] [REMOTE ] EHI: Full fetch complete (16327 records). [2025-10-03T18:39:41.857555] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-03T18:39:41.984313] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:39:41.996294] [INFO ] [REMOTE ] EICB: Full fetch complete (2730 records). [2025-10-03T18:39:42.006736] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-03T18:39:42.393167] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-03T18:39:42.498165] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T18:39:42.519212] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:42.519315] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:42.519380] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-03T18:39:42.519488] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-03T18:39:42.530980] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-03T18:39:42.531145] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-03T18:39:42.531315] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-03T18:39:42.531993] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-03T18:39:42.532125] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-03T18:39:42.531488] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-03T18:39:42.532469] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 20.4s. Estimated remaining: 3h 50m 9s. Rate: 7.2 symbols/min [2025-10-03T18:39:42.533321] [DEBUG] [LOCAL ] EHI: Trimmed 16327 records to 10783 (keeping 200 days of data) [2025-10-03T18:39:42.774186] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:39:42.790997] [DEBUG] [LOCAL ] EHI: Primary data saved (10783 records). [2025-10-03T18:39:42.791173] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-03T18:39:42.791283] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EHI took 53.0s. Estimated remaining: 3h 49m 42s. Rate: 7.2 symbols/min [2025-10-03T18:39:42.839257] [DEBUG] [LOCAL ] EIX: Loaded 53730 existing records from primary storage. [2025-10-03T18:39:42.839677] [INFO ] [MAIN ] EIX: Loaded 53730 existing records. [2025-10-03T18:39:43.032548] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:39:43.032840] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-03T18:39:43.032895] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-03T18:39:43.033454] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-03T18:39:43.033515] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-03T18:39:43.152954] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:39:43.197591] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-03T18:39:43.435391] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:39:43.905398] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T18:39:43.990694] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-03T18:39:44.790716] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-03T18:39:45.387036] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:39:45.590696] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-03T18:39:45.842757] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:39:46.046856] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T18:39:46.390714] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-03T18:39:47.190692] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-03T18:39:47.734410] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:39:47.990703] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-03T18:39:48.681246] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-03T18:39:48.790689] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-03T18:39:49.163398] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-03T18:39:49.212867] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-03T18:39:49.590699] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-03T18:39:50.390697] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-03T18:39:50.496873] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T18:39:51.190744] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-03T18:39:51.906026] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T18:39:51.990733] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-03T18:39:52.234730] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T18:39:52.790669] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-03T18:39:53.004462] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T18:39:53.590737] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-03T18:39:54.193930] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:39:54.194832] [INFO ] [REMOTE ] EICC: Full fetch complete (8265 records). [2025-10-03T18:39:54.194902] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-03T18:39:54.195343] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:39:54.195431] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:39:54.195475] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:39:54.195515] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-03T18:39:54.195571] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-03T18:39:54.195608] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-03T18:39:54.195689] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-03T18:39:54.195797] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EICC took 24.0s. Estimated remaining: 3h 49m 41s. Rate: 7.2 symbols/min [2025-10-03T18:39:54.390712] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-03T18:39:54.654883] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T18:39:55.190745] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-03T18:39:55.528750] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T18:39:55.990754] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-03T18:39:57.137797] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:39:57.166437] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-03T18:39:57.168625] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T18:39:57.590734] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-03T18:39:58.964109] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T18:39:58.970281] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-03T18:39:59.129965] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:39:59.190689] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-03T18:40:00.013269] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:40:00.018061] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-03T18:40:01.172604] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-03T18:40:01.177967] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-03T18:40:01.244887] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-03T18:40:01.590704] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-03T18:40:02.437937] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T18:40:02.446982] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-03T18:40:03.801365] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-03T18:40:03.814722] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-03T18:40:03.834588] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T18:40:03.990691] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-03T18:40:05.104599] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T18:40:05.106125] [INFO ] [REMOTE ] EIG: Full fetch complete (27131 records). [2025-10-03T18:40:05.106221] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-03T18:40:05.507016] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-03T18:40:05.507105] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-03T18:40:05.507674] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-03T18:40:05.507741] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-03T18:40:05.508624] [DEBUG] [LOCAL ] EIG: Trimmed 27131 records to 20583 (keeping 200 days of data) [2025-10-03T18:40:05.634171] [DEBUG] [LOCAL ] EIG: Primary data saved (20583 records). [2025-10-03T18:40:05.634299] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-03T18:40:05.634404] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIG took 28.8s. Estimated remaining: 3h 49m 40s. Rate: 7.2 symbols/min [2025-10-03T18:40:06.010186] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T18:40:06.022297] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-03T18:40:08.029994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T18:40:08.042194] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-03T18:40:09.763542] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:40:09.766243] [INFO ] [REMOTE ] EIX: Full fetch complete (77038 records). [2025-10-03T18:40:09.766366] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-03T18:40:10.193785] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-03T18:40:10.193873] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-03T18:40:10.194864] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-03T18:40:10.194933] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-03T18:40:10.196613] [DEBUG] [LOCAL ] EIX: Trimmed 77038 records to 54120 (keeping 200 days of data) [2025-10-03T18:40:10.534774] [DEBUG] [LOCAL ] EIX: Primary data saved (54120 records). [2025-10-03T18:40:10.534922] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-03T18:40:10.535013] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EIX took 28.0s. Estimated remaining: 3h 49m 24s. Rate: 7.2 symbols/min [2025-10-03T18:40:11.142322] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.342374] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.362430] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.357670] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:11.373559] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-10-03T18:40:11.373993] [INFO ] [MAIN ] ELC: Loaded 3504 existing records. [2025-10-03T18:40:11.638085] [DEBUG] [LOCAL ] EL: Loaded 53778 existing records from primary storage. [2025-10-03T18:40:11.682807] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:11.686439] [DEBUG] [LOCAL ] ELF: Loaded 52560 existing records from primary storage. [2025-10-03T18:40:11.685101] [INFO ] [MAIN ] EL: Loaded 53778 existing records. [2025-10-03T18:40:11.685322] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-03T18:40:11.692713] [DEBUG] [LOCAL ] ELAN: Loaded 53643 existing records from primary storage. [2025-10-03T18:40:11.699741] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-03T18:40:11.705342] [INFO ] [MAIN ] ELF: Loaded 52560 existing records. [2025-10-03T18:40:11.711763] [INFO ] [MAIN ] ELAN: Loaded 53643 existing records. [2025-10-03T18:40:11.747005] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-03T18:40:11.774008] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-03T18:40:12.430594] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.451445] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.480532] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.474592] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:12.491787] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.502293] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-03T18:40:12.474728] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-03T18:40:12.507578] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-03T18:40:12.524790] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-03T18:40:12.575597] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-03T18:40:12.588936] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-03T18:40:12.588642] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-03T18:40:12.594217] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-03T18:40:12.631033] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-03T18:40:12.655215] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-03T18:40:13.337407] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:13.418350] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-03T18:40:13.934193] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:13.957155] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-03T18:40:13.968299] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:14.001703] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-03T18:40:14.039729] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:14.040840] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-03T18:40:14.501117] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T18:40:14.503005] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-03T18:40:15.092743] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T18:40:15.094259] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-03T18:40:15.548247] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T18:40:15.549834] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-03T18:40:15.959876] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T18:40:15.971554] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-03T18:40:16.290370] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-03T18:40:16.301939] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-03T18:40:16.308458] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-03T18:40:16.309955] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-03T18:40:16.346763] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T18:40:16.359019] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-03T18:40:16.720918] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-03T18:40:16.722618] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-03T18:40:17.284134] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:40:17.285805] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-03T18:40:17.579842] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T18:40:17.591628] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-03T18:40:17.852886] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:40:17.854870] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-03T18:40:17.959101] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:40:18.053451] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:40:18.227224] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-03T18:40:18.390737] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-03T18:40:19.190629] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-03T18:40:19.239114] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:40:19.990611] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-03T18:40:20.504636] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T18:40:20.790701] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-03T18:40:21.342524] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T18:40:21.403353] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T18:40:21.590722] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-03T18:40:21.742039] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:40:22.390704] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-03T18:40:22.954893] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:40:23.190700] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-03T18:40:23.571363] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T18:40:23.673454] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:40:23.674235] [INFO ] [REMOTE ] ELC: Full fetch complete (5088 records). [2025-10-03T18:40:23.674307] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-03T18:40:23.674740] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:40:23.674826] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:40:23.674885] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:40:23.674987] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-03T18:40:23.675070] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-10-03T18:40:23.675110] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-10-03T18:40:23.675414] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-10-03T18:40:23.675519] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 13.1s. Estimated remaining: 3h 49m 26s. Rate: 7.2 symbols/min [2025-10-03T18:40:23.875639] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:23.928124] [DEBUG] [LOCAL ] ELME: Loaded 39517 existing records from primary storage. [2025-10-03T18:40:23.928438] [INFO ] [MAIN ] ELME: Loaded 39517 existing records. [2025-10-03T18:40:23.995759] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-03T18:40:24.145894] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:24.146131] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-03T18:40:24.146184] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-03T18:40:24.146548] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-03T18:40:24.146608] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-03T18:40:24.548564] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:24.790741] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-03T18:40:25.590732] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-03T18:40:26.121061] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-03T18:40:26.390726] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-03T18:40:27.189210] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-03T18:40:27.193630] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-03T18:40:27.282436] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T18:40:27.848350] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T18:40:27.990722] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-03T18:40:28.790697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-03T18:40:29.397682] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-03T18:40:29.590718] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-03T18:40:29.663735] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:40:30.190691] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:40:30.390697] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-03T18:40:31.190720] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-03T18:40:31.710764] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T18:40:31.934077] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T18:40:31.990731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-03T18:40:32.790721] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-03T18:40:33.172316] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T18:40:33.550969] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:40:33.590730] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-03T18:40:34.390691] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-03T18:40:34.546612] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:40:35.170385] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T18:40:35.190677] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-03T18:40:35.990622] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-03T18:40:36.488032] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-03T18:40:36.611450] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T18:40:36.790702] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-03T18:40:37.590716] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-03T18:40:37.881285] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:40:38.225064] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T18:40:38.390722] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-03T18:40:39.190731] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-03T18:40:39.829075] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-03T18:40:39.990699] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-03T18:40:40.220369] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:40:40.755257] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T18:40:40.790664] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-03T18:40:41.590628] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-03T18:40:41.909339] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T18:40:42.293829] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:40:42.390703] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-03T18:40:43.190632] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-03T18:40:43.317482] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T18:40:43.990694] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-03T18:40:44.371932] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:40:44.790711] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-03T18:40:45.365377] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T18:40:45.419870] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:40:45.590729] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-03T18:40:46.390731] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-03T18:40:46.517038] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T18:40:46.519793] [INFO ] [REMOTE ] ELF: Full fetch complete (75289 records). [2025-10-03T18:40:46.519952] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-03T18:40:46.965593] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-03T18:40:46.965717] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-03T18:40:46.966718] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-03T18:40:46.966819] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-03T18:40:46.968420] [DEBUG] [LOCAL ] ELF: Trimmed 75289 records to 52899 (keeping 200 days of data) [2025-10-03T18:40:47.191319] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-03T18:40:47.311310] [DEBUG] [LOCAL ] ELF: Primary data saved (52899 records). [2025-10-03T18:40:47.311518] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-03T18:40:47.311778] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELF took 36.8s. Estimated remaining: 3h 49m 53s. Rate: 7.2 symbols/min [2025-10-03T18:40:47.492830] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:47.530697] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T18:40:47.563742] [DEBUG] [LOCAL ] ELP: Loaded 25797 existing records from primary storage. [2025-10-03T18:40:47.564046] [INFO ] [MAIN ] ELP: Loaded 25797 existing records. [2025-10-03T18:40:47.788024] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:47.788314] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-03T18:40:47.788383] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-03T18:40:47.789350] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-03T18:40:47.789429] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-03T18:40:47.998832] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-03T18:40:48.300767] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:48.400065] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T18:40:48.655116] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T18:40:48.658619] [INFO ] [REMOTE ] ELME: Full fetch complete (56095 records). [2025-10-03T18:40:48.658848] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-03T18:40:48.795819] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-03T18:40:49.179867] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-03T18:40:49.179996] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-03T18:40:49.180871] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-03T18:40:49.180946] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-03T18:40:49.182278] [DEBUG] [LOCAL ] ELME: Trimmed 56095 records to 39824 (keeping 200 days of data) [2025-10-03T18:40:49.412980] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:40:49.416406] [INFO ] [REMOTE ] EL: Full fetch complete (76922 records). [2025-10-03T18:40:49.416548] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-03T18:40:49.418379] [FATAL] [VALIDATOR ] EL: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:40:49.419032] [FATAL] [MAIN ] EL: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:40:49.419709] [WARN ] [MAIN ] EL: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:40:49.420033] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-03T18:40:49.420998] [DEBUG] [LOCAL ] EL: No primary data file found to delete. [2025-10-03T18:40:49.421844] [INFO ] [LOCAL ] EL: Starting deletion of derivative data. [2025-10-03T18:40:49.422817] [DEBUG] [LOCAL ] EL: Deleted derivative data file. [2025-10-03T18:40:49.423147] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. EL took 38.9s. Estimated remaining: 3h 49m 30s. Rate: 7.2 symbols/min [2025-10-03T18:40:49.591859] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-03T18:40:49.625095] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:49.626148] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-03T18:40:49.626218] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-03T18:40:49.627798] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-03T18:40:49.628779] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-03T18:40:49.629840] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-03T18:40:49.630402] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-03T18:40:49.932666] [DEBUG] [LOCAL ] ELME: Primary data saved (39824 records). [2025-10-03T18:40:49.956627] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-03T18:40:49.957785] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELME took 26.3s. Estimated remaining: 3h 49m 4s. Rate: 7.2 symbols/min [2025-10-03T18:40:50.174731] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:50.247968] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:50.298028] [DEBUG] [LOCAL ] ELS: Loaded 49822 existing records from primary storage. [2025-10-03T18:40:50.298351] [INFO ] [MAIN ] ELS: Loaded 49822 existing records. [2025-10-03T18:40:50.399250] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-03T18:40:50.502426] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:50.502757] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-03T18:40:50.502814] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-03T18:40:50.504045] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-03T18:40:50.504108] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-03T18:40:50.803293] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-10-03T18:40:50.930097] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:50.923592] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T18:40:50.961275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T18:40:51.190721] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-03T18:40:51.615625] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:40:51.990708] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-03T18:40:52.790680] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-03T18:40:53.106524] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T18:40:53.117426] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T18:40:53.590686] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-03T18:40:54.390724] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-03T18:40:55.171833] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:40:55.174681] [INFO ] [REMOTE ] ELAN: Full fetch complete (76870 records). [2025-10-03T18:40:55.174821] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-03T18:40:55.197158] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-03T18:40:55.604500] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-03T18:40:55.604668] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-03T18:40:55.605593] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-03T18:40:55.605758] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-03T18:40:55.607421] [DEBUG] [LOCAL ] ELAN: Trimmed 76870 records to 54031 (keeping 200 days of data) [2025-10-03T18:40:55.743186] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:40:55.981365] [DEBUG] [LOCAL ] ELAN: Primary data saved (54031 records). [2025-10-03T18:40:55.981509] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-03T18:40:55.982256] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELAN took 45.4s. Estimated remaining: 3h 48m 50s. Rate: 7.2 symbols/min [2025-10-03T18:40:55.996348] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-03T18:40:56.170753] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:40:56.228563] [DEBUG] [LOCAL ] ELV: Loaded 50927 existing records from primary storage. [2025-10-03T18:40:56.228954] [INFO ] [MAIN ] ELV: Loaded 50927 existing records. [2025-10-03T18:40:56.430115] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:40:56.430933] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-03T18:40:56.431007] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-03T18:40:56.432865] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-03T18:40:56.432966] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-03T18:40:56.796128] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-03T18:40:56.831776] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:40:56.915403] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:40:57.046220] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:40:57.306577] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T18:40:57.590686] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-03T18:40:58.390623] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-03T18:40:58.820090] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T18:40:59.190707] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-03T18:40:59.710835] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:40:59.990676] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-03T18:41:00.274464] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-03T18:41:00.790698] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-03T18:41:01.282713] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:41:01.590684] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-03T18:41:02.283152] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:41:02.390620] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-03T18:41:02.816549] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T18:41:03.190690] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-03T18:41:03.990685] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-03T18:41:04.225985] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T18:41:04.424338] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T18:41:04.476722] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T18:41:04.790698] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-03T18:41:05.590794] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-03T18:41:06.121108] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T18:41:06.390707] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-03T18:41:07.190670] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-03T18:41:07.249018] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T18:41:07.625366] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:41:07.990628] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-03T18:41:08.259045] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T18:41:08.790680] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-03T18:41:09.121421] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T18:41:09.210143] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-03T18:41:09.590679] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-03T18:41:09.928129] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-03T18:41:10.390729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-03T18:41:11.190720] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-03T18:41:11.438278] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T18:41:11.990711] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-03T18:41:12.231410] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:41:12.384500] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-03T18:41:12.385271] [INFO ] [REMOTE ] ELPC: Full fetch complete (1435 records). [2025-10-03T18:41:12.385343] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-03T18:41:12.611506] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-03T18:41:12.611900] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:41:12.611973] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:41:12.612058] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-03T18:41:12.612197] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-03T18:41:12.612258] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-03T18:41:12.612322] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-03T18:41:12.612428] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELPC took 23.2s. Estimated remaining: 3h 49m 1s. Rate: 7.2 symbols/min [2025-10-03T18:41:12.801812] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-03T18:41:12.807580] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:12.807802] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-03T18:41:12.807848] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-03T18:41:12.807960] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-03T18:41:12.808002] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-03T18:41:12.808048] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-03T18:41:12.808101] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-03T18:41:13.208106] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:13.590726] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-03T18:41:13.828315] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:41:13.829954] [INFO ] [REMOTE ] ELP: Full fetch complete (37056 records). [2025-10-03T18:41:13.830037] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-03T18:41:14.241432] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-03T18:41:14.241561] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-03T18:41:14.242234] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-03T18:41:14.242312] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-03T18:41:14.243327] [DEBUG] [LOCAL ] ELP: Trimmed 37056 records to 25951 (keeping 200 days of data) [2025-10-03T18:41:14.390703] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-03T18:41:14.394250] [DEBUG] [LOCAL ] ELP: Primary data saved (25951 records). [2025-10-03T18:41:14.394360] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-03T18:41:14.394447] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. ELP took 27.1s. Estimated remaining: 3h 48m 38s. Rate: 7.2 symbols/min [2025-10-03T18:41:14.577910] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:14.600185] [DEBUG] [LOCAL ] EMD: Loaded 21348 existing records from primary storage. [2025-10-03T18:41:14.600514] [INFO ] [MAIN ] EMD: Loaded 21348 existing records. [2025-10-03T18:41:14.674955] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:41:14.711356] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-03T18:41:14.722357] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:41:14.732745] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-03T18:41:14.737962] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:41:14.763174] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-03T18:41:14.797387] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:14.797625] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-03T18:41:14.797851] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-03T18:41:14.797791] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-03T18:41:14.797945] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-03T18:41:14.798074] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-03T18:41:14.798221] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. EMA took 2.2s. Estimated remaining: 3h 48m 11s. Rate: 7.2 symbols/min [2025-10-03T18:41:14.835104] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-10-03T18:41:14.871697] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-03T18:41:15.107203] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:15.207087] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-03T18:41:15.439421] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-03T18:41:15.462980] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:15.464347] [DEBUG] [LOCAL ] EME: Loaded 31497 existing records from primary storage. [2025-10-03T18:41:15.474064] [INFO ] [MAIN ] EME: Loaded 31497 existing records. [2025-10-03T18:41:15.671836] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:15.672066] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-03T18:41:15.672115] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-03T18:41:15.673222] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-03T18:41:15.673288] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-03T18:41:15.995879] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-03T18:41:16.072507] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:16.790748] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-03T18:41:17.473350] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-03T18:41:17.590688] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-03T18:41:17.840437] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:41:17.919366] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:41:18.390734] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-03T18:41:19.190755] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-03T18:41:19.309545] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T18:41:19.450443] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:41:19.990719] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-03T18:41:20.192494] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:41:20.790739] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-03T18:41:21.201020] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T18:41:21.590706] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-03T18:41:22.317868] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T18:41:22.390690] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-03T18:41:23.190700] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-03T18:41:23.745976] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T18:41:23.921834] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:41:23.983490] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T18:41:23.990615] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-03T18:41:24.790730] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-03T18:41:25.590679] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-03T18:41:25.956462] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T18:41:25.964081] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T18:41:26.390730] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-03T18:41:27.111380] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:41:27.190692] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-03T18:41:27.990735] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-03T18:41:28.389586] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-03T18:41:28.790737] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-03T18:41:29.003078] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:41:29.204500] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:41:29.590769] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-03T18:41:30.390639] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-03T18:41:30.519784] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T18:41:31.034818] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T18:41:31.094162] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:41:31.190702] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-03T18:41:31.990639] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-03T18:41:32.310733] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T18:41:32.790683] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-03T18:41:33.590683] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-03T18:41:33.690212] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T18:41:33.932892] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T18:41:34.390696] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-03T18:41:35.196197] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-03T18:41:35.220335] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:41:35.992951] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-03T18:41:35.997615] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:41:36.304523] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:41:36.790703] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-03T18:41:37.460436] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:41:37.590696] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-03T18:41:38.190866] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T18:41:38.390719] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-03T18:41:39.190719] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-03T18:41:39.490736] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T18:41:39.795716] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:41:39.990706] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-03T18:41:40.790744] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-03T18:41:40.817767] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:41:40.820380] [INFO ] [REMOTE ] ELV: Full fetch complete (72793 records). [2025-10-03T18:41:40.820630] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-03T18:41:40.822041] [FATAL] [VALIDATOR ] ELV: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:41:40.822197] [FATAL] [MAIN ] ELV: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:41:40.822366] [WARN ] [MAIN ] ELV: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:41:40.822466] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-03T18:41:40.822618] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-03T18:41:40.822734] [INFO ] [LOCAL ] ELV: Starting deletion of derivative data. [2025-10-03T18:41:40.823025] [DEBUG] [LOCAL ] ELV: Deleted derivative data file. [2025-10-03T18:41:40.824299] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 44.8s. Estimated remaining: 3h 48m 43s. Rate: 7.2 symbols/min [2025-10-03T18:41:41.135332] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:41:41.143584] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:41.146629] [INFO ] [REMOTE ] EMD: Full fetch complete (32529 records). [2025-10-03T18:41:41.146765] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-03T18:41:41.283936] [DEBUG] [LOCAL ] EMF: Loaded 3431 existing records from primary storage. [2025-10-03T18:41:41.284905] [INFO ] [MAIN ] EMF: Loaded 3431 existing records. [2025-10-03T18:41:41.595928] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-03T18:41:41.703582] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:41.736967] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-03T18:41:41.742542] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-03T18:41:41.779824] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-03T18:41:41.801636] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-03T18:41:41.936138] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-03T18:41:41.951348] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-03T18:41:41.955047] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-03T18:41:41.955481] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-03T18:41:42.020239] [DEBUG] [LOCAL ] EMD: Trimmed 32529 records to 21522 (keeping 200 days of data) [2025-10-03T18:41:42.363932] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:42.364606] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T18:41:42.371897] [INFO ] [REMOTE ] ELS: Full fetch complete (70836 records). [2025-10-03T18:41:42.372619] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-03T18:41:42.398693] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-03T18:41:42.853997] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-03T18:41:42.853807] [DEBUG] [LOCAL ] EMD: Primary data saved (21522 records). [2025-10-03T18:41:42.854116] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-03T18:41:42.854243] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. EMD took 28.5s. Estimated remaining: 3h 48m 20s. Rate: 7.2 symbols/min [2025-10-03T18:41:42.854327] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-03T18:41:42.860608] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-03T18:41:42.909968] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-03T18:41:43.028114] [DEBUG] [LOCAL ] ELS: Trimmed 70836 records to 50194 (keeping 200 days of data) [2025-10-03T18:41:43.058944] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:43.133419] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T18:41:43.199820] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-03T18:41:43.202175] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T18:41:43.364297] [DEBUG] [LOCAL ] EMN: Loaded 50840 existing records from primary storage. [2025-10-03T18:41:43.366050] [INFO ] [MAIN ] EMN: Loaded 50840 existing records. [2025-10-03T18:41:43.654609] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:43.657844] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-03T18:41:43.660200] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-03T18:41:43.662192] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-03T18:41:43.663593] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-03T18:41:43.846353] [DEBUG] [LOCAL ] ELS: Primary data saved (50194 records). [2025-10-03T18:41:43.846928] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-03T18:41:43.862351] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. ELS took 53.9s. Estimated remaining: 3h 47m 55s. Rate: 7.2 symbols/min [2025-10-03T18:41:43.998866] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-03T18:41:44.250671] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:44.282275] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:44.296061] [DEBUG] [LOCAL ] EMO: Loaded 12644 existing records from primary storage. [2025-10-03T18:41:44.296300] [INFO ] [MAIN ] EMO: Loaded 12644 existing records. [2025-10-03T18:41:44.516011] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:41:44.516553] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-03T18:41:44.516629] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-03T18:41:44.517638] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-03T18:41:44.517738] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-03T18:41:44.803060] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-03T18:41:44.846797] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T18:41:44.960848] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:44.963289] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-03T18:41:45.590722] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-03T18:41:46.390718] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-03T18:41:46.574828] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T18:41:46.677499] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T18:41:46.795694] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-03T18:41:47.190697] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-03T18:41:47.886200] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T18:41:47.990665] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-03T18:41:48.575789] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:41:48.790691] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-03T18:41:49.261851] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-03T18:41:49.590687] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-03T18:41:50.390711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-03T18:41:50.971014] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T18:41:50.972865] [INFO ] [REMOTE ] EME: Full fetch complete (46854 records). [2025-10-03T18:41:50.972956] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-03T18:41:51.195755] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-03T18:41:51.419346] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-03T18:41:51.419450] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-03T18:41:51.420192] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-03T18:41:51.420266] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-03T18:41:51.421581] [DEBUG] [LOCAL ] EME: Trimmed 46854 records to 31702 (keeping 200 days of data) [2025-10-03T18:41:51.654258] [DEBUG] [LOCAL ] EME: Primary data saved (31702 records). [2025-10-03T18:41:51.654413] [INFO ] [MAIN ] EME: Full history saved. [2025-10-03T18:41:51.654504] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EME took 36.9s. Estimated remaining: 3h 47m 46s. Rate: 7.2 symbols/min [2025-10-03T18:41:51.844495] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:41:51.844870] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-10-03T18:41:51.844973] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-10-03T18:41:51.845093] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-03T18:41:51.845140] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-03T18:41:51.845188] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-03T18:41:51.845228] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-03T18:41:52.000737] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-03T18:41:52.148866] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T18:41:52.282179] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T18:41:52.305264] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:41:52.585731] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:41:52.790699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-03T18:41:53.295293] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-03T18:41:53.590701] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-03T18:41:54.070556] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T18:41:54.390687] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-03T18:41:55.122799] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:41:55.190704] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-03T18:41:55.990699] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-03T18:41:56.521022] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-03T18:41:56.790693] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-03T18:41:56.939088] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:41:57.513928] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-03T18:41:57.590695] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-03T18:41:58.056408] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:41:58.390692] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-03T18:41:58.777977] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T18:41:59.190686] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-03T18:41:59.990682] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-03T18:42:00.635779] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:42:00.636585] [INFO ] [REMOTE ] EMF: Full fetch complete (7129 records). [2025-10-03T18:42:00.636700] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-03T18:42:00.799186] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-03T18:42:01.047825] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-03T18:42:01.048074] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-03T18:42:01.048455] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-03T18:42:01.048558] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-03T18:42:01.049594] [DEBUG] [LOCAL ] EMF: Trimmed 7129 records to 3480 (keeping 200 days of data) [2025-10-03T18:42:01.102718] [DEBUG] [LOCAL ] EMF: Primary data saved (3480 records). [2025-10-03T18:42:01.104448] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:01.103423] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-03T18:42:01.115016] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EMF took 20.3s. Estimated remaining: 3h 47m 40s. Rate: 7.2 symbols/min [2025-10-03T18:42:01.339723] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:01.402151] [DEBUG] [LOCAL ] EMR: Loaded 53633 existing records from primary storage. [2025-10-03T18:42:01.402476] [INFO ] [MAIN ] EMR: Loaded 53633 existing records. [2025-10-03T18:42:01.600180] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-03T18:42:01.637524] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:01.639875] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-03T18:42:01.639985] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-03T18:42:01.643969] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-03T18:42:01.644098] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-03T18:42:01.824351] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:42:02.161704] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:02.390703] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-03T18:42:02.888855] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-03T18:42:03.190686] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-03T18:42:03.354871] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:42:03.990704] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-03T18:42:04.031104] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T18:42:04.790741] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-03T18:42:05.438279] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T18:42:05.590711] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-03T18:42:06.139322] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:42:06.390718] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-03T18:42:07.190671] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-03T18:42:07.376592] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T18:42:07.990672] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-03T18:42:08.130231] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T18:42:08.371278] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-03T18:42:08.790727] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-03T18:42:09.373354] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T18:42:09.590689] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-03T18:42:09.666175] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:42:10.158542] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T18:42:10.390712] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-03T18:42:11.190684] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-03T18:42:11.347252] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:42:11.773175] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:42:11.990713] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-03T18:42:12.619768] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T18:42:12.790728] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-03T18:42:13.590693] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-03T18:42:14.107028] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T18:42:14.390711] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-03T18:42:14.554389] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:42:15.190685] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-03T18:42:15.990728] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-03T18:42:16.135421] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T18:42:16.692861] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:42:16.790717] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-03T18:42:16.931711] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T18:42:17.590728] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-03T18:42:18.146628] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:42:18.390678] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-03T18:42:18.756590] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-03T18:42:19.190713] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-03T18:42:19.990628] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-03T18:42:20.297334] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:20.303270] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:42:20.790760] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-03T18:42:21.453454] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T18:42:21.454301] [INFO ] [REMOTE ] EMP: Full fetch complete (4310 records). [2025-10-03T18:42:21.454382] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-03T18:42:21.592314] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-03T18:42:21.593502] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:42:21.625487] [INFO ] [REMOTE ] EMN: Full fetch complete (72103 records). [2025-10-03T18:42:21.659775] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-03T18:42:22.191861] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-03T18:42:22.227545] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-03T18:42:22.240764] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-03T18:42:22.251224] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-03T18:42:22.260949] [DEBUG] [LOCAL ] EMP: Trimmed 4310 records to 3108 (keeping 200 days of data) [2025-10-03T18:42:22.320555] [DEBUG] [LOCAL ] EMP: Primary data saved (3108 records). [2025-10-03T18:42:22.341400] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-03T18:42:22.341675] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMP took 30.7s. Estimated remaining: 3h 48m 0s. Rate: 7.2 symbols/min [2025-10-03T18:42:22.398270] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-03T18:42:22.622316] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-03T18:42:22.632880] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-03T18:42:22.639323] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-03T18:42:22.639440] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-03T18:42:22.694264] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:22.695879] [DEBUG] [LOCAL ] EMN: Trimmed 72103 records to 51219 (keeping 200 days of data) [2025-10-03T18:42:22.858805] [DEBUG] [LOCAL ] ENB: Loaded 53900 existing records from primary storage. [2025-10-03T18:42:22.860569] [INFO ] [MAIN ] ENB: Loaded 53900 existing records. [2025-10-03T18:42:23.147082] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:23.183573] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-03T18:42:23.186943] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-03T18:42:23.192878] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-03T18:42:23.193750] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-03T18:42:23.441963] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T18:42:23.486165] [INFO ] [REMOTE ] EMO: Full fetch complete (17303 records). [2025-10-03T18:42:23.517005] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-03T18:42:23.745135] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:23.750089] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-03T18:42:24.159317] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-03T18:42:24.164117] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-03T18:42:24.170680] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-03T18:42:24.173932] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-03T18:42:24.187366] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-03T18:42:24.191180] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-03T18:42:24.195114] [DEBUG] [LOCAL ] EMN: Primary data saved (51219 records). [2025-10-03T18:42:24.195556] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-03T18:42:24.195753] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMN took 41.3s. Estimated remaining: 3h 47m 38s. Rate: 7.2 symbols/min [2025-10-03T18:42:24.195410] [DEBUG] [LOCAL ] EMO: Trimmed 17303 records to 12774 (keeping 200 days of data) [2025-10-03T18:42:24.458016] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:24.459034] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-10-03T18:42:24.459338] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-10-03T18:42:24.460026] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-03T18:42:24.460086] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-03T18:42:24.460724] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-10-03T18:42:24.461029] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-03T18:42:24.860458] [DEBUG] [LOCAL ] EMO: Primary data saved (12774 records). [2025-10-03T18:42:24.865089] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-03T18:42:24.884806] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:24.884929] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. EMO took 41.0s. Estimated remaining: 3h 47m 12s. Rate: 7.2 symbols/min [2025-10-03T18:42:24.885243] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-03T18:42:25.082787] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:25.133333] [DEBUG] [LOCAL ] ENIC: Loaded 36637 existing records from primary storage. [2025-10-03T18:42:25.133678] [INFO ] [MAIN ] ENIC: Loaded 36637 existing records. [2025-10-03T18:42:25.357495] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:25.357752] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-03T18:42:25.357808] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-03T18:42:25.359463] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-10-03T18:42:25.359532] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-03T18:42:25.779868] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:25.780307] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-03T18:42:25.889106] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:42:25.971443] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-03T18:42:26.217935] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:42:26.390691] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-03T18:42:26.843093] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:42:27.190714] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-03T18:42:27.764966] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T18:42:27.936051] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:42:27.990725] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-03T18:42:28.587963] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T18:42:28.790714] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-03T18:42:29.086336] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-03T18:42:29.590731] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-03T18:42:30.390721] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-03T18:42:31.190735] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-03T18:42:31.780844] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:42:31.807260] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T18:42:31.841340] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T18:42:31.990712] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-03T18:42:32.790760] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-03T18:42:33.590679] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-03T18:42:33.873299] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T18:42:34.390629] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-03T18:42:34.485917] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:42:34.793547] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:42:34.947184] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:42:35.190688] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-03T18:42:35.990735] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-03T18:42:36.619454] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T18:42:36.790728] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-03T18:42:37.590744] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-03T18:42:37.909292] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T18:42:38.390712] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-03T18:42:38.526425] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:42:39.053904] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:42:39.190730] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-03T18:42:39.990698] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-03T18:42:40.300966] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:42:40.638594] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:42:40.652002] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-03T18:42:40.790719] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-03T18:42:41.590722] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-03T18:42:42.306277] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T18:42:42.390703] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-03T18:42:42.709067] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:42:43.190684] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-03T18:42:43.662195] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-03T18:42:43.878488] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T18:42:43.990688] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-03T18:42:44.790709] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-03T18:42:45.590706] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-03T18:42:45.681865] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:42:45.684879] [INFO ] [REMOTE ] EMR: Full fetch complete (77103 records). [2025-10-03T18:42:45.684989] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-03T18:42:46.101454] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-03T18:42:46.101544] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-03T18:42:46.102526] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-03T18:42:46.102598] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-03T18:42:46.104181] [DEBUG] [LOCAL ] EMR: Trimmed 77103 records to 54022 (keeping 200 days of data) [2025-10-03T18:42:46.404914] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-03T18:42:46.461575] [DEBUG] [LOCAL ] EMR: Primary data saved (54022 records). [2025-10-03T18:42:46.461775] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-03T18:42:46.462772] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. EMR took 45.3s. Estimated remaining: 3h 47m 33s. Rate: 7.2 symbols/min [2025-10-03T18:42:46.657471] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:46.663548] [DEBUG] [LOCAL ] ENO: Loaded 1926 existing records from primary storage. [2025-10-03T18:42:46.663883] [INFO ] [MAIN ] ENO: Loaded 1926 existing records. [2025-10-03T18:42:46.921338] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:46.921694] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-03T18:42:46.921803] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-03T18:42:46.917481] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-03T18:42:46.933452] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-03T18:42:46.939379] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-03T18:42:47.028311] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T18:42:47.194484] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-03T18:42:47.360724] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:47.370549] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:42:47.990701] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-03T18:42:48.790720] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-03T18:42:49.115110] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T18:42:49.190930] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:42:49.356367] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-03T18:42:49.590922] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-03T18:42:50.390753] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-03T18:42:50.995515] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T18:42:51.034551] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T18:42:51.035424] [INFO ] [REMOTE ] ENFY: Full fetch complete (5689 records). [2025-10-03T18:42:51.035497] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-03T18:42:51.195848] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-03T18:42:51.484522] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-10-03T18:42:51.484609] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-10-03T18:42:51.484819] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-10-03T18:42:51.484881] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-10-03T18:42:51.485401] [DEBUG] [LOCAL ] ENFY: Trimmed 5689 records to 3201 (keeping 200 days of data) [2025-10-03T18:42:51.505179] [DEBUG] [LOCAL ] ENFY: Primary data saved (3201 records). [2025-10-03T18:42:51.505320] [INFO ] [MAIN ] ENFY: Full history saved. [2025-10-03T18:42:51.505404] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. ENFY took 27.3s. Estimated remaining: 3h 47m 17s. Rate: 7.2 symbols/min [2025-10-03T18:42:51.706085] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:51.770172] [DEBUG] [LOCAL ] ENOV: Loaded 45207 existing records from primary storage. [2025-10-03T18:42:51.770676] [INFO ] [MAIN ] ENOV: Loaded 45207 existing records. [2025-10-03T18:42:51.990435] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:51.990901] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-03T18:42:51.990713] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-03T18:42:51.992008] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-03T18:42:51.993538] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-03T18:42:51.993604] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-03T18:42:52.316633] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:42:52.339829] [INFO ] [REMOTE ] ENIC: Full fetch complete (51416 records). [2025-10-03T18:42:52.359964] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-03T18:42:52.419858] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:52.624493] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-03T18:42:52.813742] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-03T18:42:52.835111] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-03T18:42:52.835247] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-03T18:42:52.836087] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-03T18:42:52.836157] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-03T18:42:52.837894] [DEBUG] [LOCAL ] ENIC: Trimmed 51416 records to 36843 (keeping 200 days of data) [2025-10-03T18:42:53.058031] [DEBUG] [LOCAL ] ENIC: Primary data saved (36843 records). [2025-10-03T18:42:53.058198] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-03T18:42:53.059980] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENIC took 28.2s. Estimated remaining: 3h 46m 54s. Rate: 7.2 symbols/min [2025-10-03T18:42:53.241792] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:42:53.284319] [DEBUG] [LOCAL ] ENR: Loaded 43162 existing records from primary storage. [2025-10-03T18:42:53.284676] [INFO ] [MAIN ] ENR: Loaded 43162 existing records. [2025-10-03T18:42:53.473146] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:42:53.473355] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-03T18:42:53.473403] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-03T18:42:53.473770] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-03T18:42:53.473833] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-03T18:42:53.595738] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-03T18:42:53.857373] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:42:54.390685] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-03T18:42:54.799956] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T18:42:55.023717] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T18:42:55.190717] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-03T18:42:55.541885] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-03T18:42:55.658006] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T18:42:55.990683] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-03T18:42:56.790686] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-03T18:42:57.590635] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-03T18:42:57.933601] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T18:42:58.037422] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T18:42:58.350389] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:42:58.390696] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-03T18:42:59.190752] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-03T18:42:59.828387] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T18:42:59.990729] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-03T18:43:00.533337] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:43:00.790734] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-03T18:43:01.590628] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-03T18:43:01.683767] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:43:02.390693] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-03T18:43:02.853195] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T18:43:02.939671] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:43:03.190723] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-03T18:43:03.990703] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-03T18:43:04.046489] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T18:43:04.790691] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-03T18:43:04.908668] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:43:04.911583] [INFO ] [REMOTE ] ENB: Full fetch complete (77487 records). [2025-10-03T18:43:04.911795] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-03T18:43:05.346862] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-03T18:43:05.347050] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-03T18:43:05.348072] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-03T18:43:05.348178] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-03T18:43:05.350043] [DEBUG] [LOCAL ] ENB: Trimmed 77487 records to 54287 (keeping 200 days of data) [2025-10-03T18:43:05.486093] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:43:05.597375] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-03T18:43:05.721947] [DEBUG] [LOCAL ] ENB: Primary data saved (54287 records). [2025-10-03T18:43:05.722104] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-03T18:43:05.722193] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENB took 43.4s. Estimated remaining: 3h 46m 55s. Rate: 7.2 symbols/min [2025-10-03T18:43:05.913437] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:05.914129] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-03T18:43:05.914183] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-03T18:43:05.914356] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-03T18:43:05.914429] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-03T18:43:05.914489] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-03T18:43:05.914525] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-03T18:43:06.332201] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:06.394854] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-03T18:43:06.399462] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:43:07.190684] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-03T18:43:07.275511] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:43:07.744914] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T18:43:07.779108] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:43:07.990700] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-03T18:43:08.549803] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T18:43:08.790708] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-03T18:43:09.590720] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-03T18:43:10.021537] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-03T18:43:10.370540] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T18:43:10.390612] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-03T18:43:11.190705] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-03T18:43:11.990699] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-03T18:43:12.223625] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:43:12.790715] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-03T18:43:12.841800] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:43:13.200214] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:43:13.231576] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T18:43:13.590691] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-03T18:43:14.390701] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-03T18:43:15.160999] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T18:43:15.190722] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-03T18:43:15.990723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-03T18:43:16.137386] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T18:43:16.615028] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T18:43:16.746775] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:43:16.790690] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-03T18:43:17.590690] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-03T18:43:18.382522] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:43:18.391686] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-03T18:43:19.181872] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:43:19.190607] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-03T18:43:19.960092] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:43:19.990706] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-03T18:43:20.550268] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:43:20.790717] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-03T18:43:21.508793] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:43:21.590738] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-03T18:43:21.998632] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T18:43:22.241127] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T18:43:22.243229] [INFO ] [REMOTE ] ENOV: Full fetch complete (63257 records). [2025-10-03T18:43:22.243323] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-03T18:43:22.397190] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-03T18:43:22.684228] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-03T18:43:22.684414] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-03T18:43:22.685499] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-03T18:43:22.685608] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-03T18:43:22.692171] [DEBUG] [LOCAL ] ENOV: Trimmed 63257 records to 45484 (keeping 200 days of data) [2025-10-03T18:43:22.973025] [DEBUG] [LOCAL ] ENOV: Primary data saved (45484 records). [2025-10-03T18:43:22.973184] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-03T18:43:22.973367] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENOV took 31.5s. Estimated remaining: 3h 47m 6s. Rate: 7.2 symbols/min [2025-10-03T18:43:23.155776] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:23.182783] [DEBUG] [LOCAL ] ENVA: Loaded 25450 existing records from primary storage. [2025-10-03T18:43:23.183116] [INFO ] [MAIN ] ENVA: Loaded 25450 existing records. [2025-10-03T18:43:23.196131] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-03T18:43:23.386148] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:23.386421] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-03T18:43:23.386485] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-03T18:43:23.387561] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-03T18:43:23.387624] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-03T18:43:23.803119] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:23.992265] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-03T18:43:23.995577] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T18:43:24.427745] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-03T18:43:24.428693] [INFO ] [REMOTE ] ENO: Full fetch complete (3107 records). [2025-10-03T18:43:24.428772] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-03T18:43:24.795703] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-03T18:43:24.854599] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:43:24.895754] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-03T18:43:24.895881] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-03T18:43:24.896084] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-03T18:43:24.896129] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-03T18:43:24.896619] [DEBUG] [LOCAL ] ENO: Trimmed 3107 records to 1938 (keeping 200 days of data) [2025-10-03T18:43:24.914687] [DEBUG] [LOCAL ] ENO: Primary data saved (1938 records). [2025-10-03T18:43:24.914853] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-03T18:43:24.914950] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENO took 38.5s. Estimated remaining: 3h 46m 44s. Rate: 7.2 symbols/min [2025-10-03T18:43:25.128089] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:25.129422] [DEBUG] [LOCAL ] EOD: No existing data file found in primary storage. [2025-10-03T18:43:25.129476] [WARN ] [MAIN ] EOD: No existing data found, performing full refresh instead. [2025-10-03T18:43:25.129717] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-03T18:43:25.129779] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-03T18:43:25.129850] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-03T18:43:25.129895] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-03T18:43:25.523479] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:25.590845] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-03T18:43:26.127431] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T18:43:26.390732] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-03T18:43:26.910179] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T18:43:26.913257] [INFO ] [REMOTE ] ENR: Full fetch complete (58789 records). [2025-10-03T18:43:26.913383] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-03T18:43:27.200828] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-03T18:43:27.362119] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-03T18:43:27.362226] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-03T18:43:27.363164] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-03T18:43:27.363230] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-03T18:43:27.366166] [DEBUG] [LOCAL ] ENR: Trimmed 58789 records to 43463 (keeping 200 days of data) [2025-10-03T18:43:27.619276] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-03T18:43:27.684720] [DEBUG] [LOCAL ] ENR: Primary data saved (43463 records). [2025-10-03T18:43:27.684864] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-03T18:43:27.685785] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENR took 34.6s. Estimated remaining: 3h 46m 23s. Rate: 7.2 symbols/min [2025-10-03T18:43:27.868392] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:27.926188] [DEBUG] [LOCAL ] EOG: Loaded 53734 existing records from primary storage. [2025-10-03T18:43:27.926574] [INFO ] [MAIN ] EOG: Loaded 53734 existing records. [2025-10-03T18:43:27.995842] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-03T18:43:28.155000] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:28.155261] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-03T18:43:28.155343] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-03T18:43:28.155789] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-03T18:43:28.155901] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-03T18:43:28.556455] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T18:43:28.585918] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:28.790705] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-03T18:43:29.308755] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T18:43:29.590721] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-03T18:43:30.390627] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-03T18:43:30.697741] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T18:43:30.764934] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:43:31.190731] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-03T18:43:31.714306] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T18:43:31.990693] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-03T18:43:32.121352] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T18:43:32.790745] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-03T18:43:33.330274] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T18:43:33.590717] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-03T18:43:34.390717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-03T18:43:34.410849] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T18:43:34.587966] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T18:43:35.190714] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-03T18:43:35.551510] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:43:35.990631] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-03T18:43:36.074557] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:43:36.790708] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-03T18:43:37.137493] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T18:43:37.590703] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-03T18:43:38.266213] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T18:43:38.390721] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-03T18:43:38.439433] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T18:43:38.441866] [INFO ] [REMOTE ] ENS: Full fetch complete (42239 records). [2025-10-03T18:43:38.442007] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-03T18:43:38.865995] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-03T18:43:38.866095] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-03T18:43:38.866791] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-03T18:43:38.866858] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-03T18:43:38.868052] [DEBUG] [LOCAL ] ENS: Trimmed 42239 records to 29820 (keeping 200 days of data) [2025-10-03T18:43:39.064430] [DEBUG] [LOCAL ] ENS: Primary data saved (29820 records). [2025-10-03T18:43:39.064623] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-03T18:43:39.064743] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENS took 33.3s. Estimated remaining: 3h 46m 22s. Rate: 7.2 symbols/min [2025-10-03T18:43:39.195792] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-03T18:43:39.256909] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:39.271757] [DEBUG] [LOCAL ] EOI: Loaded 10789 existing records from primary storage. [2025-10-03T18:43:39.271999] [INFO ] [MAIN ] EOI: Loaded 10789 existing records. [2025-10-03T18:43:39.470639] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:43:39.470927] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-03T18:43:39.470979] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-03T18:43:39.471157] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-03T18:43:39.471217] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-03T18:43:39.891020] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:39.990637] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-03T18:43:40.043366] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T18:43:40.436020] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-03T18:43:40.790732] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-03T18:43:40.932503] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-03T18:43:41.305038] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-03T18:43:41.590637] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-03T18:43:42.390715] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-03T18:43:42.674828] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:43:42.900076] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T18:43:43.190735] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-03T18:43:43.990684] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-03T18:43:44.022328] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:43:44.790675] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-03T18:43:45.060558] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:43:45.590715] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-03T18:43:45.868168] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:43:46.390718] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-03T18:43:46.808084] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T18:43:47.190633] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-03T18:43:47.351477] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T18:43:47.990672] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-03T18:43:48.358586] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:43:48.790692] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-03T18:43:49.590628] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-03T18:43:49.991690] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T18:43:50.018575] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T18:43:50.390711] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-03T18:43:50.431687] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T18:43:51.190704] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-03T18:43:51.552507] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T18:43:51.554175] [INFO ] [REMOTE ] ENVA: Full fetch complete (36788 records). [2025-10-03T18:43:51.554320] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-03T18:43:51.969368] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-03T18:43:51.969460] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-03T18:43:51.970149] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-03T18:43:51.970218] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-03T18:43:51.971222] [DEBUG] [LOCAL ] ENVA: Trimmed 36788 records to 25618 (keeping 200 days of data) [2025-10-03T18:43:52.022149] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-03T18:43:52.130262] [DEBUG] [LOCAL ] ENVA: Primary data saved (25618 records). [2025-10-03T18:43:52.130411] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-03T18:43:52.130514] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. ENVA took 29.2s. Estimated remaining: 3h 46m 24s. Rate: 7.2 symbols/min [2025-10-03T18:43:52.313765] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:43:52.313954] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-10-03T18:43:52.314018] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-10-03T18:43:52.314140] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-03T18:43:52.314185] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-03T18:43:52.314231] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-03T18:43:52.314290] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-03T18:43:52.703570] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:43:52.790666] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-03T18:43:53.044558] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:43:53.045723] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:43:53.590690] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-03T18:43:53.963377] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:43:54.181501] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T18:43:54.390692] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-03T18:43:55.190688] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-03T18:43:55.346765] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T18:43:55.990716] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-03T18:43:56.790716] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-03T18:43:57.006299] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:43:57.206187] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:43:57.590697] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-03T18:43:57.712987] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:43:58.390708] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-03T18:43:59.190631] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-03T18:43:59.351759] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T18:43:59.448930] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:43:59.889115] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T18:43:59.890885] [INFO ] [REMOTE ] EOD: Full fetch complete (20473 records). [2025-10-03T18:43:59.890967] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-03T18:43:59.995863] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-03T18:44:00.320708] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-10-03T18:44:00.320805] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-10-03T18:44:00.321277] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-10-03T18:44:00.321320] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-10-03T18:44:00.322096] [DEBUG] [LOCAL ] EOD: Trimmed 20473 records to 14703 (keeping 200 days of data) [2025-10-03T18:44:00.420705] [DEBUG] [LOCAL ] EOD: Primary data saved (14703 records). [2025-10-03T18:44:00.420870] [INFO ] [MAIN ] EOD: Full history saved. [2025-10-03T18:44:00.420949] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. EOD took 35.5s. Estimated remaining: 3h 46m 15s. Rate: 7.2 symbols/min [2025-10-03T18:44:00.650534] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:00.664450] [DEBUG] [LOCAL ] EOT: Loaded 6929 existing records from primary storage. [2025-10-03T18:44:00.664703] [INFO ] [MAIN ] EOT: Loaded 6929 existing records. [2025-10-03T18:44:00.795778] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-03T18:44:00.877066] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:00.877525] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-03T18:44:00.877590] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-03T18:44:00.877866] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-03T18:44:00.877975] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-03T18:44:01.270474] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:01.590739] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-03T18:44:01.879003] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:44:02.074309] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T18:44:02.390697] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-03T18:44:02.402941] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T18:44:03.190725] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-03T18:44:03.990668] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-03T18:44:04.062217] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:44:04.177172] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:44:04.546923] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T18:44:04.790681] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-03T18:44:05.590717] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-03T18:44:05.779375] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:44:06.354791] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T18:44:06.390697] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-03T18:44:07.190737] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-03T18:44:07.230327] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-03T18:44:07.929195] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:44:07.990711] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-03T18:44:08.790885] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-03T18:44:09.590719] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-03T18:44:09.600542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T18:44:09.856168] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T18:44:10.316970] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T18:44:10.390727] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-03T18:44:11.190689] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-03T18:44:11.990713] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-03T18:44:12.102966] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:44:12.105707] [INFO ] [REMOTE ] EOG: Full fetch complete (77279 records). [2025-10-03T18:44:12.105821] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-03T18:44:12.271236] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:44:12.553861] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-03T18:44:12.553959] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-03T18:44:12.554901] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-03T18:44:12.554973] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-03T18:44:12.556635] [DEBUG] [LOCAL ] EOG: Trimmed 77279 records to 54124 (keeping 200 days of data) [2025-10-03T18:44:12.790934] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-03T18:44:12.821845] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T18:44:12.922798] [DEBUG] [LOCAL ] EOG: Primary data saved (54124 records). [2025-10-03T18:44:12.922977] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-03T18:44:12.923921] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOG took 45.2s. Estimated remaining: 3h 46m 16s. Rate: 7.2 symbols/min [2025-10-03T18:44:13.112369] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:13.141826] [DEBUG] [LOCAL ] EPAC: Loaded 27163 existing records from primary storage. [2025-10-03T18:44:13.142119] [INFO ] [MAIN ] EPAC: Loaded 27163 existing records. [2025-10-03T18:44:13.347742] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:13.348125] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-03T18:44:13.348178] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-03T18:44:13.348481] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-03T18:44:13.348566] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-03T18:44:13.600860] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-03T18:44:13.715485] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T18:44:13.789168] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:14.390713] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-03T18:44:14.428118] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T18:44:15.190719] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-03T18:44:15.794013] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:44:15.990696] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-03T18:44:16.304828] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:44:16.790730] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-03T18:44:16.870205] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T18:44:16.871260] [INFO ] [REMOTE ] EOI: Full fetch complete (16116 records). [2025-10-03T18:44:16.871336] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-03T18:44:16.871803] [FATAL] [VALIDATOR ] EOI: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:44:16.871888] [FATAL] [MAIN ] EOI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:44:16.871939] [WARN ] [MAIN ] EOI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:44:16.872018] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-03T18:44:16.872083] [DEBUG] [LOCAL ] EOI: No primary data file found to delete. [2025-10-03T18:44:16.872120] [INFO ] [LOCAL ] EOI: Starting deletion of derivative data. [2025-10-03T18:44:16.872441] [DEBUG] [LOCAL ] EOI: Deleted derivative data file. [2025-10-03T18:44:16.872568] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOI took 37.8s. Estimated remaining: 3h 45m 58s. Rate: 7.2 symbols/min [2025-10-03T18:44:17.060881] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:17.100472] [DEBUG] [LOCAL ] EPAM: Loaded 40032 existing records from primary storage. [2025-10-03T18:44:17.100816] [INFO ] [MAIN ] EPAM: Loaded 40032 existing records. [2025-10-03T18:44:17.293789] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:17.294043] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-03T18:44:17.294099] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-03T18:44:17.294488] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-03T18:44:17.294549] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-03T18:44:17.583276] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:44:17.595848] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-03T18:44:17.618953] [INFO ] [REMOTE ] EOS: Full fetch complete (23256 records). [2025-10-03T18:44:17.619196] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-03T18:44:17.642307] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:44:17.652964] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:44:17.699542] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:44:17.718155] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-03T18:44:17.724821] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:17.725034] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-03T18:44:17.725372] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-03T18:44:17.725439] [DEBUG] [LOCAL ] EOS: No derivative data file found to delete. [2025-10-03T18:44:17.725588] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOS took 25.6s. Estimated remaining: 3h 45m 33s. Rate: 7.2 symbols/min [2025-10-03T18:44:17.926637] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:17.926830] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-03T18:44:17.926921] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-03T18:44:17.927009] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-03T18:44:17.927050] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-03T18:44:17.927094] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-03T18:44:17.927140] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-03T18:44:18.313746] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:18.390729] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-03T18:44:18.972569] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:44:19.190747] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-03T18:44:19.907102] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T18:44:19.990691] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-03T18:44:20.694268] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T18:44:20.790670] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-03T18:44:20.935835] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T18:44:21.590714] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-03T18:44:22.011880] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T18:44:22.197063] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:44:22.390732] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-03T18:44:23.190725] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-03T18:44:23.459598] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T18:44:23.990730] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-03T18:44:24.593135] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T18:44:24.651821] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:44:24.790712] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-03T18:44:25.590698] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-03T18:44:26.271158] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T18:44:26.390711] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-03T18:44:27.036291] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:44:27.190707] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-03T18:44:27.389315] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:44:27.990736] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-03T18:44:28.624466] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T18:44:28.790730] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-03T18:44:29.468797] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T18:44:29.590708] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-03T18:44:30.086166] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T18:44:30.390719] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-03T18:44:31.199341] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-03T18:44:31.224097] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:44:31.229741] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:44:31.990727] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-03T18:44:32.687692] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T18:44:32.795776] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-03T18:44:32.810922] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T18:44:33.590739] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-03T18:44:34.228925] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:44:34.390713] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-03T18:44:35.179262] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T18:44:35.193025] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-03T18:44:35.562256] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:44:35.990668] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-03T18:44:36.790733] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-03T18:44:36.820278] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:44:37.597210] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-03T18:44:37.622929] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T18:44:37.649262] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T18:44:38.249852] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T18:44:38.250909] [INFO ] [REMOTE ] EOT: Full fetch complete (10762 records). [2025-10-03T18:44:38.250997] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-03T18:44:38.395885] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-03T18:44:38.701887] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-03T18:44:38.701978] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-03T18:44:38.702343] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-03T18:44:38.702403] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-03T18:44:38.702941] [DEBUG] [LOCAL ] EOT: Trimmed 10762 records to 6963 (keeping 200 days of data) [2025-10-03T18:44:38.751454] [DEBUG] [LOCAL ] EOT: Primary data saved (6963 records). [2025-10-03T18:44:38.751602] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-03T18:44:38.751726] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EOT took 38.3s. Estimated remaining: 3h 45m 52s. Rate: 7.2 symbols/min [2025-10-03T18:44:38.956208] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:39.021580] [DEBUG] [LOCAL ] EPD: Loaded 53999 existing records from primary storage. [2025-10-03T18:44:39.022028] [INFO ] [MAIN ] EPD: Loaded 53999 existing records. [2025-10-03T18:44:39.195879] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-03T18:44:39.242580] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:39.242872] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-03T18:44:39.242928] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-03T18:44:39.244371] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-03T18:44:39.244441] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-03T18:44:39.623004] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:39.990689] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-03T18:44:40.036406] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T18:44:40.720857] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T18:44:40.790700] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-03T18:44:41.590704] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-03T18:44:41.977161] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-03T18:44:42.136553] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-03T18:44:42.390709] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-03T18:44:43.190945] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-03T18:44:43.190854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:44:43.577474] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T18:44:43.990701] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-03T18:44:44.790637] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-03T18:44:44.864010] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T18:44:44.866220] [INFO ] [REMOTE ] EPAC: Full fetch complete (38980 records). [2025-10-03T18:44:44.887027] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-03T18:44:44.894827] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T18:44:45.364687] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-03T18:44:45.364782] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-03T18:44:45.365445] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-03T18:44:45.365533] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-03T18:44:45.366583] [DEBUG] [LOCAL ] EPAC: Trimmed 38980 records to 27317 (keeping 200 days of data) [2025-10-03T18:44:45.532697] [DEBUG] [LOCAL ] EPAC: Primary data saved (27317 records). [2025-10-03T18:44:45.532855] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-03T18:44:45.532949] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPAC took 32.6s. Estimated remaining: 3h 45m 40s. Rate: 7.2 symbols/min [2025-10-03T18:44:45.603795] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-03T18:44:45.727707] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:45.784411] [DEBUG] [LOCAL ] EPR: Loaded 44243 existing records from primary storage. [2025-10-03T18:44:45.784783] [INFO ] [MAIN ] EPR: Loaded 44243 existing records. [2025-10-03T18:44:45.986090] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:45.986329] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-03T18:44:45.986390] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-03T18:44:45.987600] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-03T18:44:45.987700] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-03T18:44:46.414214] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:46.407442] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-03T18:44:46.688530] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:44:47.190699] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-03T18:44:47.226356] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T18:44:47.806977] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:44:47.990709] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-03T18:44:48.790631] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-03T18:44:48.823924] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T18:44:49.530156] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T18:44:49.590616] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-03T18:44:50.390702] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-03T18:44:50.600760] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-03T18:44:51.190701] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-03T18:44:51.343094] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:44:51.646535] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T18:44:51.990677] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-03T18:44:52.374475] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T18:44:52.377263] [INFO ] [REMOTE ] EPC: Full fetch complete (57009 records). [2025-10-03T18:44:52.377377] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-03T18:44:52.802897] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-03T18:44:52.805962] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-03T18:44:52.806815] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-03T18:44:52.807632] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-03T18:44:52.807829] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-03T18:44:52.809237] [DEBUG] [LOCAL ] EPC: Trimmed 57009 records to 40372 (keeping 200 days of data) [2025-10-03T18:44:53.065798] [DEBUG] [LOCAL ] EPC: Primary data saved (40372 records). [2025-10-03T18:44:53.065936] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-03T18:44:53.066036] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPC took 35.3s. Estimated remaining: 3h 45m 30s. Rate: 7.2 symbols/min [2025-10-03T18:44:53.255455] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:53.313509] [DEBUG] [LOCAL ] EPRT: Loaded 48821 existing records from primary storage. [2025-10-03T18:44:53.313960] [INFO ] [MAIN ] EPRT: Loaded 48821 existing records. [2025-10-03T18:44:53.432813] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T18:44:53.461285] [INFO ] [REMOTE ] EPAM: Full fetch complete (56078 records). [2025-10-03T18:44:53.487180] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-03T18:44:53.558684] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:44:53.594574] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-03T18:44:53.599920] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-03T18:44:53.594394] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-03T18:44:53.633295] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-03T18:44:53.638450] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-03T18:44:54.269842] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-03T18:44:54.287332] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-03T18:44:54.303214] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-03T18:44:54.308037] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-03T18:44:54.374133] [DEBUG] [LOCAL ] EPAM: Trimmed 56078 records to 40286 (keeping 200 days of data) [2025-10-03T18:44:54.398928] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:54.400229] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-03T18:44:54.520927] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T18:44:54.688059] [DEBUG] [LOCAL ] EPAM: Primary data saved (40286 records). [2025-10-03T18:44:54.688193] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-03T18:44:54.688321] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPAM took 37.8s. Estimated remaining: 3h 45m 8s. Rate: 7.2 symbols/min [2025-10-03T18:44:54.873317] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:44:54.873485] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-03T18:44:54.873525] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-03T18:44:54.873636] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-03T18:44:54.873717] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-03T18:44:54.873767] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-03T18:44:54.873802] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-03T18:44:55.194332] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-03T18:44:55.251630] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:44:55.739464] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-03T18:44:55.990719] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-03T18:44:56.139208] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T18:44:56.790632] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-03T18:44:56.941078] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T18:44:57.590735] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-03T18:44:58.054144] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-03T18:44:58.372143] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:44:58.390628] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-03T18:44:58.970096] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T18:44:59.190729] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-03T18:44:59.680308] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:44:59.990686] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-03T18:45:00.790667] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-03T18:45:00.867047] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T18:45:01.064755] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T18:45:01.590705] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-03T18:45:02.390721] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-03T18:45:02.815125] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:45:03.190730] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-03T18:45:03.223228] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T18:45:03.471301] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T18:45:03.990730] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-03T18:45:04.790692] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-03T18:45:04.851609] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:45:05.590680] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-03T18:45:05.976589] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T18:45:06.390626] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-03T18:45:06.485524] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-03T18:45:06.743126] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:45:07.190742] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-03T18:45:07.990625] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-03T18:45:08.148350] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-03T18:45:08.422960] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T18:45:08.790726] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-03T18:45:09.401589] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T18:45:09.590748] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-03T18:45:10.390727] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-03T18:45:10.755443] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:45:11.148847] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:45:11.190688] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-03T18:45:11.348523] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-03T18:45:11.990725] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-03T18:45:12.661057] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T18:45:12.790700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-03T18:45:13.521753] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T18:45:13.590696] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-03T18:45:13.624518] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:45:14.390743] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-03T18:45:15.190674] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-03T18:45:15.284382] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:45:15.990693] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-03T18:45:16.104213] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T18:45:16.416948] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:45:16.790729] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-03T18:45:17.370461] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:45:17.590721] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-03T18:45:18.074410] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:45:18.076819] [INFO ] [REMOTE ] EPR: Full fetch complete (62691 records). [2025-10-03T18:45:18.077025] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-03T18:45:18.078135] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:18.078239] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:18.078286] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:18.078380] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-03T18:45:18.078469] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-03T18:45:18.078566] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-10-03T18:45:18.078907] [DEBUG] [LOCAL ] EPR: Deleted derivative data file. [2025-10-03T18:45:18.081517] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPR took 32.5s. Estimated remaining: 3h 45m 31s. Rate: 7.2 symbols/min [2025-10-03T18:45:18.301532] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:18.372585] [DEBUG] [LOCAL ] EQH: Loaded 53042 existing records from primary storage. [2025-10-03T18:45:18.372975] [INFO ] [MAIN ] EQH: Loaded 53042 existing records. [2025-10-03T18:45:18.395814] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-03T18:45:18.575312] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:18.575527] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-03T18:45:18.575575] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-03T18:45:18.577226] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-03T18:45:18.577290] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-03T18:45:18.953987] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:19.190715] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-03T18:45:19.311116] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T18:45:19.314383] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-03T18:45:19.314536] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-03T18:45:19.437444] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T18:45:19.759616] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-03T18:45:19.759748] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-03T18:45:19.760671] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-03T18:45:19.760745] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-03T18:45:19.762362] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 54388 (keeping 200 days of data) [2025-10-03T18:45:19.993099] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-03T18:45:20.110421] [DEBUG] [LOCAL ] EPD: Primary data saved (54388 records). [2025-10-03T18:45:20.110562] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-03T18:45:20.111593] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EPD took 41.4s. Estimated remaining: 3h 45m 9s. Rate: 7.2 symbols/min [2025-10-03T18:45:20.302530] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:20.363100] [DEBUG] [LOCAL ] EQNR: Loaded 53416 existing records from primary storage. [2025-10-03T18:45:20.363516] [INFO ] [MAIN ] EQNR: Loaded 53416 existing records. [2025-10-03T18:45:20.566819] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:20.567068] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-03T18:45:20.567118] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-03T18:45:20.568901] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-03T18:45:20.568964] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-03T18:45:20.798348] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-03T18:45:20.962019] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T18:45:21.003589] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:21.033496] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T18:45:21.590672] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-03T18:45:22.390755] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-03T18:45:22.660014] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T18:45:23.190725] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-03T18:45:23.556872] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T18:45:23.990731] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-03T18:45:24.199493] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:45:24.790718] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-03T18:45:24.885037] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:45:25.590700] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-03T18:45:25.863793] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T18:45:26.182727] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:45:26.189195] [INFO ] [REMOTE ] EPRT: Full fetch complete (68866 records). [2025-10-03T18:45:26.189387] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-03T18:45:26.392393] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-03T18:45:26.400459] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T18:45:26.634166] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-03T18:45:26.634275] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-03T18:45:26.635286] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-03T18:45:26.635363] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-03T18:45:26.636955] [DEBUG] [LOCAL ] EPRT: Trimmed 68866 records to 49188 (keeping 200 days of data) [2025-10-03T18:45:26.945751] [DEBUG] [LOCAL ] EPRT: Primary data saved (49188 records). [2025-10-03T18:45:26.945897] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-03T18:45:26.945985] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPRT took 33.9s. Estimated remaining: 3h 44m 58s. Rate: 7.2 symbols/min [2025-10-03T18:45:27.129606] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:27.178146] [DEBUG] [LOCAL ] EQR: Loaded 51894 existing records from primary storage. [2025-10-03T18:45:27.178482] [INFO ] [MAIN ] EQR: Loaded 51894 existing records. [2025-10-03T18:45:27.200141] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-03T18:45:27.369540] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:27.369799] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-03T18:45:27.369859] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-03T18:45:27.371281] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-03T18:45:27.371349] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-03T18:45:27.799729] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:27.985165] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:45:27.986799] [INFO ] [REMOTE ] EQBK: Full fetch complete (15403 records). [2025-10-03T18:45:27.986903] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-03T18:45:27.987714] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:27.987820] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:27.987907] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:27.988001] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-03T18:45:27.988093] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-03T18:45:27.988155] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-03T18:45:27.988224] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-03T18:45:27.988311] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EQBK took 33.3s. Estimated remaining: 3h 44m 34s. Rate: 7.2 symbols/min [2025-10-03T18:45:27.990619] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-03T18:45:28.066597] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T18:45:28.790751] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-03T18:45:29.590744] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-03T18:45:29.762381] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T18:45:30.390776] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-03T18:45:30.540167] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:45:31.190707] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-03T18:45:31.525479] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:45:31.990725] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-03T18:45:32.125301] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:45:32.790735] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-03T18:45:33.179340] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T18:45:33.590760] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-03T18:45:33.910273] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T18:45:34.390720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-03T18:45:34.524458] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T18:45:35.190728] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-03T18:45:35.626631] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T18:45:35.990634] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-03T18:45:36.103712] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:45:36.770728] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:45:36.790634] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-03T18:45:37.590751] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-03T18:45:37.770499] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T18:45:38.392338] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-03T18:45:38.395622] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:45:39.190687] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-03T18:45:39.331869] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T18:45:39.990697] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-03T18:45:40.189337] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T18:45:40.591457] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T18:45:40.790693] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-03T18:45:41.590738] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-03T18:45:41.946722] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-03T18:45:42.390826] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-03T18:45:42.651219] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T18:45:43.190665] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-03T18:45:43.657177] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T18:45:43.990724] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-03T18:45:44.036430] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:45:44.790728] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-03T18:45:45.077436] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:45:45.590762] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-03T18:45:46.059048] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-03T18:45:46.390709] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-03T18:45:46.608767] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:45:46.938074] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:45:46.942628] [INFO ] [REMOTE ] EQH: Full fetch complete (75994 records). [2025-10-03T18:45:46.942862] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-03T18:45:46.944062] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:46.944201] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:46.944283] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:46.944370] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-03T18:45:46.944493] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-10-03T18:45:46.944566] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-10-03T18:45:46.944851] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-10-03T18:45:46.945961] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 28.9s. Estimated remaining: 3h 44m 48s. Rate: 7.2 symbols/min [2025-10-03T18:45:47.190712] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-03T18:45:48.172158] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T18:45:48.186460] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-03T18:45:48.864963] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:45:48.877128] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-03T18:45:50.147929] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-03T18:45:50.150320] [INFO ] [REMOTE ] EQNR: Full fetch complete (76432 records). [2025-10-03T18:45:50.150469] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-03T18:45:50.151693] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T18:45:50.151811] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:45:50.151858] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:45:50.151927] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-03T18:45:50.151996] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-10-03T18:45:50.152033] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-10-03T18:45:50.152218] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-10-03T18:45:50.152846] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQNR took 30.0s. Estimated remaining: 3h 44m 29s. Rate: 7.2 symbols/min [2025-10-03T18:45:50.931526] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:45:50.943795] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-03T18:45:53.921297] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (2.98 seconds). [2025-10-03T18:45:53.924070] [INFO ] [REMOTE ] EQR: Full fetch complete (74019 records). [2025-10-03T18:45:53.924219] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-03T18:45:54.351029] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-03T18:45:54.351171] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-03T18:45:54.352224] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-03T18:45:54.352356] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-03T18:45:54.354144] [DEBUG] [LOCAL ] EQR: Trimmed 74019 records to 52274 (keeping 200 days of data) [2025-10-03T18:45:54.689837] [DEBUG] [LOCAL ] EQR: Primary data saved (52274 records). [2025-10-03T18:45:54.689983] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-03T18:45:54.690093] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQR took 27.7s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-03T18:45:55.380475] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.389751] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.447793] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-03T18:45:55.449925] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.456747] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-03T18:45:55.459666] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-03T18:45:55.481470] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-03T18:45:55.486618] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:45:55.487255] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-03T18:45:55.490687] [DEBUG] [LOCAL ] EQV: Loaded 2747 existing records from primary storage. [2025-10-03T18:45:55.491156] [INFO ] [MAIN ] EQV: Loaded 2747 existing records. [2025-10-03T18:45:55.490463] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-03T18:45:55.979663] [DEBUG] [LOCAL ] ERJ: Loaded 51007 existing records from primary storage. [2025-10-03T18:45:55.977623] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.008186] [INFO ] [MAIN ] ERJ: Loaded 51007 existing records. [2025-10-03T18:45:56.008464] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-03T18:45:56.054309] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-10-03T18:45:56.084322] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-03T18:45:56.107988] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-03T18:45:56.108189] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-03T18:45:56.113733] [INFO ] [MAIN ] EQT: Loaded 54072 existing records. [2025-10-03T18:45:56.851248] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:56.945921] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-03T18:45:56.901318] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.945208] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:45:56.995985] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-03T18:45:56.979123] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-03T18:45:57.047081] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-03T18:45:57.047320] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-03T18:45:57.054791] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-03T18:45:57.054702] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-03T18:45:57.095544] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-03T18:45:57.111442] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-03T18:45:57.220513] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:57.292506] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-03T18:45:57.622530] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T18:45:57.677162] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-03T18:45:58.002479] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:58.008683] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:45:58.009144] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-03T18:45:58.009410] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-03T18:45:58.146197] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-03T18:45:58.147356] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-03T18:45:58.214243] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T18:45:58.216419] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-03T18:45:58.486761] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T18:45:58.487848] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-03T18:45:58.838038] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T18:45:58.839042] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-03T18:45:58.962303] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:45:58.965132] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-03T18:45:59.165095] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-03T18:45:59.166085] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-03T18:45:59.463133] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T18:45:59.465311] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-03T18:45:59.693060] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T18:45:59.721089] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:45:59.843716] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-03T18:45:59.901255] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T18:45:59.990691] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-03T18:46:00.484850] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-03T18:46:00.790691] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-03T18:46:01.590737] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-03T18:46:02.395826] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-03T18:46:02.413968] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:46:02.940434] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T18:46:03.190720] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-03T18:46:03.740880] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T18:46:03.758853] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:46:03.990752] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-03T18:46:04.322966] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T18:46:04.790699] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-03T18:46:05.369248] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:46:05.590723] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-03T18:46:06.390746] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-03T18:46:06.987533] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T18:46:07.190707] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-03T18:46:07.370280] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T18:46:07.990700] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-03T18:46:08.569003] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T18:46:08.790706] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-03T18:46:08.846869] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T18:46:09.590712] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-03T18:46:10.067418] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:46:10.068150] [INFO ] [REMOTE ] EQS: Full fetch complete (2497 records). [2025-10-03T18:46:10.068222] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-03T18:46:10.261883] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-03T18:46:10.262172] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:46:10.262242] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:46:10.262317] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-03T18:46:10.262385] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-03T18:46:10.262423] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-03T18:46:10.262468] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-03T18:46:10.262529] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQS took 15.6s. Estimated remaining: 3h 44m 19s. Rate: 7.2 symbols/min [2025-10-03T18:46:10.390695] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-03T18:46:10.452723] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:10.495843] [DEBUG] [LOCAL ] ERO: Loaded 41598 existing records from primary storage. [2025-10-03T18:46:10.496195] [INFO ] [MAIN ] ERO: Loaded 41598 existing records. [2025-10-03T18:46:10.710578] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:10.710941] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-03T18:46:10.711050] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-03T18:46:10.722982] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-03T18:46:10.728172] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-03T18:46:10.808353] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T18:46:11.155382] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:11.190736] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-03T18:46:11.990677] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-03T18:46:12.440429] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T18:46:12.571124] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:46:12.790696] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-03T18:46:13.590719] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-03T18:46:13.737599] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T18:46:14.247792] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T18:46:14.390740] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-03T18:46:15.190724] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-03T18:46:15.560463] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:46:15.822418] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:46:15.990694] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-03T18:46:16.387499] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:46:16.790731] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-03T18:46:17.590732] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-03T18:46:17.795748] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T18:46:18.281332] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T18:46:18.390694] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-03T18:46:19.150928] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:46:19.190726] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-03T18:46:19.516987] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-03T18:46:19.911600] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T18:46:19.990712] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-03T18:46:20.790710] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-03T18:46:21.590736] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-03T18:46:22.117211] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T18:46:22.283564] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-03T18:46:22.390711] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-03T18:46:23.190738] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-03T18:46:23.544272] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:46:23.691666] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T18:46:23.990717] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-03T18:46:24.790673] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-03T18:46:25.320955] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T18:46:25.319447] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T18:46:25.590635] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-03T18:46:25.778180] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:46:26.390687] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-03T18:46:27.190736] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-03T18:46:27.547303] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-03T18:46:27.629705] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:46:27.978950] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:46:27.990534] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-03T18:46:28.790687] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-03T18:46:29.467429] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T18:46:29.470310] [INFO ] [REMOTE ] ERJ: Full fetch complete (72470 records). [2025-10-03T18:46:29.470426] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-03T18:46:29.595834] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-03T18:46:29.918056] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-03T18:46:29.918153] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-03T18:46:29.919144] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-03T18:46:29.919250] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-03T18:46:29.920991] [DEBUG] [LOCAL ] ERJ: Trimmed 72470 records to 51385 (keeping 200 days of data) [2025-10-03T18:46:30.252326] [DEBUG] [LOCAL ] ERJ: Primary data saved (51385 records). [2025-10-03T18:46:30.252773] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-03T18:46:30.253113] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. ERJ took 35.6s. Estimated remaining: 3h 44m 35s. Rate: 7.2 symbols/min [2025-10-03T18:46:30.391121] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-03T18:46:30.444152] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:30.478432] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:46:30.541822] [DEBUG] [LOCAL ] ES: Loaded 52959 existing records from primary storage. [2025-10-03T18:46:30.542202] [INFO ] [MAIN ] ES: Loaded 52959 existing records. [2025-10-03T18:46:30.732267] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:30.732514] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-03T18:46:30.732579] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-03T18:46:30.734159] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-03T18:46:30.734224] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-03T18:46:30.914337] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:46:30.964990] [INFO ] [REMOTE ] EQV: Full fetch complete (5774 records). [2025-10-03T18:46:30.978766] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-03T18:46:31.194399] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-03T18:46:31.309006] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:31.555268] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-03T18:46:31.555417] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-03T18:46:31.555791] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-03T18:46:31.555915] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-03T18:46:31.557034] [DEBUG] [LOCAL ] EQV: Trimmed 5774 records to 2754 (keeping 200 days of data) [2025-10-03T18:46:31.576020] [DEBUG] [LOCAL ] EQV: Primary data saved (2754 records). [2025-10-03T18:46:31.576408] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-03T18:46:31.576688] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. EQV took 36.9s. Estimated remaining: 3h 44m 12s. Rate: 7.2 symbols/min [2025-10-03T18:46:31.755633] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T18:46:31.825112] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:31.860758] [DEBUG] [LOCAL ] ESAB: Loaded 26272 existing records from primary storage. [2025-10-03T18:46:31.861063] [INFO ] [MAIN ] ESAB: Loaded 26272 existing records. [2025-10-03T18:46:31.995760] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-03T18:46:32.054817] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:32.055048] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-03T18:46:32.055107] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-03T18:46:32.056289] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-03T18:46:32.056359] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-03T18:46:32.427056] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:32.789821] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T18:46:32.798239] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-03T18:46:33.590678] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-03T18:46:33.827349] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T18:46:33.942947] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T18:46:34.390698] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-03T18:46:35.190688] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-03T18:46:35.361071] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:46:35.363906] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-03T18:46:35.364035] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-03T18:46:35.790490] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-03T18:46:35.790686] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-03T18:46:35.791741] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-03T18:46:35.791896] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-03T18:46:35.793721] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54462 (keeping 200 days of data) [2025-10-03T18:46:35.993552] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-03T18:46:36.096232] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:46:36.227532] [DEBUG] [LOCAL ] EQT: Primary data saved (54462 records). [2025-10-03T18:46:36.227710] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-03T18:46:36.228459] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. EQT took 41.5s. Estimated remaining: 3h 43m 56s. Rate: 7.2 symbols/min [2025-10-03T18:46:36.411322] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:36.430892] [DEBUG] [LOCAL ] ESE: Loaded 16803 existing records from primary storage. [2025-10-03T18:46:36.431178] [INFO ] [MAIN ] ESE: Loaded 16803 existing records. [2025-10-03T18:46:36.644123] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:36.644441] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-03T18:46:36.644495] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-03T18:46:36.645217] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-03T18:46:36.645317] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-03T18:46:36.795924] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-03T18:46:37.107097] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:37.110696] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-03T18:46:37.171541] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T18:46:37.590738] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-03T18:46:38.317920] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:46:38.322002] [INFO ] [REMOTE ] ERO: Full fetch complete (59575 records). [2025-10-03T18:46:38.322221] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-03T18:46:38.395947] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-03T18:46:38.878968] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T18:46:39.052426] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-03T18:46:39.052533] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-03T18:46:39.053401] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-03T18:46:39.053473] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-03T18:46:39.055768] [DEBUG] [LOCAL ] ERO: Trimmed 59575 records to 41941 (keeping 200 days of data) [2025-10-03T18:46:39.192764] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-03T18:46:39.346085] [DEBUG] [LOCAL ] ERO: Primary data saved (41941 records). [2025-10-03T18:46:39.346218] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-03T18:46:39.346301] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ERO took 29.1s. Estimated remaining: 3h 43m 37s. Rate: 7.2 symbols/min [2025-10-03T18:46:39.519851] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:46:39.568989] [DEBUG] [LOCAL ] ESI: Loaded 51102 existing records from primary storage. [2025-10-03T18:46:39.569336] [INFO ] [MAIN ] ESI: Loaded 51102 existing records. [2025-10-03T18:46:39.762621] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:46:39.762983] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-03T18:46:39.763068] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-03T18:46:39.764946] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-03T18:46:39.765015] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-03T18:46:39.996200] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-03T18:46:40.189638] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:46:40.218237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:46:40.254875] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:46:40.790683] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-03T18:46:40.855887] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T18:46:41.590705] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-03T18:46:42.295311] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T18:46:42.390725] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-03T18:46:43.190693] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-03T18:46:43.271531] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:46:43.891745] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T18:46:43.973356] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T18:46:43.990686] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-03T18:46:44.790689] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-03T18:46:45.069155] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T18:46:45.590685] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-03T18:46:46.390702] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-03T18:46:46.626174] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T18:46:46.915534] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T18:46:47.121615] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T18:46:47.190682] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-03T18:46:47.990713] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-03T18:46:48.302164] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:46:48.790730] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-03T18:46:49.539968] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:46:49.590637] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-03T18:46:49.917863] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T18:46:50.390733] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-03T18:46:50.715882] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:46:51.190698] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-03T18:46:51.990670] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-03T18:46:52.129611] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:46:52.180048] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T18:46:52.790718] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-03T18:46:53.590699] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-03T18:46:53.631553] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:46:53.861499] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:46:54.390724] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-03T18:46:55.190663] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-03T18:46:55.405699] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:46:55.447492] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:46:55.990714] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-03T18:46:56.790634] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-03T18:46:57.024606] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T18:46:57.053425] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T18:46:57.590712] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-03T18:46:58.038962] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T18:46:58.390728] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-03T18:46:59.190686] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-03T18:46:59.252071] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T18:46:59.990712] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-03T18:47:00.212599] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T18:47:00.613161] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T18:47:00.790710] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-03T18:47:00.817073] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T18:47:01.590727] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-03T18:47:02.390670] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-03T18:47:02.648589] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-03T18:47:03.190633] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-03T18:47:03.337063] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-03T18:47:03.338867] [INFO ] [REMOTE ] ESE: Full fetch complete (22398 records). [2025-10-03T18:47:03.338980] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-03T18:47:03.660162] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T18:47:03.809178] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-03T18:47:03.809263] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-03T18:47:03.809783] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-03T18:47:03.809849] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-03T18:47:03.810679] [DEBUG] [LOCAL ] ESE: Trimmed 22398 records to 16903 (keeping 200 days of data) [2025-10-03T18:47:03.923751] [DEBUG] [LOCAL ] ESE: Primary data saved (16903 records). [2025-10-03T18:47:03.923898] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-03T18:47:03.924008] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ESE took 27.7s. Estimated remaining: 3h 44m 2s. Rate: 7.2 symbols/min [2025-10-03T18:47:03.995868] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-03T18:47:04.114087] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:04.161625] [DEBUG] [LOCAL ] ESNT: Loaded 38632 existing records from primary storage. [2025-10-03T18:47:04.162157] [INFO ] [MAIN ] ESNT: Loaded 38632 existing records. [2025-10-03T18:47:04.361664] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:04.362114] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-03T18:47:04.362177] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-03T18:47:04.363582] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-03T18:47:04.363683] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-03T18:47:04.647872] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T18:47:04.788697] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:04.790617] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-03T18:47:05.590678] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-03T18:47:05.791513] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T18:47:06.379828] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T18:47:06.390610] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-03T18:47:07.190699] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-03T18:47:07.477303] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T18:47:07.913093] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:47:07.990706] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-03T18:47:08.778931] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T18:47:08.790725] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-03T18:47:09.572306] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:47:09.574940] [INFO ] [REMOTE ] ES: Full fetch complete (76225 records). [2025-10-03T18:47:09.575057] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-03T18:47:09.597298] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-03T18:47:10.003133] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-03T18:47:10.003249] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-03T18:47:10.004590] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-03T18:47:10.004735] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-03T18:47:10.006725] [DEBUG] [LOCAL ] ES: Trimmed 76225 records to 53348 (keeping 200 days of data) [2025-10-03T18:47:10.347971] [DEBUG] [LOCAL ] ES: Primary data saved (53348 records). [2025-10-03T18:47:10.348140] [INFO ] [MAIN ] ES: Full history saved. [2025-10-03T18:47:10.348409] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ES took 40.1s. Estimated remaining: 3h 43m 50s. Rate: 7.2 symbols/min [2025-10-03T18:47:10.397526] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-03T18:47:10.471808] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T18:47:10.626743] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:10.669931] [DEBUG] [LOCAL ] ESRT: Loaded 46767 existing records from primary storage. [2025-10-03T18:47:10.671058] [INFO ] [MAIN ] ESRT: Loaded 46767 existing records. [2025-10-03T18:47:10.881844] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:10.882086] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-03T18:47:10.882141] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-03T18:47:10.883424] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-03T18:47:10.883523] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-03T18:47:10.964237] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:47:11.012721] [INFO ] [REMOTE ] ESAB: Full fetch complete (35954 records). [2025-10-03T18:47:11.023806] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-03T18:47:11.198558] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-03T18:47:11.679002] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:11.772723] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-03T18:47:11.772832] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-03T18:47:11.773470] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-03T18:47:11.773532] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-03T18:47:11.774736] [DEBUG] [LOCAL ] ESAB: Trimmed 35954 records to 26556 (keeping 200 days of data) [2025-10-03T18:47:11.971356] [DEBUG] [LOCAL ] ESAB: Primary data saved (26556 records). [2025-10-03T18:47:11.971578] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-03T18:47:11.971824] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESAB took 40.4s. Estimated remaining: 3h 43m 27s. Rate: 7.2 symbols/min [2025-10-03T18:47:11.995871] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-03T18:47:12.177336] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:12.199887] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:47:12.248156] [DEBUG] [LOCAL ] ESS: Loaded 30187 existing records from primary storage. [2025-10-03T18:47:12.248426] [INFO ] [MAIN ] ESS: Loaded 30187 existing records. [2025-10-03T18:47:12.443945] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:12.444186] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-03T18:47:12.444239] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-03T18:47:12.445280] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-03T18:47:12.445342] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-03T18:47:12.799181] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-03T18:47:12.848230] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:12.875304] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T18:47:13.590702] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-03T18:47:13.689421] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T18:47:14.311156] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T18:47:14.313982] [INFO ] [REMOTE ] ESI: Full fetch complete (72711 records). [2025-10-03T18:47:14.314159] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-03T18:47:14.395796] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-03T18:47:14.766300] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-03T18:47:14.766391] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-03T18:47:14.767361] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-03T18:47:14.767430] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-03T18:47:14.769097] [DEBUG] [LOCAL ] ESI: Trimmed 72711 records to 51476 (keeping 200 days of data) [2025-10-03T18:47:15.100500] [DEBUG] [LOCAL ] ESI: Primary data saved (51476 records). [2025-10-03T18:47:15.100830] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-03T18:47:15.101029] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESI took 35.8s. Estimated remaining: 3h 43m 8s. Rate: 7.2 symbols/min [2025-10-03T18:47:15.191690] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-03T18:47:15.324416] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:47:15.328558] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:15.383784] [DEBUG] [LOCAL ] ESTC: Loaded 50315 existing records from primary storage. [2025-10-03T18:47:15.384139] [INFO ] [MAIN ] ESTC: Loaded 50315 existing records. [2025-10-03T18:47:15.593231] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:15.593490] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-03T18:47:15.593540] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-03T18:47:15.594886] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-03T18:47:15.594949] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-03T18:47:16.000316] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-03T18:47:16.064995] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:16.081176] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:47:16.233450] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T18:47:16.790715] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-03T18:47:17.207249] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-03T18:47:17.590716] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-03T18:47:18.390636] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-03T18:47:18.512559] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:47:18.878309] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:47:19.190721] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-03T18:47:19.659812] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:47:19.990718] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-03T18:47:20.454864] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T18:47:20.790717] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-03T18:47:21.428819] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:47:21.590722] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-03T18:47:22.380892] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T18:47:22.391066] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-03T18:47:22.959979] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:47:23.190701] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-03T18:47:23.769540] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T18:47:23.990707] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-03T18:47:24.790675] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-03T18:47:24.917352] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:47:24.964358] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:47:25.590748] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-03T18:47:26.296075] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:47:26.390710] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-03T18:47:26.917943] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:47:27.190751] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-03T18:47:27.990727] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-03T18:47:28.078147] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:47:28.536435] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T18:47:28.538955] [INFO ] [REMOTE ] ESNT: Full fetch complete (57102 records). [2025-10-03T18:47:28.539090] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-03T18:47:28.798764] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-03T18:47:28.970488] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-03T18:47:28.970587] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-03T18:47:28.971398] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-03T18:47:28.971467] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-03T18:47:28.972903] [DEBUG] [LOCAL ] ESNT: Trimmed 57102 records to 38930 (keeping 200 days of data) [2025-10-03T18:47:29.228541] [DEBUG] [LOCAL ] ESNT: Primary data saved (38930 records). [2025-10-03T18:47:29.228756] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-03T18:47:29.229632] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESNT took 25.3s. Estimated remaining: 3h 43m 12s. Rate: 7.2 symbols/min [2025-10-03T18:47:29.367897] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T18:47:29.451432] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:29.509747] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-10-03T18:47:29.510118] [INFO ] [MAIN ] ET: Loaded 54179 existing records. [2025-10-03T18:47:29.596424] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-03T18:47:29.710676] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:29.710888] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-03T18:47:29.710938] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-03T18:47:29.712381] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-03T18:47:29.712458] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-03T18:47:30.141872] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:30.179010] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:47:30.390793] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-03T18:47:31.149200] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:47:31.190706] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-03T18:47:31.990696] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-03T18:47:32.208841] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:47:32.790687] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-03T18:47:33.404124] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T18:47:33.591540] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-03T18:47:33.594228] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T18:47:34.293086] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T18:47:34.390703] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-03T18:47:34.887856] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:47:35.190689] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-03T18:47:35.739057] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T18:47:35.990705] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-03T18:47:36.458085] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:47:36.790692] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-03T18:47:37.590686] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-03T18:47:37.666251] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:47:37.741872] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T18:47:38.390701] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-03T18:47:38.957930] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:47:39.190701] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-03T18:47:39.990692] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-03T18:47:40.146685] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:47:40.790684] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-03T18:47:41.346147] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:47:41.390431] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T18:47:41.590688] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-03T18:47:42.171627] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:47:42.390681] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-03T18:47:43.190728] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-03T18:47:43.366423] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T18:47:43.417965] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T18:47:43.990716] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-03T18:47:44.553963] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T18:47:44.556397] [INFO ] [REMOTE ] ESRT: Full fetch complete (66494 records). [2025-10-03T18:47:44.556518] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-03T18:47:44.795744] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-03T18:47:44.989250] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-03T18:47:44.989350] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-03T18:47:44.990389] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-03T18:47:44.990456] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-03T18:47:44.992212] [DEBUG] [LOCAL ] ESRT: Trimmed 66494 records to 47041 (keeping 200 days of data) [2025-10-03T18:47:45.085128] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T18:47:45.091350] [INFO ] [REMOTE ] ESS: Full fetch complete (43478 records). [2025-10-03T18:47:45.092577] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-03T18:47:45.618331] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-03T18:47:45.638391] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-03T18:47:45.638558] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-03T18:47:45.639356] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-03T18:47:45.641902] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-03T18:47:45.647618] [DEBUG] [LOCAL ] ESS: Trimmed 43478 records to 30332 (keeping 200 days of data) [2025-10-03T18:47:45.860555] [DEBUG] [LOCAL ] ESRT: Primary data saved (47041 records). [2025-10-03T18:47:45.862614] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-03T18:47:45.863125] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESRT took 35.5s. Estimated remaining: 3h 43m 20s. Rate: 7.2 symbols/min [2025-10-03T18:47:46.110130] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:46.140821] [DEBUG] [LOCAL ] ESS: Primary data saved (30332 records). [2025-10-03T18:47:46.139083] [DEBUG] [LOCAL ] ETB: Loaded 12219 existing records from primary storage. [2025-10-03T18:47:46.141213] [INFO ] [MAIN ] ETB: Loaded 12219 existing records. [2025-10-03T18:47:46.186116] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-03T18:47:46.213627] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESS took 34.2s. Estimated remaining: 3h 42m 55s. Rate: 7.2 symbols/min [2025-10-03T18:47:46.455032] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:46.528231] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-03T18:47:46.533018] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-03T18:47:46.532878] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:46.534532] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-03T18:47:46.534700] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-03T18:47:46.756041] [DEBUG] [LOCAL ] ETD: Loaded 27624 existing records from primary storage. [2025-10-03T18:47:46.772810] [INFO ] [MAIN ] ETD: Loaded 27624 existing records. [2025-10-03T18:47:46.849596] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:47:47.020241] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-03T18:47:47.200917] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:47:47.224148] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:47.224511] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-03T18:47:47.224566] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-03T18:47:47.225485] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-03T18:47:47.226501] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-03T18:47:47.226565] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-03T18:47:47.606871] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:47.637622] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T18:47:47.990739] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-03T18:47:48.246332] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T18:47:48.728109] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-03T18:47:48.730925] [INFO ] [REMOTE ] ESTC: Full fetch complete (72038 records). [2025-10-03T18:47:48.731064] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-03T18:47:48.800483] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-03T18:47:49.179264] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-03T18:47:49.179362] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-03T18:47:49.180299] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-03T18:47:49.180375] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-03T18:47:49.181992] [DEBUG] [LOCAL ] ESTC: Trimmed 72038 records to 50664 (keeping 200 days of data) [2025-10-03T18:47:49.485981] [DEBUG] [LOCAL ] ESTC: Primary data saved (50664 records). [2025-10-03T18:47:49.486126] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-03T18:47:49.486230] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ESTC took 34.4s. Estimated remaining: 3h 42m 36s. Rate: 7.2 symbols/min [2025-10-03T18:47:49.593749] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-03T18:47:49.690294] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:47:49.690546] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-10-03T18:47:49.690603] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-10-03T18:47:49.690770] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-03T18:47:49.690827] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-03T18:47:49.690875] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-03T18:47:49.690908] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-03T18:47:49.928214] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T18:47:50.131189] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:47:50.175336] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-03T18:47:50.390669] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-03T18:47:50.436180] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:47:51.190693] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-03T18:47:51.990723] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-03T18:47:52.188192] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T18:47:52.603204] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T18:47:52.654938] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:47:52.790725] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-03T18:47:53.590695] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-03T18:47:53.885475] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:47:54.390694] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-03T18:47:55.190676] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-03T18:47:55.341815] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T18:47:55.916545] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T18:47:55.944363] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T18:47:55.990733] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-03T18:47:56.790710] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-03T18:47:56.920769] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T18:47:57.590721] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-03T18:47:57.655839] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:47:58.390693] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-03T18:47:59.190736] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-03T18:47:59.216431] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-03T18:47:59.645895] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T18:47:59.990691] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-03T18:48:00.166229] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-03T18:48:00.790628] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-03T18:48:00.801230] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-03T18:48:01.590681] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-03T18:48:01.901190] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T18:48:02.390681] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-03T18:48:03.190716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-03T18:48:03.811364] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T18:48:03.990737] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-03T18:48:04.266864] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:48:04.779988] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:48:04.790612] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-03T18:48:04.875744] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-03T18:48:05.590702] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-03T18:48:05.682356] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-03T18:48:06.390716] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-03T18:48:07.190680] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-03T18:48:07.515403] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T18:48:07.824074] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-03T18:48:07.881393] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T18:48:07.883138] [INFO ] [REMOTE ] ETB: Full fetch complete (18256 records). [2025-10-03T18:48:07.883222] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-03T18:48:07.995805] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-03T18:48:08.313338] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-03T18:48:08.313430] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-03T18:48:08.313885] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-03T18:48:08.313948] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-03T18:48:08.315449] [DEBUG] [LOCAL ] ETB: Trimmed 18256 records to 12368 (keeping 200 days of data) [2025-10-03T18:48:08.393572] [DEBUG] [LOCAL ] ETB: Primary data saved (12368 records). [2025-10-03T18:48:08.393773] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-03T18:48:08.393913] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ETB took 22.5s. Estimated remaining: 3h 42m 50s. Rate: 7.2 symbols/min [2025-10-03T18:48:08.583120] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:08.605705] [DEBUG] [LOCAL ] ETJ: Loaded 16912 existing records from primary storage. [2025-10-03T18:48:08.606018] [INFO ] [MAIN ] ETJ: Loaded 16912 existing records. [2025-10-03T18:48:08.791020] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-03T18:48:08.805252] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:08.806262] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-03T18:48:08.806314] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-03T18:48:08.807019] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-03T18:48:08.807081] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-03T18:48:09.218476] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:09.233684] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T18:48:09.590733] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-03T18:48:10.349378] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T18:48:10.390688] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-03T18:48:11.039395] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T18:48:11.190713] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-03T18:48:11.372084] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T18:48:11.990723] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-03T18:48:12.261493] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T18:48:12.726154] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:48:12.790686] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-03T18:48:13.590735] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-03T18:48:14.390744] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-03T18:48:14.684785] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T18:48:14.741789] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-03T18:48:14.747026] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-03T18:48:14.747212] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-03T18:48:15.200298] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-03T18:48:15.229457] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-03T18:48:15.229630] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-03T18:48:15.230992] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-03T18:48:15.231222] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-03T18:48:15.233054] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54569 (keeping 200 days of data) [2025-10-03T18:48:15.344879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:48:15.610441] [DEBUG] [LOCAL ] ET: Primary data saved (54569 records). [2025-10-03T18:48:15.610634] [INFO ] [MAIN ] ET: Full history saved. [2025-10-03T18:48:15.612227] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ET took 46.4s. Estimated remaining: 3h 42m 39s. Rate: 7.2 symbols/min [2025-10-03T18:48:15.793228] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:15.860283] [DEBUG] [LOCAL ] ETN: Loaded 53136 existing records from primary storage. [2025-10-03T18:48:15.860615] [INFO ] [MAIN ] ETN: Loaded 53136 existing records. [2025-10-03T18:48:15.995845] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-03T18:48:16.057078] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:16.057310] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-03T18:48:16.057360] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-03T18:48:16.059211] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-03T18:48:16.059278] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-03T18:48:16.468372] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:16.795744] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-03T18:48:16.807601] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T18:48:17.152906] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T18:48:17.590720] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-03T18:48:18.390684] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-03T18:48:18.649508] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:48:18.914236] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T18:48:19.190705] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-03T18:48:19.463219] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:48:19.990638] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-03T18:48:20.094845] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T18:48:20.790673] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-03T18:48:21.590702] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-03T18:48:21.800335] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T18:48:21.828195] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T18:48:22.356706] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:48:22.358069] [INFO ] [REMOTE ] ETG: Full fetch complete (24863 records). [2025-10-03T18:48:22.358147] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-03T18:48:22.395740] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-03T18:48:22.754256] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-03T18:48:22.754354] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-03T18:48:22.754974] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-03T18:48:22.755041] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-03T18:48:22.756007] [DEBUG] [LOCAL ] ETG: Trimmed 24863 records to 16693 (keeping 200 days of data) [2025-10-03T18:48:22.879165] [DEBUG] [LOCAL ] ETG: Primary data saved (16693 records). [2025-10-03T18:48:22.879332] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-03T18:48:22.879442] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ETG took 33.4s. Estimated remaining: 3h 42m 28s. Rate: 7.2 symbols/min [2025-10-03T18:48:23.114289] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:23.131710] [DEBUG] [LOCAL ] ETO: Loaded 6595 existing records from primary storage. [2025-10-03T18:48:23.132043] [INFO ] [MAIN ] ETO: Loaded 6595 existing records. [2025-10-03T18:48:23.195893] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-03T18:48:23.474225] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:23.474699] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-03T18:48:23.474781] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-03T18:48:23.475343] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-03T18:48:23.475422] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-03T18:48:23.967707] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T18:48:23.994054] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-03T18:48:24.111506] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:24.790746] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-03T18:48:24.899164] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T18:48:25.157585] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-03T18:48:25.590690] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-03T18:48:26.110551] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:48:26.390686] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-03T18:48:26.456833] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T18:48:27.190720] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-03T18:48:27.990675] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-03T18:48:28.353374] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:48:28.458893] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-03T18:48:28.643505] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-03T18:48:28.790679] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-03T18:48:29.590629] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-03T18:48:29.786336] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T18:48:29.788012] [INFO ] [REMOTE ] ETD: Full fetch complete (38453 records). [2025-10-03T18:48:29.788092] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-03T18:48:30.202360] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-03T18:48:30.202449] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-03T18:48:30.203097] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-03T18:48:30.203183] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-03T18:48:30.204227] [DEBUG] [LOCAL ] ETD: Trimmed 38453 records to 27784 (keeping 200 days of data) [2025-10-03T18:48:30.388175] [DEBUG] [LOCAL ] ETD: Primary data saved (27784 records). [2025-10-03T18:48:30.388324] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-03T18:48:30.388442] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETD took 44.2s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-10-03T18:48:30.399615] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-03T18:48:30.577949] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:30.631323] [DEBUG] [LOCAL ] ETR: Loaded 53613 existing records from primary storage. [2025-10-03T18:48:30.631672] [INFO ] [MAIN ] ETR: Loaded 53613 existing records. [2025-10-03T18:48:30.813221] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:30.813434] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-03T18:48:30.813483] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-03T18:48:30.815149] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-03T18:48:30.815213] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-03T18:48:31.182875] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:31.190632] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-03T18:48:31.497030] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:48:31.674197] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:48:31.691722] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-03T18:48:31.990711] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-03T18:48:32.790677] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-03T18:48:32.920593] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:48:33.459103] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T18:48:33.590681] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-03T18:48:34.217516] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T18:48:34.390702] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-03T18:48:35.190692] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-03T18:48:35.990692] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-03T18:48:36.211447] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T18:48:36.435310] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-03T18:48:36.790694] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-03T18:48:37.215145] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-03T18:48:37.590695] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-03T18:48:38.390698] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-03T18:48:38.514546] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T18:48:39.148370] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T18:48:39.190671] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-03T18:48:39.471986] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T18:48:39.884215] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T18:48:39.990695] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-03T18:48:40.725737] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:48:40.790731] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-03T18:48:41.490766] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T18:48:41.590700] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-03T18:48:42.390685] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-03T18:48:42.565118] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T18:48:42.566824] [INFO ] [REMOTE ] ETJ: Full fetch complete (25679 records). [2025-10-03T18:48:42.566901] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-03T18:48:42.967810] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-03T18:48:42.967909] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-03T18:48:42.968413] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-03T18:48:42.968478] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-03T18:48:42.969328] [DEBUG] [LOCAL ] ETJ: Trimmed 25679 records to 17112 (keeping 200 days of data) [2025-10-03T18:48:43.077254] [DEBUG] [LOCAL ] ETJ: Primary data saved (17112 records). [2025-10-03T18:48:43.077443] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-03T18:48:43.077544] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETJ took 34.7s. Estimated remaining: 3h 42m 19s. Rate: 7.2 symbols/min [2025-10-03T18:48:43.195823] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-03T18:48:43.271734] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:43.296375] [DEBUG] [LOCAL ] ETV: Loaded 21812 existing records from primary storage. [2025-10-03T18:48:43.296726] [INFO ] [MAIN ] ETV: Loaded 21812 existing records. [2025-10-03T18:48:43.496976] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:43.497244] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-03T18:48:43.497296] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-03T18:48:43.497508] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-03T18:48:43.497599] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-03T18:48:43.994219] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:43.990133] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T18:48:43.994785] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-03T18:48:44.083011] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:48:44.790692] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-03T18:48:45.154784] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T18:48:45.590727] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-03T18:48:46.322291] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:48:46.367823] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T18:48:46.390690] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-03T18:48:47.190664] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-03T18:48:47.418493] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:48:47.856781] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T18:48:47.990718] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-03T18:48:48.617816] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T18:48:48.619027] [INFO ] [REMOTE ] ETO: Full fetch complete (9492 records). [2025-10-03T18:48:48.619108] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-03T18:48:48.790853] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-03T18:48:49.012294] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-03T18:48:49.012381] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-03T18:48:49.012634] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-03T18:48:49.012723] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-03T18:48:49.013282] [DEBUG] [LOCAL ] ETO: Trimmed 9492 records to 6702 (keeping 200 days of data) [2025-10-03T18:48:49.057959] [DEBUG] [LOCAL ] ETO: Primary data saved (6702 records). [2025-10-03T18:48:49.058123] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-03T18:48:49.058247] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETO took 26.2s. Estimated remaining: 3h 42m 5s. Rate: 7.2 symbols/min [2025-10-03T18:48:49.244930] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:48:49.272037] [DEBUG] [LOCAL ] ETW: Loaded 25372 existing records from primary storage. [2025-10-03T18:48:49.272304] [INFO ] [MAIN ] ETW: Loaded 25372 existing records. [2025-10-03T18:48:49.463773] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:48:49.464014] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-03T18:48:49.464088] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-03T18:48:49.464341] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-03T18:48:49.464401] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-03T18:48:49.595815] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-03T18:48:49.852573] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:48:49.921424] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T18:48:50.390685] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-03T18:48:51.190676] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-03T18:48:51.243262] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T18:48:51.750774] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:48:51.990708] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-03T18:48:52.790716] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-03T18:48:53.441872] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T18:48:53.590636] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-03T18:48:53.736258] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:48:53.816953] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T18:48:54.390712] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-03T18:48:55.190697] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-03T18:48:55.443339] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T18:48:55.990631] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-03T18:48:56.043347] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:48:56.284222] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T18:48:56.790674] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-03T18:48:57.001978] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T18:48:57.590744] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-03T18:48:58.390710] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-03T18:48:58.704065] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T18:48:58.739711] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:48:59.190695] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-03T18:48:59.325158] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T18:48:59.990707] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-03T18:49:00.097307] [DEBUG] [REMOTE ] ETV: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-03T18:49:00.097835] [WARN ] [REMOTE ] ETV: No data returned for month 2025-08 [2025-10-03T18:49:00.097937] [FATAL] [REMOTE ] ETV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:49:00.098037] [FATAL] [MAIN ] ETV: Failed to fetch primary data. [2025-10-03T18:49:00.098104] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:49:00.098180] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-03T18:49:00.098246] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-10-03T18:49:00.098285] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-10-03T18:49:00.098614] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-10-03T18:49:00.098733] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETV took 17.0s. Estimated remaining: 3h 42m 2s. Rate: 7.2 symbols/min [2025-10-03T18:49:00.297150] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:00.305429] [DEBUG] [LOCAL ] ETX: Loaded 5194 existing records from primary storage. [2025-10-03T18:49:00.305691] [INFO ] [MAIN ] ETX: Loaded 5194 existing records. [2025-10-03T18:49:00.454198] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:49:00.523660] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:00.523931] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-03T18:49:00.524106] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-03T18:49:00.524413] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-03T18:49:00.524473] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-03T18:49:00.795824] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-03T18:49:00.905369] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:01.590735] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-03T18:49:02.129566] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:49:02.276116] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T18:49:02.390722] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-03T18:49:03.190690] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-03T18:49:03.990715] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-03T18:49:04.158339] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T18:49:04.161271] [INFO ] [REMOTE ] ETN: Full fetch complete (76549 records). [2025-10-03T18:49:04.161453] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-03T18:49:04.517758] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-03T18:49:04.659281] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-03T18:49:04.659489] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-03T18:49:04.660516] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-03T18:49:04.660610] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-03T18:49:04.682889] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T18:49:04.692779] [DEBUG] [LOCAL ] ETN: Trimmed 76549 records to 53510 (keeping 200 days of data) [2025-10-03T18:49:04.790887] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-03T18:49:05.047431] [DEBUG] [LOCAL ] ETN: Primary data saved (53510 records). [2025-10-03T18:49:05.047580] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-03T18:49:05.051968] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETN took 49.4s. Estimated remaining: 3h 41m 47s. Rate: 7.2 symbols/min [2025-10-03T18:49:05.232767] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:05.258227] [DEBUG] [LOCAL ] ETY: Loaded 23009 existing records from primary storage. [2025-10-03T18:49:05.258515] [INFO ] [MAIN ] ETY: Loaded 23009 existing records. [2025-10-03T18:49:05.449164] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:05.449449] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-03T18:49:05.449507] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-03T18:49:05.449786] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-03T18:49:05.449844] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-03T18:49:05.597457] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-03T18:49:05.839815] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:05.896847] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T18:49:06.390712] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-03T18:49:07.190731] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-03T18:49:07.450384] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-03T18:49:07.572810] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T18:49:07.748421] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-03T18:49:07.990728] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-03T18:49:08.455949] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T18:49:08.790671] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-03T18:49:09.315146] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-03T18:49:09.590695] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-03T18:49:10.390631] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-03T18:49:10.787460] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:49:10.943336] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T18:49:11.190688] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-03T18:49:11.990686] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-03T18:49:12.327076] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T18:49:12.790671] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-03T18:49:13.098436] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T18:49:13.533054] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T18:49:13.590693] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-03T18:49:14.390726] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-03T18:49:15.190630] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-03T18:49:15.403887] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T18:49:15.632573] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:49:15.810720] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T18:49:15.990729] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-03T18:49:16.790704] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-03T18:49:17.138194] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T18:49:17.590710] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-03T18:49:18.390624] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-03T18:49:18.606367] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T18:49:18.611294] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T18:49:18.626868] [INFO ] [REMOTE ] ETW: Full fetch complete (36538 records). [2025-10-03T18:49:18.627448] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-03T18:49:19.048423] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-03T18:49:19.048540] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-03T18:49:19.049198] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-03T18:49:19.049264] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-03T18:49:19.050202] [DEBUG] [LOCAL ] ETW: Trimmed 36538 records to 25554 (keeping 200 days of data) [2025-10-03T18:49:19.192935] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-03T18:49:19.215095] [DEBUG] [LOCAL ] ETW: Primary data saved (25554 records). [2025-10-03T18:49:19.215246] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-03T18:49:19.215334] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETW took 30.2s. Estimated remaining: 3h 41m 50s. Rate: 7.2 symbols/min [2025-10-03T18:49:19.412146] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:19.433071] [DEBUG] [LOCAL ] EVC: Loaded 18719 existing records from primary storage. [2025-10-03T18:49:19.433360] [INFO ] [MAIN ] EVC: Loaded 18719 existing records. [2025-10-03T18:49:19.653097] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:19.654765] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-03T18:49:19.654593] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:49:19.654940] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-03T18:49:19.661263] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-03T18:49:19.661338] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-03T18:49:20.003496] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-03T18:49:20.046486] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:20.755599] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:49:20.758367] [INFO ] [REMOTE ] ETR: Full fetch complete (77094 records). [2025-10-03T18:49:20.758584] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-03T18:49:20.797411] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-03T18:49:20.887860] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T18:49:21.238157] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-03T18:49:21.238256] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-03T18:49:21.239201] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-03T18:49:21.239268] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-03T18:49:21.240873] [DEBUG] [LOCAL ] ETR: Trimmed 77094 records to 54002 (keeping 200 days of data) [2025-10-03T18:49:21.582502] [DEBUG] [LOCAL ] ETR: Primary data saved (54002 records). [2025-10-03T18:49:21.582697] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-03T18:49:21.583801] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETR took 51.2s. Estimated remaining: 3h 41m 30s. Rate: 7.2 symbols/min [2025-10-03T18:49:21.596045] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-03T18:49:21.811247] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:21.845535] [DEBUG] [LOCAL ] EVEX: Loaded 30868 existing records from primary storage. [2025-10-03T18:49:21.845878] [INFO ] [MAIN ] EVEX: Loaded 30868 existing records. [2025-10-03T18:49:22.042626] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:22.043148] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-03T18:49:22.057319] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-03T18:49:22.058622] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:49:22.058724] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-03T18:49:22.064450] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-03T18:49:22.380477] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:49:22.392246] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-03T18:49:22.512317] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:23.190617] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-03T18:49:23.657296] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T18:49:23.722769] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T18:49:23.723842] [INFO ] [REMOTE ] ETX: Full fetch complete (7089 records). [2025-10-03T18:49:23.723982] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-03T18:49:23.995779] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-03T18:49:24.108710] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-03T18:49:24.108802] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-03T18:49:24.109015] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-03T18:49:24.109057] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-03T18:49:24.109557] [DEBUG] [LOCAL ] ETX: Trimmed 7089 records to 5236 (keeping 200 days of data) [2025-10-03T18:49:24.151501] [DEBUG] [LOCAL ] ETX: Primary data saved (5236 records). [2025-10-03T18:49:24.151672] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-03T18:49:24.151876] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. ETX took 24.1s. Estimated remaining: 3h 41m 10s. Rate: 7.2 symbols/min [2025-10-03T18:49:24.331820] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:24.344728] [DEBUG] [LOCAL ] EVF: Loaded 9459 existing records from primary storage. [2025-10-03T18:49:24.344961] [INFO ] [MAIN ] EVF: Loaded 9459 existing records. [2025-10-03T18:49:24.531620] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:24.531856] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-03T18:49:24.531905] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-03T18:49:24.532083] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-03T18:49:24.532142] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-03T18:49:24.795997] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-03T18:49:24.907669] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:25.419533] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:49:25.590737] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-03T18:49:26.074199] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T18:49:26.219744] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:49:26.390690] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-03T18:49:27.190694] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-03T18:49:27.456383] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:49:27.990699] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-03T18:49:28.570097] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T18:49:28.790680] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-03T18:49:29.122949] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T18:49:29.590707] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-03T18:49:29.638574] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T18:49:30.192364] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T18:49:30.390693] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-03T18:49:30.977261] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:49:31.190708] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-03T18:49:31.990677] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-03T18:49:32.223756] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T18:49:32.734183] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T18:49:32.790693] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-03T18:49:33.590686] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-03T18:49:33.999883] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T18:49:34.343777] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T18:49:34.390638] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-03T18:49:35.190696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-03T18:49:35.442067] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T18:49:35.990707] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-03T18:49:36.248160] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T18:49:36.790684] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-03T18:49:37.053725] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:49:37.590701] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-03T18:49:37.798036] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T18:49:38.390627] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-03T18:49:38.690755] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T18:49:39.190724] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-03T18:49:39.487099] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T18:49:39.990696] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-03T18:49:40.191085] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T18:49:40.790736] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-03T18:49:40.987919] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T18:49:41.164348] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T18:49:41.590711] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-03T18:49:42.390749] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-03T18:49:42.792181] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:49:42.852057] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T18:49:43.190702] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-03T18:49:43.990688] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-03T18:49:44.484245] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:49:44.790718] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-03T18:49:44.827374] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T18:49:45.590713] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-03T18:49:46.344308] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:49:46.390698] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-03T18:49:46.648511] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T18:49:47.190740] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-03T18:49:47.409409] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:49:47.990718] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-03T18:49:48.174969] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T18:49:48.790693] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-03T18:49:49.012163] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:49:49.590677] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-03T18:49:49.730538] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T18:49:49.733536] [INFO ] [REMOTE ] ETY: Full fetch complete (34344 records). [2025-10-03T18:49:49.733685] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-03T18:49:50.144797] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-03T18:49:50.144892] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-03T18:49:50.145480] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-03T18:49:50.145543] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-03T18:49:50.146387] [DEBUG] [LOCAL ] ETY: Trimmed 34344 records to 23218 (keeping 200 days of data) [2025-10-03T18:49:50.293308] [DEBUG] [LOCAL ] ETY: Primary data saved (23218 records). [2025-10-03T18:49:50.293443] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-03T18:49:50.293554] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. ETY took 45.2s. Estimated remaining: 3h 41m 37s. Rate: 7.2 symbols/min [2025-10-03T18:49:50.398583] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-03T18:49:50.482140] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:50.491212] [DEBUG] [LOCAL ] EVG: Loaded 5992 existing records from primary storage. [2025-10-03T18:49:50.491493] [INFO ] [MAIN ] EVG: Loaded 5992 existing records. [2025-10-03T18:49:50.692497] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:50.692729] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-03T18:49:50.692791] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-03T18:49:50.692995] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-03T18:49:50.693055] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-03T18:49:51.101390] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:51.108888] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T18:49:51.135699] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:49:51.190712] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-03T18:49:51.990719] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-03T18:49:52.081491] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:49:52.082706] [INFO ] [REMOTE ] EVC: Full fetch complete (29928 records). [2025-10-03T18:49:52.082808] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-03T18:49:52.488968] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-03T18:49:52.489121] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-03T18:49:52.489714] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-03T18:49:52.489778] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-03T18:49:52.490492] [DEBUG] [LOCAL ] EVC: Trimmed 29928 records to 18787 (keeping 200 days of data) [2025-10-03T18:49:52.601152] [DEBUG] [LOCAL ] EVC: Primary data saved (18787 records). [2025-10-03T18:49:52.601304] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-03T18:49:52.601391] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVC took 33.4s. Estimated remaining: 3h 41m 17s. Rate: 7.2 symbols/min [2025-10-03T18:49:52.775017] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:52.790741] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-03T18:49:52.824411] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-10-03T18:49:52.824831] [INFO ] [MAIN ] EVH: Loaded 49734 existing records. [2025-10-03T18:49:53.009881] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:53.010125] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-03T18:49:53.010175] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-03T18:49:53.010410] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-03T18:49:53.010469] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-03T18:49:53.443839] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:53.449305] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-03T18:49:53.575674] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T18:49:53.590612] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-03T18:49:54.390683] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-03T18:49:54.844165] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:49:55.021915] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:49:55.024297] [INFO ] [REMOTE ] EVEX: Full fetch complete (42330 records). [2025-10-03T18:49:55.024383] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-03T18:49:55.196365] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-03T18:49:55.451589] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-03T18:49:55.451739] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-03T18:49:55.452550] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-03T18:49:55.452631] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-03T18:49:55.454166] [DEBUG] [LOCAL ] EVEX: Trimmed 42330 records to 31245 (keeping 200 days of data) [2025-10-03T18:49:55.650590] [DEBUG] [LOCAL ] EVEX: Primary data saved (31245 records). [2025-10-03T18:49:55.650778] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-03T18:49:55.651732] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. EVEX took 34.1s. Estimated remaining: 3h 40m 58s. Rate: 7.2 symbols/min [2025-10-03T18:49:55.841688] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:55.857251] [DEBUG] [LOCAL ] EVN: Loaded 11253 existing records from primary storage. [2025-10-03T18:49:55.857504] [INFO ] [MAIN ] EVN: Loaded 11253 existing records. [2025-10-03T18:49:55.995765] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-03T18:49:56.054586] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:56.054989] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-03T18:49:56.055046] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-03T18:49:56.055298] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-03T18:49:56.055356] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-03T18:49:56.417364] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:56.790635] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-03T18:49:56.801275] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T18:49:56.802701] [INFO ] [REMOTE ] EVF: Full fetch complete (12349 records). [2025-10-03T18:49:56.802860] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-03T18:49:57.219064] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T18:49:57.262875] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-03T18:49:57.262976] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-03T18:49:57.263328] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-03T18:49:57.263391] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-03T18:49:57.264131] [DEBUG] [LOCAL ] EVF: Trimmed 12349 records to 9646 (keeping 200 days of data) [2025-10-03T18:49:57.327001] [DEBUG] [LOCAL ] EVF: Primary data saved (9646 records). [2025-10-03T18:49:57.327176] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-03T18:49:57.327362] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVF took 33.2s. Estimated remaining: 3h 40m 36s. Rate: 7.2 symbols/min [2025-10-03T18:49:57.513628] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:49:57.554983] [DEBUG] [LOCAL ] EVR: Loaded 35117 existing records from primary storage. [2025-10-03T18:49:57.555294] [INFO ] [MAIN ] EVR: Loaded 35117 existing records. [2025-10-03T18:49:57.599477] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-03T18:49:57.738936] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T18:49:57.765692] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:49:57.770251] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-03T18:49:57.770329] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-03T18:49:57.770569] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-03T18:49:57.770639] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-03T18:49:58.141337] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:49:58.311498] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T18:49:58.390683] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-03T18:49:59.190687] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-03T18:49:59.755085] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:49:59.768782] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T18:49:59.990702] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-03T18:50:00.790743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-03T18:50:01.401378] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T18:50:01.483291] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T18:50:01.590728] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-03T18:50:02.390745] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-03T18:50:03.190684] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-03T18:50:03.346000] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T18:50:03.472868] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T18:50:03.961619] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T18:50:03.990697] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-03T18:50:04.790997] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-03T18:50:05.549110] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:50:05.590681] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-03T18:50:05.606666] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T18:50:06.390716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-03T18:50:07.190672] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-03T18:50:07.273110] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T18:50:07.438989] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:50:07.990713] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-03T18:50:08.791474] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:50:08.791603] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-03T18:50:08.890501] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T18:50:09.590680] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-03T18:50:09.680800] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T18:50:09.970204] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T18:50:10.390716] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-03T18:50:11.190716] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-03T18:50:11.262292] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T18:50:11.990724] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-03T18:50:12.722856] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T18:50:12.790691] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-03T18:50:12.834834] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:50:13.590630] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-03T18:50:13.746127] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T18:50:14.181222] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T18:50:14.390667] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-03T18:50:15.119559] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T18:50:15.190672] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-03T18:50:15.990721] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-03T18:50:16.790637] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-03T18:50:16.986820] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T18:50:16.988256] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T18:50:17.390939] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:50:17.590717] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-03T18:50:18.098970] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:50:18.100165] [INFO ] [REMOTE ] EVG: Full fetch complete (8254 records). [2025-10-03T18:50:18.100261] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-03T18:50:18.395831] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-03T18:50:18.499322] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-03T18:50:18.499409] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-03T18:50:18.499664] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-03T18:50:18.499726] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-03T18:50:18.500220] [DEBUG] [LOCAL ] EVG: Trimmed 8254 records to 6027 (keeping 200 days of data) [2025-10-03T18:50:18.539086] [DEBUG] [LOCAL ] EVG: Primary data saved (6027 records). [2025-10-03T18:50:18.539228] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-03T18:50:18.539332] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVG took 28.2s. Estimated remaining: 3h 40m 53s. Rate: 7.2 symbols/min [2025-10-03T18:50:18.734832] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:18.754318] [DEBUG] [LOCAL ] EVT: Loaded 17068 existing records from primary storage. [2025-10-03T18:50:18.754743] [INFO ] [MAIN ] EVT: Loaded 17068 existing records. [2025-10-03T18:50:18.958751] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:18.959030] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-03T18:50:18.959084] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-03T18:50:18.959267] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-03T18:50:18.959324] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-03T18:50:19.196771] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-03T18:50:19.346108] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:19.992712] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-03T18:50:19.998193] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T18:50:20.164728] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T18:50:20.790720] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-03T18:50:21.418113] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T18:50:21.575869] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T18:50:21.577501] [INFO ] [REMOTE ] EVN: Full fetch complete (17894 records). [2025-10-03T18:50:21.577579] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-03T18:50:21.595758] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-03T18:50:22.022928] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-03T18:50:22.023025] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-03T18:50:22.023587] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-03T18:50:22.023679] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-03T18:50:22.024425] [DEBUG] [LOCAL ] EVN: Trimmed 17894 records to 11412 (keeping 200 days of data) [2025-10-03T18:50:22.096316] [DEBUG] [LOCAL ] EVN: Primary data saved (11412 records). [2025-10-03T18:50:22.096465] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-03T18:50:22.096553] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVN took 26.4s. Estimated remaining: 3h 40m 35s. Rate: 7.2 symbols/min [2025-10-03T18:50:22.295744] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:22.325427] [DEBUG] [LOCAL ] EVTC: Loaded 26492 existing records from primary storage. [2025-10-03T18:50:22.325745] [INFO ] [MAIN ] EVTC: Loaded 26492 existing records. [2025-10-03T18:50:22.395874] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-03T18:50:22.530638] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:22.530878] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-03T18:50:22.530929] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-03T18:50:22.531175] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-03T18:50:22.531267] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-03T18:50:22.928746] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:23.018318] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T18:50:23.190683] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-03T18:50:23.990686] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-03T18:50:24.129729] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T18:50:24.186271] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:50:24.790723] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-03T18:50:25.503788] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T18:50:25.590748] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-03T18:50:25.805353] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T18:50:26.390729] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-03T18:50:26.685229] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T18:50:27.190722] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-03T18:50:27.406082] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T18:50:27.782980] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T18:50:27.990689] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-03T18:50:28.790631] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-03T18:50:29.104082] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:50:29.590688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-03T18:50:30.124699] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T18:50:30.390693] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-03T18:50:30.845355] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T18:50:31.190684] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-03T18:50:31.855219] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:50:31.990686] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-03T18:50:32.294958] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:50:32.297380] [INFO ] [REMOTE ] EVR: Full fetch complete (50820 records). [2025-10-03T18:50:32.297673] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-03T18:50:32.726602] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-03T18:50:32.726727] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-03T18:50:32.727449] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-03T18:50:32.727496] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-03T18:50:32.728795] [DEBUG] [LOCAL ] EVR: Trimmed 50820 records to 35297 (keeping 200 days of data) [2025-10-03T18:50:32.796267] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-03T18:50:32.967224] [DEBUG] [LOCAL ] EVR: Primary data saved (35297 records). [2025-10-03T18:50:32.967413] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-03T18:50:32.967546] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVR took 35.6s. Estimated remaining: 3h 40m 32s. Rate: 7.2 symbols/min [2025-10-03T18:50:33.152119] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:33.191703] [DEBUG] [LOCAL ] EVTL: Loaded 38644 existing records from primary storage. [2025-10-03T18:50:33.192019] [INFO ] [MAIN ] EVTL: Loaded 38644 existing records. [2025-10-03T18:50:33.390460] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:33.390885] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-03T18:50:33.390947] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-03T18:50:33.391200] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-03T18:50:33.391259] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-03T18:50:33.596419] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-03T18:50:33.792066] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:33.833618] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T18:50:34.135088] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T18:50:34.390628] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-03T18:50:34.709949] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T18:50:35.190694] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-03T18:50:35.775786] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T18:50:35.990735] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-03T18:50:36.181730] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T18:50:36.790700] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-03T18:50:37.159281] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T18:50:37.590735] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-03T18:50:38.407309] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-03T18:50:38.413772] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T18:50:38.695381] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T18:50:39.190709] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-03T18:50:39.990744] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-03T18:50:40.045230] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:50:40.554617] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T18:50:40.790675] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-03T18:50:40.986805] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T18:50:41.590742] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-03T18:50:42.390724] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-03T18:50:42.480006] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:50:43.016422] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T18:50:43.190708] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-03T18:50:43.407883] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T18:50:43.990726] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-03T18:50:44.215694] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:50:44.790697] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-03T18:50:44.895376] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T18:50:45.590688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-03T18:50:46.211191] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T18:50:46.214200] [INFO ] [REMOTE ] EVH: Full fetch complete (71786 records). [2025-10-03T18:50:46.214372] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-03T18:50:46.394756] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-03T18:50:46.663550] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-03T18:50:46.663741] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-03T18:50:46.664902] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-03T18:50:46.665010] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-03T18:50:46.666594] [DEBUG] [LOCAL ] EVH: Trimmed 71786 records to 50116 (keeping 200 days of data) [2025-10-03T18:50:46.802259] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-03T18:50:46.990837] [DEBUG] [LOCAL ] EVH: Primary data saved (50116 records). [2025-10-03T18:50:46.990993] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-03T18:50:46.991093] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVH took 54.4s. Estimated remaining: 3h 40m 35s. Rate: 7.2 symbols/min [2025-10-03T18:50:47.180133] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:47.194816] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-03T18:50:47.206837] [DEBUG] [LOCAL ] EVTR: Loaded 23911 existing records from primary storage. [2025-10-03T18:50:47.207442] [INFO ] [MAIN ] EVTR: Loaded 23911 existing records. [2025-10-03T18:50:47.413085] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:47.425579] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-03T18:50:47.425766] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-03T18:50:47.426979] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:50:47.432152] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-03T18:50:47.432381] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-03T18:50:47.846149] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:47.894233] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T18:50:47.990736] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-03T18:50:48.790701] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-03T18:50:48.944367] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:50:49.478903] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T18:50:49.590706] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-03T18:50:50.390688] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-03T18:50:50.529464] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T18:50:51.190691] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-03T18:50:51.619713] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T18:50:51.990736] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-03T18:50:52.243203] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T18:50:52.790743] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-03T18:50:53.129218] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:50:53.131075] [INFO ] [REMOTE ] EVTC: Full fetch complete (38072 records). [2025-10-03T18:50:53.131208] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-03T18:50:53.550967] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-03T18:50:53.551085] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-03T18:50:53.551777] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-03T18:50:53.551846] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-03T18:50:53.553277] [DEBUG] [LOCAL ] EVTC: Trimmed 38072 records to 26688 (keeping 200 days of data) [2025-10-03T18:50:53.611270] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-03T18:50:53.730989] [DEBUG] [LOCAL ] EVTC: Primary data saved (26688 records). [2025-10-03T18:50:53.731153] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-03T18:50:53.731266] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVTC took 31.6s. Estimated remaining: 3h 40m 23s. Rate: 7.2 symbols/min [2025-10-03T18:50:53.922526] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:50:53.974850] [DEBUG] [LOCAL ] EW: Loaded 53791 existing records from primary storage. [2025-10-03T18:50:53.975180] [INFO ] [MAIN ] EW: Loaded 53791 existing records. [2025-10-03T18:50:54.176085] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:50:54.176448] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-03T18:50:54.176591] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-03T18:50:54.177198] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-03T18:50:54.177262] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-03T18:50:54.430744] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-03T18:50:54.595781] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-03T18:50:54.693342] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:50:54.710854] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T18:50:55.190699] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-03T18:50:55.478253] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T18:50:55.990731] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-03T18:50:56.262504] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:50:56.790685] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-03T18:50:57.334566] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:50:57.422015] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T18:50:57.590699] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-03T18:50:58.390722] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-03T18:50:58.656157] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:50:59.190719] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-03T18:50:59.990725] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-03T18:51:00.295511] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T18:51:00.410250] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T18:51:00.588016] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T18:51:00.589864] [INFO ] [REMOTE ] EVT: Full fetch complete (25348 records). [2025-10-03T18:51:00.590043] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-03T18:51:00.803351] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-03T18:51:01.025377] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-03T18:51:01.025520] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-03T18:51:01.025998] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-03T18:51:01.026062] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-03T18:51:01.026887] [DEBUG] [LOCAL ] EVT: Trimmed 25348 records to 17194 (keeping 200 days of data) [2025-10-03T18:51:01.139263] [DEBUG] [LOCAL ] EVT: Primary data saved (17194 records). [2025-10-03T18:51:01.139420] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-03T18:51:01.139562] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVT took 42.6s. Estimated remaining: 3h 40m 13s. Rate: 7.2 symbols/min [2025-10-03T18:51:01.321747] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:01.364915] [DEBUG] [LOCAL ] EXG: Loaded 34342 existing records from primary storage. [2025-10-03T18:51:01.365244] [INFO ] [MAIN ] EXG: Loaded 34342 existing records. [2025-10-03T18:51:01.575394] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:01.575663] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-03T18:51:01.575729] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-03T18:51:01.575963] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-03T18:51:01.576022] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-03T18:51:01.599093] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-03T18:51:01.975842] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:02.390697] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-03T18:51:02.896269] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T18:51:03.190726] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-03T18:51:03.473233] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:51:03.749291] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T18:51:03.990716] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-03T18:51:04.782514] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:51:04.793626] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-03T18:51:05.278090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T18:51:05.590694] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-03T18:51:05.726310] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T18:51:06.390775] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-03T18:51:06.856981] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T18:51:07.190718] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-03T18:51:07.804264] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T18:51:07.990718] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-03T18:51:08.640637] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T18:51:08.790728] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-03T18:51:09.230973] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T18:51:09.590722] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-03T18:51:10.262426] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:51:10.390688] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-03T18:51:11.190711] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-03T18:51:11.528005] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T18:51:11.990718] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-03T18:51:12.327170] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T18:51:12.329287] [INFO ] [REMOTE ] EVTR: Full fetch complete (32535 records). [2025-10-03T18:51:12.329413] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-03T18:51:12.478155] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T18:51:12.793587] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-03T18:51:12.794038] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-03T18:51:12.795368] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-03T18:51:12.796035] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-03T18:51:12.796106] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-03T18:51:12.797145] [DEBUG] [LOCAL ] EVTR: Trimmed 32535 records to 24179 (keeping 200 days of data) [2025-10-03T18:51:12.967489] [DEBUG] [LOCAL ] EVTR: Primary data saved (24179 records). [2025-10-03T18:51:12.967663] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-03T18:51:12.967795] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTR took 26.0s. Estimated remaining: 3h 40m 11s. Rate: 7.2 symbols/min [2025-10-03T18:51:13.159427] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:13.216500] [DEBUG] [LOCAL ] EXK: Loaded 53526 existing records from primary storage. [2025-10-03T18:51:13.217009] [INFO ] [MAIN ] EXK: Loaded 53526 existing records. [2025-10-03T18:51:13.441583] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T18:51:13.448493] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:13.456589] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-03T18:51:13.457303] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-03T18:51:13.459232] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-03T18:51:13.459313] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-03T18:51:13.595849] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-03T18:51:13.863990] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:14.390688] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-03T18:51:14.464611] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T18:51:14.467218] [INFO ] [REMOTE ] EVTL: Full fetch complete (52482 records). [2025-10-03T18:51:14.467311] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-03T18:51:14.878927] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-03T18:51:14.879018] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-03T18:51:14.879703] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-03T18:51:14.879769] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-03T18:51:14.881145] [DEBUG] [LOCAL ] EVTL: Trimmed 52482 records to 39032 (keeping 200 days of data) [2025-10-03T18:51:15.115197] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:51:15.147499] [DEBUG] [LOCAL ] EVTL: Primary data saved (39032 records). [2025-10-03T18:51:15.147678] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-03T18:51:15.147845] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EVTL took 42.2s. Estimated remaining: 3h 39m 50s. Rate: 7.2 symbols/min [2025-10-03T18:51:15.195780] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-03T18:51:15.337203] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:15.370924] [DEBUG] [LOCAL ] EXP: Loaded 29797 existing records from primary storage. [2025-10-03T18:51:15.371195] [INFO ] [MAIN ] EXP: Loaded 29797 existing records. [2025-10-03T18:51:15.562346] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:15.562550] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-03T18:51:15.562672] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-03T18:51:15.563322] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-03T18:51:15.563387] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-03T18:51:15.951936] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:15.990618] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-03T18:51:16.161808] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T18:51:16.790636] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-03T18:51:16.986855] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:51:17.017949] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T18:51:17.590694] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-03T18:51:17.773901] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T18:51:18.390766] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-03T18:51:19.190749] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-03T18:51:19.677407] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T18:51:20.002159] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-03T18:51:20.008245] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T18:51:20.069344] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T18:51:20.790702] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-03T18:51:21.320705] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:51:21.590725] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-03T18:51:22.390685] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-03T18:51:22.537704] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T18:51:23.190694] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-03T18:51:23.281371] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T18:51:23.308116] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T18:51:23.310118] [INFO ] [REMOTE ] EXG: Full fetch complete (49960 records). [2025-10-03T18:51:23.310222] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-03T18:51:23.704241] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-03T18:51:23.704362] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-03T18:51:23.705060] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-03T18:51:23.705127] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-03T18:51:23.706306] [DEBUG] [LOCAL ] EXG: Trimmed 49960 records to 34616 (keeping 200 days of data) [2025-10-03T18:51:23.928558] [DEBUG] [LOCAL ] EXG: Primary data saved (34616 records). [2025-10-03T18:51:23.928744] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-03T18:51:23.929743] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EXG took 22.8s. Estimated remaining: 3h 39m 43s. Rate: 7.2 symbols/min [2025-10-03T18:51:23.990713] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-03T18:51:24.648255] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T18:51:24.790695] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-03T18:51:25.590693] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-03T18:51:25.651520] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:51:25.726735] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T18:51:26.390706] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-03T18:51:27.190672] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-03T18:51:27.520818] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-03T18:51:27.786017] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T18:51:27.990698] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-03T18:51:28.790669] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-03T18:51:29.115837] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T18:51:29.328921] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T18:51:29.590708] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-03T18:51:30.390627] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-03T18:51:30.759019] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-03T18:51:31.190674] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-03T18:51:31.255205] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T18:51:31.797629] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T18:51:31.990767] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-03T18:51:32.790738] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-03T18:51:33.052202] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T18:51:33.590717] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-03T18:51:33.739364] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T18:51:33.805517] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:51:34.390750] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-03T18:51:35.190672] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-03T18:51:35.511588] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T18:51:35.592774] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T18:51:35.990752] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-03T18:51:36.731116] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:51:36.733824] [INFO ] [REMOTE ] EW: Full fetch complete (77350 records). [2025-10-03T18:51:36.733957] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-03T18:51:36.796273] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-03T18:51:37.164029] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-03T18:51:37.164122] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-03T18:51:37.165022] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-03T18:51:37.165120] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-03T18:51:37.166679] [DEBUG] [LOCAL ] EW: Trimmed 77350 records to 54180 (keeping 200 days of data) [2025-10-03T18:51:37.504948] [DEBUG] [LOCAL ] EW: Primary data saved (54180 records). [2025-10-03T18:51:37.505283] [INFO ] [MAIN ] EW: Full history saved. [2025-10-03T18:51:37.506481] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EW took 43.8s. Estimated remaining: 3h 39m 45s. Rate: 7.2 symbols/min [2025-10-03T18:51:38.013906] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-03T18:51:38.027521] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-03T18:51:38.048371] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T18:51:38.390750] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-03T18:51:39.486194] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:51:39.489958] [INFO ] [REMOTE ] EXP: Full fetch complete (42910 records). [2025-10-03T18:51:39.490095] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-03T18:51:39.949200] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-03T18:51:39.949388] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-03T18:51:39.950260] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-03T18:51:39.950376] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-03T18:51:39.951754] [DEBUG] [LOCAL ] EXP: Trimmed 42910 records to 29982 (keeping 200 days of data) [2025-10-03T18:51:40.083362] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-03T18:51:40.098000] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-03T18:51:40.206443] [DEBUG] [LOCAL ] EXP: Primary data saved (29982 records). [2025-10-03T18:51:40.206593] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-03T18:51:40.206705] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXP took 25.1s. Estimated remaining: 3h 39m 25s. Rate: 7.2 symbols/min [2025-10-03T18:51:42.082973] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T18:51:42.095417] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-03T18:51:43.785668] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-03T18:51:43.788611] [INFO ] [REMOTE ] EXK: Full fetch complete (76546 records). [2025-10-03T18:51:43.788791] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-03T18:51:44.234448] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-03T18:51:44.234540] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-03T18:51:44.235470] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-03T18:51:44.235555] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-03T18:51:44.237247] [DEBUG] [LOCAL ] EXK: Trimmed 76546 records to 53915 (keeping 200 days of data) [2025-10-03T18:51:44.581141] [DEBUG] [LOCAL ] EXK: Primary data saved (53915 records). [2025-10-03T18:51:44.581332] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-03T18:51:44.581457] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXK took 31.6s. Estimated remaining: 3h 39m 9s. Rate: 7.2 symbols/min [2025-10-03T18:51:45.216527] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.296565] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.389020] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.390026] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:51:45.476538] [DEBUG] [LOCAL ] FAF: Loaded 41936 existing records from primary storage. [2025-10-03T18:51:45.491559] [INFO ] [MAIN ] FAF: Loaded 41936 existing records. [2025-10-03T18:51:45.504170] [DEBUG] [LOCAL ] EXR: Loaded 45592 existing records from primary storage. [2025-10-03T18:51:45.551304] [INFO ] [MAIN ] EXR: Loaded 45592 existing records. [2025-10-03T18:51:45.583469] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-10-03T18:51:45.596146] [DEBUG] [LOCAL ] EXPD: Loaded 48284 existing records from primary storage. [2025-10-03T18:51:45.633832] [INFO ] [MAIN ] F: Loaded 54210 existing records. [2025-10-03T18:51:45.634069] [INFO ] [MAIN ] EXPD: Loaded 48284 existing records. [2025-10-03T18:51:46.158974] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.171048] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.176783] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-03T18:51:46.238943] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-03T18:51:46.360451] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-03T18:51:46.461167] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.488506] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.497601] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.497823] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-03T18:51:46.527880] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.539029] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-03T18:51:46.517162] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:51:46.560632] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-03T18:51:46.560562] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-03T18:51:46.581382] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-03T18:51:46.575845] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-03T18:51:46.581501] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-03T18:51:46.618007] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-03T18:51:46.612771] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-03T18:51:46.640668] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-03T18:51:47.698283] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:47.737774] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-03T18:51:48.109953] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.171249] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-03T18:51:48.240233] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.233752] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:51:48.240966] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-03T18:51:48.241221] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-03T18:51:49.356532] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T18:51:49.364604] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-03T18:51:49.776473] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:51:49.786937] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-03T18:51:49.850724] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T18:51:49.860338] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-03T18:51:50.477991] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-03T18:51:50.489812] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-03T18:51:50.677717] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T18:51:50.685410] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-03T18:51:51.002164] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T18:51:51.012784] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-03T18:51:51.435377] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T18:51:51.445921] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-03T18:51:51.726297] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T18:51:51.733852] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-03T18:51:52.524522] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T18:51:52.534820] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-03T18:51:52.918721] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-10-03T18:51:52.931336] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-03T18:51:53.010225] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:51:53.019817] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-03T18:51:53.231519] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T18:51:53.240897] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-03T18:51:54.194574] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T18:51:54.206144] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-03T18:51:54.303444] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:51:54.390627] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-03T18:51:54.876542] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T18:51:55.190754] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-03T18:51:55.314903] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T18:51:55.886454] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:51:55.928837] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T18:51:55.990733] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-03T18:51:56.330793] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T18:51:56.790739] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-03T18:51:57.590714] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-03T18:51:57.689464] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:51:58.347707] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:51:58.390635] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-03T18:51:59.190668] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-03T18:51:59.241442] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:51:59.997968] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-03T18:52:00.015595] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T18:52:00.790703] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-03T18:52:01.590689] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-03T18:52:01.626309] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:52:01.703956] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T18:52:02.072383] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T18:52:02.390732] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-03T18:52:03.184403] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:52:03.193884] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-03T18:52:03.990723] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-03T18:52:04.790638] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-03T18:52:04.890217] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T18:52:05.014762] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-10-03T18:52:05.590688] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-03T18:52:05.704863] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T18:52:06.220018] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T18:52:06.390713] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-03T18:52:07.164989] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:52:07.190696] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-03T18:52:07.990738] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-03T18:52:08.726395] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:52:08.729503] [INFO ] [REMOTE ] EXR: Full fetch complete (65879 records). [2025-10-03T18:52:08.729685] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-03T18:52:08.810465] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-03T18:52:09.177785] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-03T18:52:09.178110] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-03T18:52:09.179637] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-03T18:52:09.179844] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-03T18:52:09.181999] [DEBUG] [LOCAL ] EXR: Trimmed 65879 records to 45914 (keeping 200 days of data) [2025-10-03T18:52:09.310827] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-10-03T18:52:09.350112] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T18:52:09.565563] [DEBUG] [LOCAL ] EXR: Primary data saved (45914 records). [2025-10-03T18:52:09.565746] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-03T18:52:09.565888] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. EXR took 25.0s. Estimated remaining: 3h 39m 33s. Rate: 7.1 symbols/min [2025-10-03T18:52:09.595819] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-03T18:52:09.768320] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:09.819465] [DEBUG] [LOCAL ] FBIN: Loaded 50693 existing records from primary storage. [2025-10-03T18:52:09.819829] [INFO ] [MAIN ] FBIN: Loaded 50693 existing records. [2025-10-03T18:52:10.008059] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:10.008301] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-03T18:52:10.008357] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-03T18:52:10.010487] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-03T18:52:10.010577] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-03T18:52:10.392910] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:10.393153] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-03T18:52:10.448254] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T18:52:11.000930] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T18:52:11.003408] [INFO ] [REMOTE ] FAF: Full fetch complete (57678 records). [2025-10-03T18:52:11.003601] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-03T18:52:11.190989] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-03T18:52:11.609486] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-03T18:52:11.609608] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-03T18:52:11.610726] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-03T18:52:11.610797] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-03T18:52:11.612250] [DEBUG] [LOCAL ] FAF: Trimmed 57678 records to 42190 (keeping 200 days of data) [2025-10-03T18:52:11.896721] [DEBUG] [LOCAL ] FAF: Primary data saved (42190 records). [2025-10-03T18:52:11.896857] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-03T18:52:11.896945] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. FAF took 27.3s. Estimated remaining: 3h 39m 13s. Rate: 7.2 symbols/min [2025-10-03T18:52:11.998242] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-03T18:52:12.097261] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:12.124702] [DEBUG] [LOCAL ] FBK: Loaded 26281 existing records from primary storage. [2025-10-03T18:52:12.125001] [INFO ] [MAIN ] FBK: Loaded 26281 existing records. [2025-10-03T18:52:12.354560] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:12.354829] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-03T18:52:12.354887] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-03T18:52:12.355158] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-03T18:52:12.355218] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-03T18:52:12.781488] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:12.799162] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-03T18:52:12.826539] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T18:52:12.871953] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T18:52:13.590668] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-03T18:52:13.714690] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T18:52:13.885461] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T18:52:14.390740] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-03T18:52:14.857824] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:52:14.860274] [INFO ] [REMOTE ] EXPD: Full fetch complete (69321 records). [2025-10-03T18:52:14.860385] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-03T18:52:15.195787] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-03T18:52:15.323018] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-03T18:52:15.323119] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-03T18:52:15.324052] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-03T18:52:15.324122] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-03T18:52:15.327470] [DEBUG] [LOCAL ] EXPD: Trimmed 69321 records to 48594 (keeping 200 days of data) [2025-10-03T18:52:15.642020] [DEBUG] [LOCAL ] EXPD: Primary data saved (48594 records). [2025-10-03T18:52:15.642188] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-03T18:52:15.642321] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXPD took 31.1s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-10-03T18:52:15.835777] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:15.884921] [DEBUG] [LOCAL ] FBP: Loaded 46270 existing records from primary storage. [2025-10-03T18:52:15.885239] [INFO ] [MAIN ] FBP: Loaded 46270 existing records. [2025-10-03T18:52:15.991517] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-03T18:52:16.079218] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:16.079537] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-03T18:52:16.079614] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-03T18:52:16.079908] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-03T18:52:16.079989] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-03T18:52:16.433266] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T18:52:16.502508] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:16.790716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-03T18:52:17.046416] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T18:52:17.343488] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T18:52:17.590704] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-03T18:52:17.963182] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:52:18.390638] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-03T18:52:18.514546] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T18:52:19.190703] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-03T18:52:19.990847] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-03T18:52:19.990757] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:52:20.242589] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T18:52:20.790691] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-03T18:52:21.590693] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-03T18:52:21.886491] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T18:52:22.185606] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:52:22.390698] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-03T18:52:23.097316] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T18:52:23.190687] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-03T18:52:23.460486] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T18:52:23.990686] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-03T18:52:24.387475] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T18:52:24.790687] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-03T18:52:25.590693] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-03T18:52:26.392925] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-03T18:52:26.413075] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T18:52:26.461935] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-03T18:52:26.847956] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T18:52:27.190716] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-03T18:52:27.718146] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:52:27.990689] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-03T18:52:28.790722] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-03T18:52:28.837081] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T18:52:29.432443] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:52:29.590699] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-03T18:52:30.390630] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-03T18:52:30.757945] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-03T18:52:31.175085] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-03T18:52:31.190616] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-03T18:52:31.995422] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-03T18:52:32.002111] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T18:52:32.790678] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-03T18:52:33.055596] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T18:52:33.444817] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-03T18:52:33.447634] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-03T18:52:33.447829] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-03T18:52:33.600495] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-03T18:52:33.883566] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-03T18:52:33.883696] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-03T18:52:33.884822] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-03T18:52:33.884890] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-03T18:52:33.887073] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54600 (keeping 200 days of data) [2025-10-03T18:52:34.242932] [DEBUG] [LOCAL ] F: Primary data saved (54600 records). [2025-10-03T18:52:34.243097] [INFO ] [MAIN ] F: Full history saved. [2025-10-03T18:52:34.243229] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 49.7s. Estimated remaining: 3h 39m 7s. Rate: 7.1 symbols/min [2025-10-03T18:52:34.393220] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-03T18:52:34.455881] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T18:52:34.474519] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:34.519816] [DEBUG] [LOCAL ] FBRT: Loaded 34942 existing records from primary storage. [2025-10-03T18:52:34.520167] [INFO ] [MAIN ] FBRT: Loaded 34942 existing records. [2025-10-03T18:52:34.699478] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T18:52:34.734513] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:34.735600] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-03T18:52:34.735878] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-03T18:52:34.735788] [INFO ] [REMOTE ] FBK: Full fetch complete (33840 records). [2025-10-03T18:52:34.736114] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-03T18:52:34.736295] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-03T18:52:34.736430] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-03T18:52:35.195801] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-03T18:52:35.575514] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:35.590554] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-03T18:52:35.590614] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-03T18:52:35.591141] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-03T18:52:35.591199] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-03T18:52:35.592042] [DEBUG] [LOCAL ] FBK: Trimmed 33840 records to 26556 (keeping 200 days of data) [2025-10-03T18:52:35.759432] [DEBUG] [LOCAL ] FBK: Primary data saved (26556 records). [2025-10-03T18:52:35.759575] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-03T18:52:35.759710] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 23.9s. Estimated remaining: 3h 38m 45s. Rate: 7.2 symbols/min [2025-10-03T18:52:35.954744] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:35.971940] [DEBUG] [LOCAL ] FC: Loaded 15565 existing records from primary storage. [2025-10-03T18:52:35.972192] [INFO ] [MAIN ] FC: Loaded 15565 existing records. [2025-10-03T18:52:35.997711] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-03T18:52:36.172999] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:36.173250] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-03T18:52:36.173374] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-03T18:52:36.173745] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-03T18:52:36.173853] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-03T18:52:36.401583] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T18:52:36.617551] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:36.790679] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-03T18:52:36.899545] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:52:37.318612] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T18:52:37.590725] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-03T18:52:38.390699] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-03T18:52:38.422336] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:52:38.489176] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T18:52:39.190710] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-03T18:52:39.912131] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T18:52:39.990661] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-03T18:52:40.104772] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-03T18:52:40.790829] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-03T18:52:41.498638] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:52:41.590695] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-03T18:52:41.671598] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T18:52:42.390782] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-03T18:52:43.190833] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-03T18:52:43.353543] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:52:43.671342] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:52:43.674232] [INFO ] [REMOTE ] FBP: Full fetch complete (66456 records). [2025-10-03T18:52:43.674339] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-03T18:52:43.996159] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-03T18:52:44.130442] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-03T18:52:44.130568] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-03T18:52:44.131731] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-03T18:52:44.131857] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-03T18:52:44.133501] [DEBUG] [LOCAL ] FBP: Trimmed 66456 records to 46650 (keeping 200 days of data) [2025-10-03T18:52:44.248210] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:52:44.473957] [DEBUG] [LOCAL ] FBP: Primary data saved (46650 records). [2025-10-03T18:52:44.474678] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-03T18:52:44.474925] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FBP took 28.8s. Estimated remaining: 3h 38m 37s. Rate: 7.2 symbols/min [2025-10-03T18:52:44.679887] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:52:44.726354] [DEBUG] [LOCAL ] FCF: Loaded 39650 existing records from primary storage. [2025-10-03T18:52:44.726688] [INFO ] [MAIN ] FCF: Loaded 39650 existing records. [2025-10-03T18:52:44.795900] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-03T18:52:44.966364] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:52:44.966579] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-03T18:52:44.966626] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-03T18:52:44.966947] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-03T18:52:44.967005] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-03T18:52:45.373411] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:52:45.408748] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:52:45.590713] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-03T18:52:46.125292] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:52:46.218155] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T18:52:46.390733] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-03T18:52:47.190745] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-03T18:52:47.762729] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T18:52:47.990729] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-03T18:52:48.260382] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:52:48.790759] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-03T18:52:49.483869] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T18:52:49.590738] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-03T18:52:50.390736] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-03T18:52:50.485275] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:52:51.189499] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T18:52:51.198342] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-03T18:52:51.221341] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T18:52:51.990711] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-03T18:52:52.750781] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:52:52.790639] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-03T18:52:52.802914] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T18:52:53.590703] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-03T18:52:54.166206] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:52:54.390696] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-03T18:52:54.599902] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T18:52:55.190714] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-03T18:52:55.665266] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:52:55.990683] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-03T18:52:56.135890] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T18:52:56.790724] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-03T18:52:57.310360] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T18:52:57.590743] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-03T18:52:58.207784] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T18:52:58.390717] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-03T18:52:58.591340] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T18:52:59.190714] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-03T18:52:59.756694] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T18:52:59.990690] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-03T18:53:00.790689] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-03T18:53:00.978466] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:53:01.444638] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T18:53:01.590737] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-03T18:53:02.324940] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T18:53:02.324806] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T18:53:02.328775] [INFO ] [REMOTE ] FC: Full fetch complete (21789 records). [2025-10-03T18:53:02.328975] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-03T18:53:02.329263] [INFO ] [REMOTE ] FBIN: Full fetch complete (72661 records). [2025-10-03T18:53:02.370731] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-03T18:53:02.396874] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-03T18:53:03.096844] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-03T18:53:03.113619] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-03T18:53:03.114327] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-03T18:53:03.114414] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-03T18:53:03.146817] [DEBUG] [LOCAL ] FC: Trimmed 21789 records to 15641 (keeping 200 days of data) [2025-10-03T18:53:03.172985] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-03T18:53:03.173327] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-03T18:53:03.174143] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-03T18:53:03.174213] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-03T18:53:03.175931] [DEBUG] [LOCAL ] FBIN: Trimmed 72661 records to 51057 (keeping 200 days of data) [2025-10-03T18:53:03.211746] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-03T18:53:03.378770] [DEBUG] [LOCAL ] FC: Primary data saved (15641 records). [2025-10-03T18:53:03.380430] [INFO ] [MAIN ] FC: Full history saved. [2025-10-03T18:53:03.380817] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FC took 27.6s. Estimated remaining: 3h 38m 49s. Rate: 7.1 symbols/min [2025-10-03T18:53:03.610972] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:03.772615] [DEBUG] [LOCAL ] FCN: Loaded 26094 existing records from primary storage. [2025-10-03T18:53:03.774465] [INFO ] [MAIN ] FCN: Loaded 26094 existing records. [2025-10-03T18:53:04.114216] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:04.114500] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-03T18:53:04.114561] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-03T18:53:04.116612] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-03T18:53:04.125597] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-03T18:53:04.360311] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T18:53:04.433757] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-03T18:53:04.481254] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:53:04.558348] [INFO ] [REMOTE ] FBRT: Full fetch complete (49035 records). [2025-10-03T18:53:04.573369] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-03T18:53:04.586709] [DEBUG] [LOCAL ] FBIN: Primary data saved (51057 records). [2025-10-03T18:53:04.689048] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-03T18:53:04.733585] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FBIN took 55.2s. Estimated remaining: 3h 38m 27s. Rate: 7.2 symbols/min [2025-10-03T18:53:04.983058] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:05.021508] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-03T18:53:05.339222] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:05.446462] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-03T18:53:05.446554] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-03T18:53:05.447600] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-03T18:53:05.447753] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-03T18:53:05.452402] [DEBUG] [LOCAL ] FBRT: Trimmed 49035 records to 35221 (keeping 200 days of data) [2025-10-03T18:53:05.606828] [DEBUG] [LOCAL ] FCPT: Loaded 37618 existing records from primary storage. [2025-10-03T18:53:05.610541] [INFO ] [MAIN ] FCPT: Loaded 37618 existing records. [2025-10-03T18:53:05.857262] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:05.862423] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T18:53:05.862672] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-03T18:53:05.873989] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-03T18:53:05.873902] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-03T18:53:05.878210] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-03T18:53:05.878286] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-03T18:53:06.316724] [DEBUG] [LOCAL ] FBRT: Primary data saved (35221 records). [2025-10-03T18:53:06.341590] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-03T18:53:06.377699] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FBRT took 32.1s. Estimated remaining: 3h 38m 6s. Rate: 7.2 symbols/min [2025-10-03T18:53:06.359088] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T18:53:06.444671] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:06.445628] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-03T18:53:06.618916] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:06.619131] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-03T18:53:06.619172] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-03T18:53:06.619288] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-03T18:53:06.619332] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-03T18:53:06.619374] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-03T18:53:06.619409] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-03T18:53:06.998342] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:07.190733] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-03T18:53:07.396371] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T18:53:07.589542] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T18:53:07.990694] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-03T18:53:08.541281] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T18:53:08.790698] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-03T18:53:09.013273] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T18:53:09.590709] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-03T18:53:10.132520] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T18:53:10.390728] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-03T18:53:11.013743] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:53:11.190708] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-03T18:53:11.799256] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T18:53:11.990703] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-03T18:53:12.297175] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-10-03T18:53:12.522720] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T18:53:12.790689] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-03T18:53:13.208309] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T18:53:13.590723] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-03T18:53:14.390729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-03T18:53:14.818060] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T18:53:14.892062] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T18:53:15.190700] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-03T18:53:15.990717] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-03T18:53:16.754279] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T18:53:16.790719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-03T18:53:17.461305] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:53:17.590691] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-03T18:53:18.334194] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T18:53:18.390692] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-03T18:53:18.939731] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T18:53:19.190724] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-03T18:53:19.803623] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T18:53:19.990672] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-03T18:53:20.320818] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T18:53:20.579565] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T18:53:20.790712] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-03T18:53:21.590709] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-03T18:53:22.010825] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T18:53:22.017613] [INFO ] [REMOTE ] FCF: Full fetch complete (58175 records). [2025-10-03T18:53:22.017789] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-03T18:53:22.082247] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:53:22.398239] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-03T18:53:22.448199] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-03T18:53:22.448283] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-03T18:53:22.449088] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-03T18:53:22.449156] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-03T18:53:22.450507] [DEBUG] [LOCAL ] FCF: Trimmed 58175 records to 39961 (keeping 200 days of data) [2025-10-03T18:53:22.724190] [DEBUG] [LOCAL ] FCF: Primary data saved (39961 records). [2025-10-03T18:53:22.724391] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-03T18:53:22.724510] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FCF took 38.2s. Estimated remaining: 3h 38m 13s. Rate: 7.1 symbols/min [2025-10-03T18:53:22.921979] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:22.939874] [DEBUG] [LOCAL ] FCT: Loaded 14789 existing records from primary storage. [2025-10-03T18:53:22.940157] [INFO ] [MAIN ] FCT: Loaded 14789 existing records. [2025-10-03T18:53:23.155003] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:23.155268] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-03T18:53:23.155340] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-03T18:53:23.155692] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-03T18:53:23.155770] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-03T18:53:23.195777] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-03T18:53:23.553985] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:23.582861] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-03T18:53:23.990686] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-03T18:53:24.790688] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-03T18:53:25.309991] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T18:53:25.590747] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-03T18:53:25.792360] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:53:26.390710] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-03T18:53:26.723987] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (4.33 seconds). [2025-10-03T18:53:26.802818] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T18:53:26.972587] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T18:53:27.190696] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-03T18:53:27.990719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-03T18:53:28.156590] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T18:53:28.790716] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-03T18:53:29.312508] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T18:53:29.470208] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-03T18:53:29.590719] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-03T18:53:30.390698] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-03T18:53:31.109809] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T18:53:31.190638] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-03T18:53:31.297710] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T18:53:31.990730] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-03T18:53:32.426461] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T18:53:32.429493] [INFO ] [REMOTE ] FCPT: Full fetch complete (53816 records). [2025-10-03T18:53:32.429709] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-03T18:53:32.797104] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-03T18:53:32.838400] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-03T18:53:32.838532] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-03T18:53:32.839273] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-03T18:53:32.839342] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-03T18:53:32.840677] [DEBUG] [LOCAL ] FCPT: Trimmed 53816 records to 37913 (keeping 200 days of data) [2025-10-03T18:53:33.086910] [DEBUG] [LOCAL ] FCPT: Primary data saved (37913 records). [2025-10-03T18:53:33.087066] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-03T18:53:33.087156] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCPT took 28.3s. Estimated remaining: 3h 38m 8s. Rate: 7.1 symbols/min [2025-10-03T18:53:33.269015] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:33.273210] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T18:53:33.302212] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T18:53:33.350926] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-10-03T18:53:33.351296] [INFO ] [MAIN ] FCX: Loaded 54090 existing records. [2025-10-03T18:53:33.533437] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:33.533698] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-03T18:53:33.533756] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-03T18:53:33.533993] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-03T18:53:33.534051] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-03T18:53:33.597591] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-03T18:53:33.902054] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:34.390731] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-03T18:53:34.721669] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T18:53:34.821734] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T18:53:35.190709] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-03T18:53:35.618801] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-03T18:53:35.990732] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-03T18:53:36.790704] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-03T18:53:36.914894] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:53:37.590635] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-03T18:53:37.669151] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T18:53:38.390735] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-03T18:53:38.812675] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-03T18:53:38.813396] [INFO ] [REMOTE ] FCRX: Full fetch complete (1682 records). [2025-10-03T18:53:38.813469] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-03T18:53:39.031722] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-03T18:53:39.032033] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:53:39.032133] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:53:39.032234] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-03T18:53:39.032358] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-03T18:53:39.032434] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-03T18:53:39.032501] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-03T18:53:39.032620] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCRX took 32.6s. Estimated remaining: 3h 37m 55s. Rate: 7.1 symbols/min [2025-10-03T18:53:39.195779] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-03T18:53:39.264229] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:39.298067] [DEBUG] [LOCAL ] FDP: Loaded 30317 existing records from primary storage. [2025-10-03T18:53:39.298380] [INFO ] [MAIN ] FDP: Loaded 30317 existing records. [2025-10-03T18:53:39.494831] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:39.495242] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-03T18:53:39.495374] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-03T18:53:39.495740] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-03T18:53:39.495805] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-03T18:53:39.654588] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T18:53:39.958667] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:39.964807] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T18:53:39.966971] [INFO ] [REMOTE ] FCN: Full fetch complete (35741 records). [2025-10-03T18:53:39.967079] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-03T18:53:39.995830] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-03T18:53:40.382682] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-03T18:53:40.382781] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-03T18:53:40.383338] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-03T18:53:40.383386] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-03T18:53:40.384431] [DEBUG] [LOCAL ] FCN: Trimmed 35741 records to 26319 (keeping 200 days of data) [2025-10-03T18:53:40.567544] [DEBUG] [LOCAL ] FCN: Primary data saved (26319 records). [2025-10-03T18:53:40.567781] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-03T18:53:40.568020] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FCN took 37.2s. Estimated remaining: 3h 37m 34s. Rate: 7.2 symbols/min [2025-10-03T18:53:40.771126] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:40.790683] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-03T18:53:40.801952] [DEBUG] [LOCAL ] FDS: Loaded 26895 existing records from primary storage. [2025-10-03T18:53:40.802264] [INFO ] [MAIN ] FDS: Loaded 26895 existing records. [2025-10-03T18:53:40.932205] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-03T18:53:41.020108] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:41.020365] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-03T18:53:41.020418] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-03T18:53:41.020815] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-03T18:53:41.020875] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-03T18:53:41.470453] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:41.590728] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-03T18:53:42.390710] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-03T18:53:42.494763] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T18:53:42.826986] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-03T18:53:43.190683] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-03T18:53:43.581147] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T18:53:43.990729] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-03T18:53:44.790732] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-03T18:53:44.926452] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T18:53:45.013267] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-03T18:53:45.590631] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-03T18:53:45.658877] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T18:53:46.397102] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-03T18:53:46.403249] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:53:47.190768] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-03T18:53:47.816519] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T18:53:47.990696] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-03T18:53:48.522264] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T18:53:48.790747] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-03T18:53:48.976839] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T18:53:49.590695] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-03T18:53:49.625041] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T18:53:50.390680] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-03T18:53:50.799111] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T18:53:51.190704] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-03T18:53:51.828031] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T18:53:51.990759] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-03T18:53:52.451847] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T18:53:52.597778] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T18:53:52.790724] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-03T18:53:53.590639] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-03T18:53:53.919825] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T18:53:54.390737] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-03T18:53:55.190726] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-03T18:53:55.871305] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-03T18:53:55.896957] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T18:53:55.990671] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-03T18:53:56.370199] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T18:53:56.790687] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-03T18:53:57.293507] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T18:53:57.590725] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-03T18:53:57.684206] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T18:53:57.686395] [INFO ] [REMOTE ] FCT: Full fetch complete (21174 records). [2025-10-03T18:53:57.686532] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-03T18:53:58.124049] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-03T18:53:58.124139] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-03T18:53:58.124586] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-03T18:53:58.124682] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-03T18:53:58.125531] [DEBUG] [LOCAL ] FCT: Trimmed 21174 records to 14890 (keeping 200 days of data) [2025-10-03T18:53:58.218010] [DEBUG] [LOCAL ] FCT: Primary data saved (14890 records). [2025-10-03T18:53:58.218214] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-03T18:53:58.218362] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCT took 35.5s. Estimated remaining: 3h 37m 43s. Rate: 7.1 symbols/min [2025-10-03T18:53:58.397631] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-03T18:53:58.406074] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:53:58.462291] [DEBUG] [LOCAL ] FDX: Loaded 51922 existing records from primary storage. [2025-10-03T18:53:58.462688] [INFO ] [MAIN ] FDX: Loaded 51922 existing records. [2025-10-03T18:53:58.660335] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:53:58.660613] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-03T18:53:58.660704] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-03T18:53:58.661005] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-03T18:53:58.661065] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-03T18:53:59.059183] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:53:59.190704] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-03T18:53:59.512510] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T18:53:59.705488] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-03T18:53:59.990729] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-03T18:54:00.790698] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-03T18:54:01.154173] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T18:54:01.242891] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T18:54:01.590733] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-03T18:54:01.760634] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T18:54:02.390717] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-03T18:54:03.129327] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T18:54:03.190688] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-03T18:54:03.990739] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-03T18:54:04.425165] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-03T18:54:04.795804] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-03T18:54:04.813004] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T18:54:05.318005] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T18:54:05.590714] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-03T18:54:06.390700] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-03T18:54:06.563401] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T18:54:06.872869] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T18:54:07.190707] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-03T18:54:07.936468] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:54:07.990686] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-03T18:54:08.557464] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:54:08.559698] [INFO ] [REMOTE ] FDS: Full fetch complete (37799 records). [2025-10-03T18:54:08.559834] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-03T18:54:08.795871] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-03T18:54:08.992154] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-03T18:54:08.992258] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-03T18:54:08.992950] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-03T18:54:08.993022] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-03T18:54:08.994124] [DEBUG] [LOCAL ] FDS: Trimmed 37799 records to 27155 (keeping 200 days of data) [2025-10-03T18:54:09.176812] [DEBUG] [LOCAL ] FDS: Primary data saved (27155 records). [2025-10-03T18:54:09.176963] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-03T18:54:09.177060] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FDS took 28.6s. Estimated remaining: 3h 37m 39s. Rate: 7.1 symbols/min [2025-10-03T18:54:09.359776] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:09.411250] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-10-03T18:54:09.411624] [INFO ] [MAIN ] FE: Loaded 53818 existing records. [2025-10-03T18:54:09.597402] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-03T18:54:09.623166] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:09.623626] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-03T18:54:09.623857] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-03T18:54:09.624170] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-03T18:54:09.624232] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-03T18:54:10.031609] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:10.073493] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T18:54:10.390683] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-03T18:54:11.025371] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:54:11.080047] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-03T18:54:11.190715] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-03T18:54:11.990756] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-03T18:54:12.045395] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:54:12.790742] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-03T18:54:13.016347] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:54:13.018948] [INFO ] [REMOTE ] FDP: Full fetch complete (42931 records). [2025-10-03T18:54:13.019130] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-03T18:54:13.474173] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-03T18:54:13.597285] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-03T18:54:13.758545] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-03T18:54:13.758664] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-03T18:54:13.759449] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-03T18:54:13.759533] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-03T18:54:13.760877] [DEBUG] [LOCAL ] FDP: Trimmed 42931 records to 30517 (keeping 200 days of data) [2025-10-03T18:54:13.975671] [DEBUG] [LOCAL ] FDP: Primary data saved (30517 records). [2025-10-03T18:54:13.975835] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-03T18:54:13.975953] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FDP took 34.9s. Estimated remaining: 3h 37m 24s. Rate: 7.1 symbols/min [2025-10-03T18:54:14.168798] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:14.168995] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-03T18:54:14.169048] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-03T18:54:14.169168] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-03T18:54:14.169212] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-03T18:54:14.169260] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-03T18:54:14.169299] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-03T18:54:14.395766] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-03T18:54:14.640353] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:14.736123] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T18:54:15.190770] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-03T18:54:15.992376] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-03T18:54:15.991039] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-03T18:54:16.038815] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T18:54:16.458034] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-03T18:54:16.790690] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-03T18:54:17.119736] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T18:54:17.590698] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-03T18:54:18.390690] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-03T18:54:18.870549] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-03T18:54:18.874074] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-03T18:54:18.878950] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-03T18:54:18.879151] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-03T18:54:19.195884] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-03T18:54:19.320996] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-03T18:54:19.321185] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-03T18:54:19.322140] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-03T18:54:19.322309] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-03T18:54:19.324483] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54480 (keeping 200 days of data) [2025-10-03T18:54:19.468134] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-03T18:54:19.605733] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T18:54:19.740344] [DEBUG] [LOCAL ] FCX: Primary data saved (54480 records). [2025-10-03T18:54:19.740499] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-03T18:54:19.741228] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FCX took 46.7s. Estimated remaining: 3h 37m 11s. Rate: 7.2 symbols/min [2025-10-03T18:54:19.928255] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:19.983760] [DEBUG] [LOCAL ] FERG: Loaded 49230 existing records from primary storage. [2025-10-03T18:54:19.984098] [INFO ] [MAIN ] FERG: Loaded 49230 existing records. [2025-10-03T18:54:19.995791] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-03T18:54:20.196778] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:20.197016] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-03T18:54:20.197066] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-03T18:54:20.197301] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-03T18:54:20.197372] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-03T18:54:20.561495] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T18:54:20.606723] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:20.790691] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-03T18:54:21.276636] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T18:54:21.590713] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-03T18:54:22.390703] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-03T18:54:23.190679] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-03T18:54:23.498844] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T18:54:23.930427] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T18:54:23.990734] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-03T18:54:24.790707] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-03T18:54:24.937494] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:54:25.590629] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-03T18:54:25.851166] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T18:54:26.340824] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T18:54:26.390621] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-03T18:54:27.190708] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-03T18:54:27.301318] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T18:54:27.938470] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:54:27.990631] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-03T18:54:28.790687] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-03T18:54:29.040872] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:54:29.232548] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T18:54:29.595888] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-03T18:54:29.602374] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T18:54:29.946164] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-03T18:54:30.390740] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-03T18:54:31.190739] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-03T18:54:31.990694] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-03T18:54:32.148529] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T18:54:32.790734] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-03T18:54:33.131849] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-03T18:54:33.238558] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T18:54:33.590706] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-03T18:54:33.791719] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:54:33.936469] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:54:34.390705] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-03T18:54:35.190752] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-03T18:54:35.644978] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:54:35.990693] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-03T18:54:36.273607] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:54:36.790736] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-03T18:54:37.590740] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-03T18:54:37.877908] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T18:54:37.880851] [INFO ] [REMOTE ] FDX: Full fetch complete (74458 records). [2025-10-03T18:54:37.880988] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-03T18:54:37.989697] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-03T18:54:38.012167] [INFO ] [REMOTE ] FENG: Full fetch complete (2256 records). [2025-10-03T18:54:38.033466] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-03T18:54:38.391324] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-03T18:54:38.420327] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T18:54:38.426204] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-03T18:54:38.431743] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-03T18:54:38.437081] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-03T18:54:38.442392] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-03T18:54:38.469744] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-03T18:54:38.480492] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-03T18:54:38.480793] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FENG took 24.5s. Estimated remaining: 3h 37m 22s. Rate: 7.1 symbols/min [2025-10-03T18:54:38.535950] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-03T18:54:38.570016] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-03T18:54:38.578912] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-03T18:54:38.605951] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-03T18:54:38.659974] [DEBUG] [LOCAL ] FDX: Trimmed 74458 records to 52286 (keeping 200 days of data) [2025-10-03T18:54:38.778220] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:38.866250] [DEBUG] [LOCAL ] FET: Loaded 12979 existing records from primary storage. [2025-10-03T18:54:38.867593] [INFO ] [MAIN ] FET: Loaded 12979 existing records. [2025-10-03T18:54:38.875157] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T18:54:39.091172] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:39.092177] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-03T18:54:39.092584] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-03T18:54:39.093233] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-03T18:54:39.093299] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-03T18:54:39.195998] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-03T18:54:39.504812] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:39.722478] [DEBUG] [LOCAL ] FDX: Primary data saved (52286 records). [2025-10-03T18:54:39.722634] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-03T18:54:39.722784] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FDX took 41.5s. Estimated remaining: 3h 37m 0s. Rate: 7.1 symbols/min [2025-10-03T18:54:39.909615] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:39.935627] [DEBUG] [LOCAL ] FF: Loaded 25097 existing records from primary storage. [2025-10-03T18:54:39.935925] [INFO ] [MAIN ] FF: Loaded 25097 existing records. [2025-10-03T18:54:40.002404] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-03T18:54:40.129453] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:40.129943] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-03T18:54:40.130024] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-03T18:54:40.130351] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-03T18:54:40.130504] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-03T18:54:40.510170] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-03T18:54:40.614604] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:40.790639] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-03T18:54:40.850141] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-03T18:54:40.932028] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T18:54:41.590676] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-03T18:54:41.960880] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T18:54:42.390771] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-03T18:54:43.195261] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-03T18:54:43.197597] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T18:54:43.362247] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T18:54:43.990744] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-03T18:54:44.790639] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-03T18:54:44.846938] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T18:54:44.857865] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-03T18:54:45.590692] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-03T18:54:45.627353] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T18:54:46.390737] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-03T18:54:46.582805] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T18:54:47.190751] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-03T18:54:47.908445] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T18:54:47.911566] [INFO ] [REMOTE ] FE: Full fetch complete (77273 records). [2025-10-03T18:54:47.911742] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-03T18:54:47.995814] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-03T18:54:48.277763] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T18:54:48.422731] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-03T18:54:48.422866] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-03T18:54:48.424309] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-03T18:54:48.424384] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-03T18:54:48.426286] [DEBUG] [LOCAL ] FE: Trimmed 77273 records to 54208 (keeping 200 days of data) [2025-10-03T18:54:48.778159] [DEBUG] [LOCAL ] FE: Primary data saved (54208 records). [2025-10-03T18:54:48.778313] [INFO ] [MAIN ] FE: Full history saved. [2025-10-03T18:54:48.778432] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FE took 39.6s. Estimated remaining: 3h 36m 53s. Rate: 7.1 symbols/min [2025-10-03T18:54:48.796014] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-03T18:54:48.975294] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:48.984519] [DEBUG] [LOCAL ] FFA: Loaded 5933 existing records from primary storage. [2025-10-03T18:54:48.984805] [INFO ] [MAIN ] FFA: Loaded 5933 existing records. [2025-10-03T18:54:49.209986] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:49.210399] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-03T18:54:49.210461] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-03T18:54:49.210687] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-03T18:54:49.210757] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-03T18:54:49.599141] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-03T18:54:49.605341] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:54:49.680278] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T18:54:49.712199] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T18:54:50.390768] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-03T18:54:51.190678] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-03T18:54:51.623667] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T18:54:51.637969] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-03T18:54:51.994801] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-03T18:54:52.002388] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T18:54:52.599928] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T18:54:52.790722] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-03T18:54:53.590776] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-03T18:54:54.390748] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-03T18:54:54.499190] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T18:54:54.499594] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T18:54:55.190762] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-03T18:54:55.699291] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-03T18:54:55.932171] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:54:55.990732] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-03T18:54:56.790701] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-03T18:54:57.071004] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T18:54:57.590730] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-03T18:54:58.351556] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T18:54:58.354456] [INFO ] [REMOTE ] FERG: Full fetch complete (70934 records). [2025-10-03T18:54:58.354638] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-03T18:54:58.396483] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-03T18:54:58.660990] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T18:54:58.850392] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-03T18:54:58.850509] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-03T18:54:58.851957] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-03T18:54:58.852030] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-03T18:54:58.854115] [DEBUG] [LOCAL ] FERG: Trimmed 70934 records to 49585 (keeping 200 days of data) [2025-10-03T18:54:59.198610] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-03T18:54:59.226035] [DEBUG] [LOCAL ] FERG: Primary data saved (49585 records). [2025-10-03T18:54:59.226345] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-03T18:54:59.227251] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FERG took 39.5s. Estimated remaining: 3h 36m 48s. Rate: 7.1 symbols/min [2025-10-03T18:54:59.391130] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T18:54:59.431823] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:54:59.457337] [DEBUG] [LOCAL ] FFC: Loaded 16849 existing records from primary storage. [2025-10-03T18:54:59.457721] [INFO ] [MAIN ] FFC: Loaded 16849 existing records. [2025-10-03T18:54:59.654274] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:54:59.654678] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-03T18:54:59.654748] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-03T18:54:59.655042] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-03T18:54:59.655102] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-03T18:54:59.853806] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-03T18:55:00.006174] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-03T18:55:00.052328] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:00.790746] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-03T18:55:01.232101] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T18:55:01.590746] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-03T18:55:01.830998] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-03T18:55:02.244857] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-03T18:55:02.390712] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-03T18:55:03.190757] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-03T18:55:03.249929] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T18:55:03.990732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-03T18:55:04.417378] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T18:55:04.603464] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T18:55:04.790704] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-03T18:55:05.590729] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-03T18:55:06.109220] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:55:06.206494] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T18:55:06.390722] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-03T18:55:07.190729] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-03T18:55:07.446708] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T18:55:07.990715] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-03T18:55:08.199514] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T18:55:08.576710] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T18:55:08.790678] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-03T18:55:09.494455] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T18:55:09.495891] [INFO ] [REMOTE ] FET: Full fetch complete (18413 records). [2025-10-03T18:55:09.495980] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-03T18:55:09.595814] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-03T18:55:09.930675] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-03T18:55:09.930782] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-03T18:55:09.931279] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-03T18:55:09.931357] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-03T18:55:09.932630] [DEBUG] [LOCAL ] FET: Trimmed 18413 records to 13092 (keeping 200 days of data) [2025-10-03T18:55:10.018968] [DEBUG] [LOCAL ] FET: Primary data saved (13092 records). [2025-10-03T18:55:10.019121] [INFO ] [MAIN ] FET: Full history saved. [2025-10-03T18:55:10.019225] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FET took 31.5s. Estimated remaining: 3h 36m 44s. Rate: 7.1 symbols/min [2025-10-03T18:55:10.222743] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:10.256726] [DEBUG] [LOCAL ] FFWM: Loaded 36004 existing records from primary storage. [2025-10-03T18:55:10.257054] [INFO ] [MAIN ] FFWM: Loaded 36004 existing records. [2025-10-03T18:55:10.395779] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-03T18:55:10.455673] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:10.456009] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-03T18:55:10.456137] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-03T18:55:10.460410] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T18:55:10.462010] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-03T18:55:10.462348] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-03T18:55:10.495825] [INFO ] [REMOTE ] FF: Full fetch complete (36719 records). [2025-10-03T18:55:10.508102] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-03T18:55:11.194744] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-03T18:55:11.233801] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:11.330476] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-03T18:55:11.330565] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-03T18:55:11.331180] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-03T18:55:11.331248] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-03T18:55:11.332802] [DEBUG] [LOCAL ] FF: Trimmed 36719 records to 25223 (keeping 200 days of data) [2025-10-03T18:55:11.451698] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T18:55:11.518827] [DEBUG] [LOCAL ] FF: Primary data saved (25223 records). [2025-10-03T18:55:11.518985] [INFO ] [MAIN ] FF: Full history saved. [2025-10-03T18:55:11.519084] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FF took 31.8s. Estimated remaining: 3h 36m 23s. Rate: 7.1 symbols/min [2025-10-03T18:55:11.711088] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:11.737999] [DEBUG] [LOCAL ] FG: Loaded 22965 existing records from primary storage. [2025-10-03T18:55:11.738355] [INFO ] [MAIN ] FG: Loaded 22965 existing records. [2025-10-03T18:55:11.882549] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-03T18:55:11.972171] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:11.972412] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-03T18:55:11.972466] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-03T18:55:11.972830] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-03T18:55:11.972916] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-03T18:55:11.995826] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-03T18:55:12.377877] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:12.790732] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-03T18:55:13.043102] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T18:55:13.590702] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-03T18:55:14.390676] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-03T18:55:14.706274] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:55:14.742778] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-03T18:55:14.894039] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T18:55:15.190709] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-03T18:55:15.990683] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-03T18:55:16.658597] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T18:55:16.705817] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T18:55:16.706952] [INFO ] [REMOTE ] FFA: Full fetch complete (8572 records). [2025-10-03T18:55:16.707082] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-03T18:55:16.795766] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-03T18:55:17.156783] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-03T18:55:17.156889] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-03T18:55:17.157176] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-03T18:55:17.157291] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-03T18:55:17.157938] [DEBUG] [LOCAL ] FFA: Trimmed 8572 records to 6012 (keeping 200 days of data) [2025-10-03T18:55:17.198584] [DEBUG] [LOCAL ] FFA: Primary data saved (6012 records). [2025-10-03T18:55:17.198743] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-03T18:55:17.198880] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FFA took 28.4s. Estimated remaining: 3h 36m 10s. Rate: 7.2 symbols/min [2025-10-03T18:55:17.386145] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:17.397397] [DEBUG] [LOCAL ] FGN: Loaded 3909 existing records from primary storage. [2025-10-03T18:55:17.397709] [INFO ] [MAIN ] FGN: Loaded 3909 existing records. [2025-10-03T18:55:17.586237] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:17.586457] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-03T18:55:17.586508] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-03T18:55:17.586837] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-03T18:55:17.586898] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-03T18:55:17.598575] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-03T18:55:17.992074] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:18.144313] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:55:18.390671] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-03T18:55:18.618258] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T18:55:18.729537] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-10-03T18:55:19.190673] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-03T18:55:19.990681] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-03T18:55:20.219926] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T18:55:20.790739] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-03T18:55:21.405290] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T18:55:21.405512] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T18:55:21.590707] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-03T18:55:22.390728] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-03T18:55:23.088333] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T18:55:23.158089] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T18:55:23.190700] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-03T18:55:23.990712] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-03T18:55:24.046267] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T18:55:24.790732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-03T18:55:25.323536] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T18:55:25.440150] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T18:55:25.590730] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-03T18:55:26.390720] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-03T18:55:26.830464] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T18:55:27.190728] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-03T18:55:27.677762] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T18:55:27.679918] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T18:55:27.990734] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-03T18:55:28.570115] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T18:55:28.790732] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-03T18:55:29.590713] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-03T18:55:29.842902] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T18:55:30.390724] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-03T18:55:30.835221] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T18:55:31.190701] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-03T18:55:31.454762] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T18:55:31.990693] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-03T18:55:32.317766] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T18:55:32.790735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-03T18:55:33.350811] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-03T18:55:33.378255] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T18:55:33.590735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-03T18:55:34.118536] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T18:55:34.390710] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-03T18:55:35.190717] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-03T18:55:35.611162] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-03T18:55:35.775808] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:55:35.990742] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-03T18:55:36.790700] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-03T18:55:37.054328] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T18:55:37.056322] [INFO ] [REMOTE ] FFWM: Full fetch complete (51801 records). [2025-10-03T18:55:37.056422] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-03T18:55:37.392391] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T18:55:37.495021] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-03T18:55:37.495105] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-03T18:55:37.495845] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-03T18:55:37.495912] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-03T18:55:37.497115] [DEBUG] [LOCAL ] FFWM: Trimmed 51801 records to 36233 (keeping 200 days of data) [2025-10-03T18:55:37.595959] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-03T18:55:37.731943] [DEBUG] [LOCAL ] FFWM: Primary data saved (36233 records). [2025-10-03T18:55:37.732129] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-03T18:55:37.732382] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FFWM took 27.7s. Estimated remaining: 3h 36m 24s. Rate: 7.1 symbols/min [2025-10-03T18:55:37.925296] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:37.925497] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-03T18:55:37.925537] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-03T18:55:37.925683] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-03T18:55:37.925741] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-03T18:55:37.925786] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-03T18:55:37.925821] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-03T18:55:38.231348] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T18:55:38.327154] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:38.390668] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-03T18:55:38.605380] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:55:38.605860] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-03T18:55:38.606024] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:55:38.606104] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-03T18:55:38.606185] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:55:38.606276] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-03T18:55:38.606370] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-03T18:55:38.606431] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-03T18:55:38.606502] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-03T18:55:38.606575] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FGSN took 0.9s. Estimated remaining: 3h 36m 1s. Rate: 7.1 symbols/min [2025-10-03T18:55:38.825910] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:38.866503] [DEBUG] [LOCAL ] FHI: Loaded 40514 existing records from primary storage. [2025-10-03T18:55:38.866853] [INFO ] [MAIN ] FHI: Loaded 40514 existing records. [2025-10-03T18:55:39.066160] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:39.066377] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-03T18:55:39.066427] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-03T18:55:39.066734] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-03T18:55:39.066794] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-03T18:55:39.195802] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-03T18:55:39.454981] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:39.990701] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-03T18:55:40.448784] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T18:55:40.790748] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-03T18:55:41.239032] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T18:55:41.429794] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:55:41.590703] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-03T18:55:42.108237] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:55:42.109181] [INFO ] [REMOTE ] FGN: Full fetch complete (5774 records). [2025-10-03T18:55:42.109255] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-03T18:55:42.395767] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-03T18:55:42.509992] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-03T18:55:42.510074] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-03T18:55:42.510253] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-03T18:55:42.510295] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-03T18:55:42.511055] [DEBUG] [LOCAL ] FGN: Trimmed 5774 records to 3930 (keeping 200 days of data) [2025-10-03T18:55:42.535672] [DEBUG] [LOCAL ] FGN: Primary data saved (3930 records). [2025-10-03T18:55:42.535808] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-03T18:55:42.535919] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGN took 25.3s. Estimated remaining: 3h 35m 45s. Rate: 7.2 symbols/min [2025-10-03T18:55:42.726567] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:42.793279] [DEBUG] [LOCAL ] FHN: Loaded 53755 existing records from primary storage. [2025-10-03T18:55:42.793696] [INFO ] [MAIN ] FHN: Loaded 53755 existing records. [2025-10-03T18:55:42.991195] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:42.991461] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-03T18:55:42.991521] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-03T18:55:42.991890] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-03T18:55:42.991952] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-03T18:55:43.196467] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-03T18:55:43.394525] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:43.525935] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T18:55:43.990728] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-03T18:55:44.229246] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:55:44.790705] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-03T18:55:45.441925] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T18:55:45.590717] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-03T18:55:46.390688] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-03T18:55:46.502882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T18:55:46.991307] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T18:55:47.118809] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T18:55:47.190703] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-03T18:55:47.990744] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-03T18:55:48.720761] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T18:55:48.767900] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T18:55:48.790724] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-03T18:55:49.590732] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-03T18:55:49.619628] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T18:55:49.620967] [INFO ] [REMOTE ] FFC: Full fetch complete (24752 records). [2025-10-03T18:55:49.621055] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-03T18:55:50.037734] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-03T18:55:50.037836] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-03T18:55:50.038357] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-03T18:55:50.038454] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-03T18:55:50.039277] [DEBUG] [LOCAL ] FFC: Trimmed 24752 records to 16957 (keeping 200 days of data) [2025-10-03T18:55:50.147216] [DEBUG] [LOCAL ] FFC: Primary data saved (16957 records). [2025-10-03T18:55:50.147367] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-03T18:55:50.147494] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FFC took 50.9s. Estimated remaining: 3h 35m 35s. Rate: 7.2 symbols/min [2025-10-03T18:55:50.325368] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:50.389375] [DEBUG] [LOCAL ] FI: Loaded 53888 existing records from primary storage. [2025-10-03T18:55:50.389840] [INFO ] [MAIN ] FI: Loaded 53888 existing records. [2025-10-03T18:55:50.401852] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-03T18:55:50.593350] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:50.593583] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-03T18:55:50.593635] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-03T18:55:50.593887] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-03T18:55:50.593944] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-03T18:55:50.994344] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:51.190720] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-03T18:55:51.282988] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:55:51.506853] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T18:55:51.990707] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-03T18:55:52.796230] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-03T18:55:52.810278] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T18:55:53.550461] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:55:53.590629] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-03T18:55:54.392799] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-03T18:55:54.396476] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T18:55:55.190735] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-03T18:55:55.231471] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T18:55:55.411785] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T18:55:55.990719] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-03T18:55:56.790627] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-03T18:55:57.004350] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T18:55:57.021604] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T18:55:57.023792] [INFO ] [REMOTE ] FG: Full fetch complete (27769 records). [2025-10-03T18:55:57.023914] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-03T18:55:57.471113] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-03T18:55:57.471196] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-03T18:55:57.471768] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-03T18:55:57.471854] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-03T18:55:57.473247] [DEBUG] [LOCAL ] FG: Trimmed 27769 records to 23125 (keeping 200 days of data) [2025-10-03T18:55:57.591088] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-03T18:55:57.668094] [DEBUG] [LOCAL ] FG: Primary data saved (23125 records). [2025-10-03T18:55:57.668245] [INFO ] [MAIN ] FG: Full history saved. [2025-10-03T18:55:57.668342] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FG took 46.1s. Estimated remaining: 3h 35m 25s. Rate: 7.2 symbols/min [2025-10-03T18:55:57.903054] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:55:57.930801] [DEBUG] [LOCAL ] FICO: Loaded 20838 existing records from primary storage. [2025-10-03T18:55:57.931170] [INFO ] [MAIN ] FICO: Loaded 20838 existing records. [2025-10-03T18:55:58.223988] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:55:58.224396] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-03T18:55:58.224471] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-03T18:55:58.225056] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-03T18:55:58.225151] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-03T18:55:58.408450] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-03T18:55:58.417193] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:55:58.842938] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:55:59.190701] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-03T18:55:59.340877] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:55:59.990662] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-03T18:56:00.233370] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:56:00.254281] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T18:56:00.790689] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-03T18:56:01.590723] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-03T18:56:01.932763] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-03T18:56:02.381356] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T18:56:02.390604] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-03T18:56:03.177947] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T18:56:03.190671] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-03T18:56:03.483054] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T18:56:03.990683] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-03T18:56:04.761185] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-03T18:56:04.790625] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-03T18:56:05.580090] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T18:56:05.590747] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-03T18:56:06.390680] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-03T18:56:06.705198] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T18:56:06.889080] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T18:56:07.190698] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-03T18:56:07.990699] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-03T18:56:08.159610] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T18:56:08.262584] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:56:08.790688] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-03T18:56:09.547141] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T18:56:09.590619] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-03T18:56:10.037205] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T18:56:10.390682] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-03T18:56:11.190692] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-03T18:56:11.251208] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:56:11.661754] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T18:56:11.990682] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-03T18:56:12.735571] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T18:56:12.790675] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-03T18:56:13.464241] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T18:56:13.590683] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-03T18:56:14.216526] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T18:56:14.218607] [INFO ] [REMOTE ] FHI: Full fetch complete (57701 records). [2025-10-03T18:56:14.218740] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-03T18:56:14.396729] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-03T18:56:14.630455] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-03T18:56:14.630539] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-03T18:56:14.631418] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-03T18:56:14.631493] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-03T18:56:14.632915] [DEBUG] [LOCAL ] FHI: Trimmed 57701 records to 40721 (keeping 200 days of data) [2025-10-03T18:56:14.911353] [DEBUG] [LOCAL ] FHI: Primary data saved (40721 records). [2025-10-03T18:56:14.911479] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-03T18:56:14.911561] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 36.3s. Estimated remaining: 3h 35m 33s. Rate: 7.1 symbols/min [2025-10-03T18:56:15.105422] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:15.105758] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-03T18:56:15.105942] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-03T18:56:15.106127] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-03T18:56:15.106189] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-03T18:56:15.106243] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-03T18:56:15.106279] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-03T18:56:15.197768] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-03T18:56:15.508636] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:15.541140] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-03T18:56:15.990640] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-03T18:56:16.472311] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-03T18:56:16.581241] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T18:56:16.790685] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-03T18:56:17.176410] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-03T18:56:17.472535] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T18:56:17.590698] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-03T18:56:18.390730] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-03T18:56:18.624438] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-03T18:56:19.190678] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-03T18:56:19.501947] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T18:56:19.745953] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T18:56:19.990732] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-03T18:56:20.302986] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-03T18:56:20.790701] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-03T18:56:21.241015] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T18:56:21.590706] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-03T18:56:21.908565] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T18:56:22.390710] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-03T18:56:23.190722] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-03T18:56:23.529100] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:56:23.529462] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-03T18:56:23.529564] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:56:23.529670] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-03T18:56:23.529745] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:56:23.529818] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-03T18:56:23.529914] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-03T18:56:23.529983] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-03T18:56:23.530068] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-03T18:56:23.530141] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FIG took 8.6s. Estimated remaining: 3h 35m 25s. Rate: 7.1 symbols/min [2025-10-03T18:56:23.676594] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T18:56:23.770272] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:23.826520] [DEBUG] [LOCAL ] FIGS: Loaded 49208 existing records from primary storage. [2025-10-03T18:56:23.826908] [INFO ] [MAIN ] FIGS: Loaded 49208 existing records. [2025-10-03T18:56:23.996905] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-03T18:56:24.020832] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:24.021205] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-03T18:56:24.021263] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-03T18:56:24.021786] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-03T18:56:24.021849] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-03T18:56:24.426599] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:24.790683] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-03T18:56:25.590731] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-03T18:56:25.877707] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:56:26.390729] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-03T18:56:26.818697] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-03T18:56:26.867309] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:56:26.869352] [INFO ] [REMOTE ] FICO: Full fetch complete (28894 records). [2025-10-03T18:56:26.869445] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-03T18:56:27.195827] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-03T18:56:27.320466] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-03T18:56:27.320682] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-03T18:56:27.321504] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-03T18:56:27.321582] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-03T18:56:27.322841] [DEBUG] [LOCAL ] FICO: Trimmed 28894 records to 21102 (keeping 200 days of data) [2025-10-03T18:56:27.465111] [DEBUG] [LOCAL ] FICO: Primary data saved (21102 records). [2025-10-03T18:56:27.465265] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-03T18:56:27.465464] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FICO took 29.8s. Estimated remaining: 3h 35m 8s. Rate: 7.1 symbols/min [2025-10-03T18:56:27.672197] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:27.720942] [DEBUG] [LOCAL ] FIHL: Loaded 40141 existing records from primary storage. [2025-10-03T18:56:27.721276] [INFO ] [MAIN ] FIHL: Loaded 40141 existing records. [2025-10-03T18:56:27.925026] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:27.931661] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-03T18:56:27.931784] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-03T18:56:27.932712] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T18:56:27.932766] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-03T18:56:27.934948] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-03T18:56:27.968721] [INFO ] [REMOTE ] FHN: Full fetch complete (77282 records). [2025-10-03T18:56:28.003731] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-03T18:56:27.994506] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-03T18:56:28.658034] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:28.787129] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-03T18:56:28.787269] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-03T18:56:28.788506] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-03T18:56:28.788687] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-03T18:56:28.790849] [DEBUG] [LOCAL ] FHN: Trimmed 77282 records to 54145 (keeping 200 days of data) [2025-10-03T18:56:28.790680] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-03T18:56:28.937301] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T18:56:29.197985] [DEBUG] [LOCAL ] FHN: Primary data saved (54145 records). [2025-10-03T18:56:29.198150] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-03T18:56:29.198258] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FHN took 46.7s. Estimated remaining: 3h 34m 48s. Rate: 7.2 symbols/min [2025-10-03T18:56:29.385532] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:29.396752] [DEBUG] [LOCAL ] FINS: Loaded 8316 existing records from primary storage. [2025-10-03T18:56:29.396989] [INFO ] [MAIN ] FINS: Loaded 8316 existing records. [2025-10-03T18:56:29.593161] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:29.593233] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-03T18:56:29.593553] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-03T18:56:29.594351] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-03T18:56:29.594565] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-03T18:56:29.594624] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-03T18:56:30.070200] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:30.072203] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-03T18:56:30.104772] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T18:56:30.390689] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-03T18:56:31.190725] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-03T18:56:31.582492] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-03T18:56:31.585921] [INFO ] [REMOTE ] FI: Full fetch complete (77195 records). [2025-10-03T18:56:31.586068] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-03T18:56:31.990867] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-03T18:56:32.040789] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-03T18:56:32.041705] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-03T18:56:32.042761] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-03T18:56:32.042891] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-03T18:56:32.076080] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T18:56:32.075041] [DEBUG] [LOCAL ] FI: Trimmed 77195 records to 54278 (keeping 200 days of data) [2025-10-03T18:56:32.190132] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T18:56:32.472798] [DEBUG] [LOCAL ] FI: Primary data saved (54278 records). [2025-10-03T18:56:32.473221] [INFO ] [MAIN ] FI: Full history saved. [2025-10-03T18:56:32.474767] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FI took 42.3s. Estimated remaining: 3h 34m 30s. Rate: 7.2 symbols/min [2025-10-03T18:56:32.665161] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:32.715196] [DEBUG] [LOCAL ] FINV: Loaded 45625 existing records from primary storage. [2025-10-03T18:56:32.715566] [INFO ] [MAIN ] FINV: Loaded 45625 existing records. [2025-10-03T18:56:32.797240] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-03T18:56:32.907604] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:32.907868] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-03T18:56:32.907917] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-03T18:56:32.908504] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-03T18:56:32.908563] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-03T18:56:33.316105] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:33.335060] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T18:56:33.590704] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-03T18:56:33.966380] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T18:56:34.363047] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T18:56:34.390622] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-03T18:56:35.094795] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-03T18:56:35.190745] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-03T18:56:35.990700] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-03T18:56:36.589165] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T18:56:36.597601] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T18:56:36.790682] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-03T18:56:37.590718] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-03T18:56:38.231517] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T18:56:38.390702] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-03T18:56:38.866008] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-03T18:56:39.190742] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-03T18:56:39.744001] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T18:56:39.985473] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:56:39.990604] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-03T18:56:40.760736] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T18:56:40.790738] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-03T18:56:41.590744] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-03T18:56:42.292434] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T18:56:42.390732] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-03T18:56:43.190696] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-03T18:56:43.241533] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T18:56:43.272676] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:56:43.990724] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-03T18:56:44.790636] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-03T18:56:44.967124] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T18:56:45.453630] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:56:45.590737] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-03T18:56:46.343610] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-03T18:56:46.372898] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T18:56:46.390625] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-03T18:56:47.190719] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-03T18:56:47.871516] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T18:56:47.990689] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-03T18:56:48.268885] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T18:56:48.790699] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-03T18:56:49.470803] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T18:56:49.545218] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T18:56:49.590622] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-03T18:56:50.390734] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-03T18:56:50.960506] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-03T18:56:51.190728] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-03T18:56:51.956179] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T18:56:51.990714] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-03T18:56:52.512987] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-03T18:56:52.513884] [INFO ] [REMOTE ] FINS: Full fetch complete (12195 records). [2025-10-03T18:56:52.513958] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-03T18:56:52.693382] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T18:56:52.795710] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-03T18:56:52.941059] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-03T18:56:52.941140] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-03T18:56:52.941414] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-03T18:56:52.941454] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-03T18:56:52.942075] [DEBUG] [LOCAL ] FINS: Trimmed 12195 records to 8348 (keeping 200 days of data) [2025-10-03T18:56:52.999876] [DEBUG] [LOCAL ] FINS: Primary data saved (8348 records). [2025-10-03T18:56:53.000011] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-03T18:56:53.000109] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FINS took 23.8s. Estimated remaining: 3h 34m 44s. Rate: 7.1 symbols/min [2025-10-03T18:56:53.183982] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:56:53.235576] [DEBUG] [LOCAL ] FIS: Loaded 53751 existing records from primary storage. [2025-10-03T18:56:53.235965] [INFO ] [MAIN ] FIS: Loaded 53751 existing records. [2025-10-03T18:56:53.430148] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:56:53.430393] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-03T18:56:53.430443] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-03T18:56:53.430961] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-03T18:56:53.431023] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-03T18:56:53.595792] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-03T18:56:53.839142] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:56:54.384889] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T18:56:54.395605] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-03T18:56:54.770963] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-03T18:56:55.190707] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-03T18:56:55.990711] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-03T18:56:56.183385] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:56:56.388291] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-03T18:56:56.790683] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-03T18:56:57.590690] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-03T18:56:57.866183] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T18:56:58.397123] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-03T18:56:58.412348] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T18:56:59.190687] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-03T18:56:59.256391] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T18:56:59.896050] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T18:56:59.990671] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-03T18:57:00.776396] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T18:57:00.790568] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-03T18:57:01.590638] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-03T18:57:02.380073] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:57:02.384023] [INFO ] [REMOTE ] FIGS: Full fetch complete (71007 records). [2025-10-03T18:57:02.384140] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-03T18:57:02.418207] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-03T18:57:02.842950] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-10-03T18:57:02.900201] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-03T18:57:02.900874] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-03T18:57:02.901863] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-03T18:57:02.901929] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-03T18:57:02.903381] [DEBUG] [LOCAL ] FIGS: Trimmed 71007 records to 49571 (keeping 200 days of data) [2025-10-03T18:57:03.188436] [DEBUG] [LOCAL ] FIGS: Primary data saved (49571 records). [2025-10-03T18:57:03.188582] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-03T18:57:03.188705] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FIGS took 39.7s. Estimated remaining: 3h 34m 39s. Rate: 7.1 symbols/min [2025-10-03T18:57:03.202924] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-03T18:57:03.385443] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:03.418211] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-03T18:57:03.456268] [DEBUG] [LOCAL ] FIX: Loaded 29974 existing records from primary storage. [2025-10-03T18:57:03.456630] [INFO ] [MAIN ] FIX: Loaded 29974 existing records. [2025-10-03T18:57:03.665667] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:03.666091] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-03T18:57:03.666173] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-03T18:57:03.666482] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-03T18:57:03.666603] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-03T18:57:03.809987] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T18:57:03.998148] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-03T18:57:04.135812] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:04.790726] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-03T18:57:05.006729] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T18:57:05.590695] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-03T18:57:05.703184] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T18:57:05.843707] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:57:06.390686] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-03T18:57:07.098105] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-03T18:57:07.190678] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-03T18:57:07.950762] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:57:07.990692] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-03T18:57:08.634303] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T18:57:08.642521] [INFO ] [REMOTE ] FINV: Full fetch complete (63637 records). [2025-10-03T18:57:08.642742] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-03T18:57:08.796142] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-03T18:57:09.086742] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-03T18:57:09.086836] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-03T18:57:09.087591] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-03T18:57:09.087636] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-03T18:57:09.089173] [DEBUG] [LOCAL ] FINV: Trimmed 63637 records to 45997 (keeping 200 days of data) [2025-10-03T18:57:09.196116] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T18:57:09.203203] [INFO ] [REMOTE ] FIHL: Full fetch complete (55851 records). [2025-10-03T18:57:09.205097] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-03T18:57:09.595532] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-03T18:57:09.766872] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-03T18:57:09.767549] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-03T18:57:09.768804] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-03T18:57:09.769184] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-03T18:57:09.772880] [DEBUG] [LOCAL ] FIHL: Trimmed 55851 records to 40409 (keeping 200 days of data) [2025-10-03T18:57:09.906253] [DEBUG] [LOCAL ] FINV: Primary data saved (45997 records). [2025-10-03T18:57:09.906955] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-03T18:57:09.907875] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FINV took 37.4s. Estimated remaining: 3h 34m 27s. Rate: 7.1 symbols/min [2025-10-03T18:57:10.064061] [DEBUG] [LOCAL ] FIHL: Primary data saved (40409 records). [2025-10-03T18:57:10.064188] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-03T18:57:10.064270] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FIHL took 42.6s. Estimated remaining: 3h 34m 4s. Rate: 7.2 symbols/min [2025-10-03T18:57:10.678102] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:57:10.690262] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-03T18:57:10.751488] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T18:57:11.190679] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-03T18:57:12.317596] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T18:57:12.333351] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-03T18:57:12.808022] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T18:57:12.816429] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-03T18:57:14.111760] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T18:57:14.124585] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-03T18:57:14.209274] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-03T18:57:14.390773] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-03T18:57:16.016880] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T18:57:16.029305] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-03T18:57:16.067067] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:57:16.076175] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-03T18:57:17.120304] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T18:57:17.127821] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-03T18:57:18.057903] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T18:57:18.070619] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-03T18:57:18.089071] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T18:57:18.390746] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-03T18:57:19.702324] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T18:57:19.705104] [INFO ] [REMOTE ] FIS: Full fetch complete (77185 records). [2025-10-03T18:57:19.705241] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-03T18:57:20.025738] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T18:57:20.061820] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-03T18:57:20.166778] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-03T18:57:20.166873] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-03T18:57:20.167754] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-03T18:57:20.167822] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-03T18:57:20.169395] [DEBUG] [LOCAL ] FIS: Trimmed 77185 records to 54138 (keeping 200 days of data) [2025-10-03T18:57:20.516532] [DEBUG] [LOCAL ] FIS: Primary data saved (54138 records). [2025-10-03T18:57:20.516716] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-03T18:57:20.516830] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIS took 27.5s. Estimated remaining: 3h 33m 59s. Rate: 7.2 symbols/min [2025-10-03T18:57:21.804149] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T18:57:21.810916] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-03T18:57:23.129584] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T18:57:23.136674] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-03T18:57:24.366032] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T18:57:24.367784] [INFO ] [REMOTE ] FIX: Full fetch complete (45446 records). [2025-10-03T18:57:24.367868] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-03T18:57:24.773772] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-03T18:57:24.773866] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-03T18:57:24.774562] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-03T18:57:24.774611] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-03T18:57:24.775896] [DEBUG] [LOCAL ] FIX: Trimmed 45446 records to 30134 (keeping 200 days of data) [2025-10-03T18:57:24.975555] [DEBUG] [LOCAL ] FIX: Primary data saved (30134 records). [2025-10-03T18:57:24.975754] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-03T18:57:24.975861] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIX took 21.8s. Estimated remaining: 3h 33m 44s. Rate: 7.2 symbols/min [2025-10-03T18:57:25.602743] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.656274] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-03T18:57:25.666713] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-03T18:57:25.740850] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-03T18:57:25.739211] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.740526] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.747929] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-03T18:57:25.763813] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-03T18:57:25.768052] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:25.768164] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-03T18:57:25.879946] [DEBUG] [LOCAL ] FLC: Loaded 5441 existing records from primary storage. [2025-10-03T18:57:25.892358] [INFO ] [MAIN ] FLC: Loaded 5441 existing records. [2025-10-03T18:57:26.092739] [DEBUG] [LOCAL ] FLNG: Loaded 33928 existing records from primary storage. [2025-10-03T18:57:26.138006] [INFO ] [MAIN ] FLNG: Loaded 33928 existing records. [2025-10-03T18:57:26.152180] [DEBUG] [LOCAL ] FLG: Loaded 53710 existing records from primary storage. [2025-10-03T18:57:26.236124] [INFO ] [MAIN ] FLG: Loaded 53710 existing records. [2025-10-03T18:57:26.382719] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.435788] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-03T18:57:26.508503] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-03T18:57:26.562832] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-03T18:57:26.582954] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-03T18:57:26.880479] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.856522] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:26.914520] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-03T18:57:26.927785] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-03T18:57:26.958761] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:26.959238] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-03T18:57:26.986430] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-03T18:57:26.986566] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-03T18:57:27.002634] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-03T18:57:27.007915] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-03T18:57:27.041637] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-03T18:57:27.142438] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-03T18:57:27.186127] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:57:27.238048] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-03T18:57:27.238180] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:57:27.238226] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-03T18:57:27.238263] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:57:27.357627] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-03T18:57:27.406438] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-03T18:57:27.486910] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-03T18:57:27.570853] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-03T18:57:27.666344] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 33m 25s. Rate: 7.2 symbols/min [2025-10-03T18:57:27.759527] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:27.815363] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-03T18:57:28.157373] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.209804] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:28.231557] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-03T18:57:28.272397] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.274302] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-03T18:57:28.331136] [DEBUG] [LOCAL ] FLO: Loaded 52293 existing records from primary storage. [2025-10-03T18:57:28.331478] [INFO ] [MAIN ] FLO: Loaded 52293 existing records. [2025-10-03T18:57:28.444939] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T18:57:28.463488] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-03T18:57:28.531799] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:28.532031] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-03T18:57:28.532084] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-03T18:57:28.534477] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-03T18:57:28.534565] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-03T18:57:28.907747] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:28.908063] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-03T18:57:29.149771] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T18:57:29.151596] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-03T18:57:29.675507] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T18:57:29.683832] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-03T18:57:29.700257] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T18:57:29.702348] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-03T18:57:30.025954] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T18:57:30.037431] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-03T18:57:30.383380] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T18:57:30.385434] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-03T18:57:30.672183] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T18:57:30.683440] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-03T18:57:30.802161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T18:57:31.056474] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T18:57:31.190704] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-03T18:57:31.868170] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T18:57:31.990730] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-03T18:57:32.305896] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T18:57:32.474602] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T18:57:32.564816] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T18:57:32.790728] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-03T18:57:33.373893] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T18:57:33.590718] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-03T18:57:34.390701] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-03T18:57:35.190704] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-03T18:57:35.224923] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T18:57:35.990633] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-03T18:57:36.248511] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-03T18:57:36.611587] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-03T18:57:36.639862] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T18:57:36.790685] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-03T18:57:37.274099] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T18:57:37.590689] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-03T18:57:38.390684] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-03T18:57:39.190705] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-03T18:57:39.437094] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:57:39.754800] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T18:57:39.990677] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-03T18:57:40.080538] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T18:57:40.790739] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-03T18:57:41.590685] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-03T18:57:41.784553] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T18:57:42.149437] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T18:57:42.390729] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-03T18:57:43.190637] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-03T18:57:43.271783] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:57:43.672956] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T18:57:43.673874] [INFO ] [REMOTE ] FLC: Full fetch complete (7928 records). [2025-10-03T18:57:43.673968] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-03T18:57:43.991801] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-03T18:57:44.085322] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-03T18:57:44.085429] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-03T18:57:44.085837] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-03T18:57:44.085956] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-03T18:57:44.086813] [DEBUG] [LOCAL ] FLC: Trimmed 7928 records to 5459 (keeping 200 days of data) [2025-10-03T18:57:44.123996] [DEBUG] [LOCAL ] FLC: Primary data saved (5459 records). [2025-10-03T18:57:44.124140] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-03T18:57:44.124246] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLC took 19.1s. Estimated remaining: 3h 33m 31s. Rate: 7.2 symbols/min [2025-10-03T18:57:44.270218] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T18:57:44.354196] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:44.354369] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-03T18:57:44.354408] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-03T18:57:44.354518] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-03T18:57:44.354561] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-03T18:57:44.354603] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-03T18:57:44.354679] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-03T18:57:44.729986] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:44.790676] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-03T18:57:44.997777] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T18:57:44.998180] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-03T18:57:44.998308] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T18:57:44.998417] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-03T18:57:44.998502] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T18:57:44.998594] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-03T18:57:44.998770] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-03T18:57:44.998843] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-03T18:57:44.998911] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-03T18:57:44.999019] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 33m 9s. Rate: 7.2 symbols/min [2025-10-03T18:57:45.193956] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:45.255217] [DEBUG] [LOCAL ] FLR: Loaded 53509 existing records from primary storage. [2025-10-03T18:57:45.255579] [INFO ] [MAIN ] FLR: Loaded 53509 existing records. [2025-10-03T18:57:45.461450] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:45.461970] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-03T18:57:45.462094] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-03T18:57:45.464567] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-03T18:57:45.464781] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-03T18:57:45.596935] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-03T18:57:45.693428] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T18:57:45.915018] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:46.390697] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-03T18:57:47.053377] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T18:57:47.190684] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-03T18:57:47.950879] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T18:57:47.990680] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-03T18:57:48.790636] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-03T18:57:48.970308] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-03T18:57:49.377571] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T18:57:49.590688] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-03T18:57:50.390735] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-03T18:57:50.638389] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T18:57:51.072066] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T18:57:51.190731] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-03T18:57:51.990697] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-03T18:57:52.220350] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T18:57:52.749250] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:57:52.790706] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-03T18:57:53.590739] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-03T18:57:53.650089] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T18:57:54.289308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T18:57:54.390688] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-03T18:57:55.190696] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-03T18:57:55.278664] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T18:57:55.826159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T18:57:55.990724] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-03T18:57:56.790628] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-03T18:57:57.062259] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T18:57:57.164883] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T18:57:57.166912] [INFO ] [REMOTE ] FLNG: Full fetch complete (50613 records). [2025-10-03T18:57:57.167042] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-03T18:57:57.594381] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-03T18:57:57.595681] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-03T18:57:57.595781] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-03T18:57:57.596710] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-03T18:57:57.596899] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-03T18:57:57.598187] [DEBUG] [LOCAL ] FLNG: Trimmed 50613 records to 34143 (keeping 200 days of data) [2025-10-03T18:57:57.818590] [DEBUG] [LOCAL ] FLNG: Primary data saved (34143 records). [2025-10-03T18:57:57.818772] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-03T18:57:57.818867] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLNG took 32.8s. Estimated remaining: 3h 33m 9s. Rate: 7.2 symbols/min [2025-10-03T18:57:58.006671] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:57:58.057734] [DEBUG] [LOCAL ] FLS: Loaded 50554 existing records from primary storage. [2025-10-03T18:57:58.058089] [INFO ] [MAIN ] FLS: Loaded 50554 existing records. [2025-10-03T18:57:58.248940] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:57:58.249153] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-03T18:57:58.249203] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-03T18:57:58.251264] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-03T18:57:58.251333] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-03T18:57:58.406514] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-03T18:57:58.685247] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:57:59.183016] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-03T18:57:59.194687] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-03T18:57:59.279918] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:57:59.990631] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-03T18:58:00.313897] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T18:58:00.611543] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T18:58:00.790728] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-03T18:58:01.357749] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T18:58:01.360966] [INFO ] [REMOTE ] FLG: Full fetch complete (77309 records). [2025-10-03T18:58:01.361245] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-03T18:58:01.595959] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-03T18:58:01.925732] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-03T18:58:01.925838] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-03T18:58:01.926794] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-03T18:58:01.926869] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-03T18:58:01.928948] [DEBUG] [LOCAL ] FLG: Trimmed 77309 records to 54100 (keeping 200 days of data) [2025-10-03T18:58:02.314769] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T18:58:02.338005] [DEBUG] [LOCAL ] FLG: Primary data saved (54100 records). [2025-10-03T18:58:02.338161] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-03T18:58:02.340188] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLG took 37.4s. Estimated remaining: 3h 32m 54s. Rate: 7.2 symbols/min [2025-10-03T18:58:02.402639] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-03T18:58:02.553945] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:02.612669] [DEBUG] [LOCAL ] FLUT: Loaded 51173 existing records from primary storage. [2025-10-03T18:58:02.613045] [INFO ] [MAIN ] FLUT: Loaded 51173 existing records. [2025-10-03T18:58:02.802405] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:02.802620] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-03T18:58:02.802700] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-03T18:58:02.804321] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-03T18:58:02.804387] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-03T18:58:03.192252] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-03T18:58:03.214754] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:03.474471] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T18:58:03.947949] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T18:58:03.990718] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-03T18:58:04.664815] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T18:58:04.790691] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-03T18:58:05.590629] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-03T18:58:05.658184] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T18:58:06.390693] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-03T18:58:06.548555] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T18:58:07.165950] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T18:58:07.168583] [INFO ] [REMOTE ] FLO: Full fetch complete (75010 records). [2025-10-03T18:58:07.168733] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-03T18:58:07.202896] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-03T18:58:07.619753] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-03T18:58:07.619979] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-03T18:58:07.621138] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-03T18:58:07.621218] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-03T18:58:07.622877] [DEBUG] [LOCAL ] FLO: Trimmed 75010 records to 52669 (keeping 200 days of data) [2025-10-03T18:58:07.959259] [DEBUG] [LOCAL ] FLO: Primary data saved (52669 records). [2025-10-03T18:58:07.959441] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-03T18:58:07.959587] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLO took 40.2s. Estimated remaining: 3h 32m 40s. Rate: 7.2 symbols/min [2025-10-03T18:58:08.007211] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-03T18:58:08.155675] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:08.190168] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T18:58:08.217017] [DEBUG] [LOCAL ] FLXR: Loaded 20621 existing records from primary storage. [2025-10-03T18:58:08.217291] [INFO ] [MAIN ] FLXR: Loaded 20621 existing records. [2025-10-03T18:58:08.416438] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:08.416689] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-03T18:58:08.416750] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-03T18:58:08.417745] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-03T18:58:08.417811] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-03T18:58:08.795880] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-03T18:58:08.837872] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:09.100558] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T18:58:09.590676] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-03T18:58:09.736482] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T18:58:10.327105] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T18:58:10.390690] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-03T18:58:10.477323] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T18:58:11.132812] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T18:58:11.190708] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-03T18:58:11.990738] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-03T18:58:12.740512] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T18:58:12.790692] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-03T18:58:13.126427] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T18:58:13.590704] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-03T18:58:14.390686] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-03T18:58:14.425952] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T18:58:14.616550] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T18:58:15.190718] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-03T18:58:15.990699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-03T18:58:16.256697] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T18:58:16.375175] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T18:58:16.790759] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-03T18:58:17.590733] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-03T18:58:17.740595] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T18:58:18.029138] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T18:58:18.390739] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-03T18:58:19.190700] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-03T18:58:19.472521] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T18:58:19.475020] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T18:58:19.990702] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-03T18:58:20.742608] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T18:58:20.790719] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-03T18:58:21.585799] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T18:58:21.588633] [INFO ] [REMOTE ] FLR: Full fetch complete (76472 records). [2025-10-03T18:58:21.588792] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-03T18:58:21.595756] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-03T18:58:22.076187] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-03T18:58:22.076321] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-03T18:58:22.077373] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-03T18:58:22.077466] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-03T18:58:22.079550] [DEBUG] [LOCAL ] FLR: Trimmed 76472 records to 53897 (keeping 200 days of data) [2025-10-03T18:58:22.395431] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-03T18:58:22.424565] [DEBUG] [LOCAL ] FLR: Primary data saved (53897 records). [2025-10-03T18:58:22.424779] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-03T18:58:22.424907] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLR took 37.4s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-10-03T18:58:22.631315] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:22.675767] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T18:58:22.687410] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T18:58:22.748777] [DEBUG] [LOCAL ] FMC: Loaded 52171 existing records from primary storage. [2025-10-03T18:58:22.749129] [INFO ] [MAIN ] FMC: Loaded 52171 existing records. [2025-10-03T18:58:22.953428] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:22.953668] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-03T18:58:22.953736] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-03T18:58:22.956444] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-03T18:58:22.956517] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-03T18:58:23.195878] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-03T18:58:23.349873] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:23.990637] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-03T18:58:24.048225] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T18:58:24.790732] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-03T18:58:24.968160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T18:58:25.022318] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T18:58:25.590710] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-03T18:58:26.390671] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-03T18:58:26.656014] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T18:58:27.190730] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-03T18:58:27.441745] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-03T18:58:27.554569] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T18:58:27.990701] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-03T18:58:28.711704] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:58:28.744459] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T18:58:28.746186] [INFO ] [REMOTE ] FLXR: Full fetch complete (25826 records). [2025-10-03T18:58:28.746268] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-03T18:58:28.795871] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-03T18:58:29.149371] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-03T18:58:29.149473] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-03T18:58:29.149978] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-03T18:58:29.150042] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-03T18:58:29.150778] [DEBUG] [LOCAL ] FLXR: Trimmed 25826 records to 20820 (keeping 200 days of data) [2025-10-03T18:58:29.282027] [DEBUG] [LOCAL ] FLXR: Primary data saved (20820 records). [2025-10-03T18:58:29.282151] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-03T18:58:29.282252] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLXR took 21.3s. Estimated remaining: 3h 32m 32s. Rate: 7.2 symbols/min [2025-10-03T18:58:29.476855] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:29.485121] [DEBUG] [LOCAL ] FMN: Loaded 5624 existing records from primary storage. [2025-10-03T18:58:29.485338] [INFO ] [MAIN ] FMN: Loaded 5624 existing records. [2025-10-03T18:58:29.598101] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-03T18:58:29.689608] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:29.689848] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-03T18:58:29.689901] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-03T18:58:29.690243] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-03T18:58:29.690308] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-03T18:58:30.087104] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:30.390732] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-03T18:58:30.526389] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T18:58:31.142260] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-03T18:58:31.190699] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-03T18:58:31.349846] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T18:58:31.990726] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-03T18:58:32.463160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T18:58:32.469844] [INFO ] [REMOTE ] FLS: Full fetch complete (71683 records). [2025-10-03T18:58:32.469969] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-03T18:58:32.792425] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-03T18:58:32.894010] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-03T18:58:32.894107] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-03T18:58:32.895062] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-03T18:58:32.895142] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-03T18:58:32.896773] [DEBUG] [LOCAL ] FLS: Trimmed 71683 records to 50938 (keeping 200 days of data) [2025-10-03T18:58:33.236837] [DEBUG] [LOCAL ] FLS: Primary data saved (50938 records). [2025-10-03T18:58:33.236981] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-03T18:58:33.237103] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLS took 35.4s. Estimated remaining: 3h 32m 15s. Rate: 7.2 symbols/min [2025-10-03T18:58:33.434880] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:33.466399] [DEBUG] [LOCAL ] FMS: Loaded 30247 existing records from primary storage. [2025-10-03T18:58:33.466795] [INFO ] [MAIN ] FMS: Loaded 30247 existing records. [2025-10-03T18:58:33.595534] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-03T18:58:33.646396] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T18:58:33.740437] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:33.740692] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-03T18:58:33.740753] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-03T18:58:33.741777] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-03T18:58:33.741840] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-03T18:58:34.149298] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:34.349470] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T18:58:34.381022] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T18:58:34.390605] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-03T18:58:35.130228] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T18:58:35.190714] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-03T18:58:35.990711] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-03T18:58:36.033316] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T18:58:36.790736] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-03T18:58:37.590739] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-03T18:58:37.950666] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T18:58:38.390712] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-03T18:58:38.532003] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:58:38.864263] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T18:58:39.176338] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T18:58:39.190617] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-03T18:58:39.785799] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-03T18:58:39.990732] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-03T18:58:40.790706] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-03T18:58:41.199178] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T18:58:41.590733] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-03T18:58:42.390729] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-03T18:58:42.618453] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T18:58:42.980352] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T18:58:43.190724] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-03T18:58:43.414468] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T18:58:43.990723] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-03T18:58:44.790635] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-03T18:58:45.044381] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T18:58:45.558974] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T18:58:45.590668] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-03T18:58:45.898743] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T18:58:46.263871] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T18:58:46.390696] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-03T18:58:47.190724] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-03T18:58:47.615185] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T18:58:47.990702] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-03T18:58:48.473554] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T18:58:48.790754] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-03T18:58:49.377529] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-03T18:58:49.465079] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T18:58:49.590745] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-03T18:58:50.195121] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T18:58:50.390702] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-03T18:58:50.903451] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T18:58:50.904360] [INFO ] [REMOTE ] FMN: Full fetch complete (9937 records). [2025-10-03T18:58:50.904444] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-03T18:58:51.195872] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-03T18:58:51.316839] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-03T18:58:51.316946] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-03T18:58:51.317230] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-03T18:58:51.317278] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-03T18:58:51.317761] [DEBUG] [LOCAL ] FMN: Trimmed 9937 records to 5644 (keeping 200 days of data) [2025-10-03T18:58:51.354581] [DEBUG] [LOCAL ] FMN: Primary data saved (5644 records). [2025-10-03T18:58:51.354729] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-03T18:58:51.354823] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FMN took 22.1s. Estimated remaining: 3h 32m 24s. Rate: 7.2 symbols/min [2025-10-03T18:58:51.542375] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:51.589379] [DEBUG] [LOCAL ] FMX: Loaded 40981 existing records from primary storage. [2025-10-03T18:58:51.589784] [INFO ] [MAIN ] FMX: Loaded 40981 existing records. [2025-10-03T18:58:51.784742] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:51.784982] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-03T18:58:51.785031] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-03T18:58:51.787051] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-03T18:58:51.787124] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-03T18:58:51.995796] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-03T18:58:52.196013] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:52.787684] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T18:58:52.790633] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-03T18:58:52.790871] [INFO ] [REMOTE ] FLUT: Full fetch complete (72921 records). [2025-10-03T18:58:52.791169] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-03T18:58:53.262804] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-03T18:58:53.262938] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-03T18:58:53.264588] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-03T18:58:53.264743] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-03T18:58:53.266983] [DEBUG] [LOCAL ] FLUT: Trimmed 72921 records to 51557 (keeping 200 days of data) [2025-10-03T18:58:53.590971] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-03T18:58:53.721722] [DEBUG] [LOCAL ] FLUT: Primary data saved (51557 records). [2025-10-03T18:58:53.721931] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-03T18:58:53.722059] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FLUT took 51.4s. Estimated remaining: 3h 32m 5s. Rate: 7.2 symbols/min [2025-10-03T18:58:53.882279] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T18:58:54.049805] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:58:54.053206] [DEBUG] [LOCAL ] FMY: Loaded 1399 existing records from primary storage. [2025-10-03T18:58:54.053394] [INFO ] [MAIN ] FMY: Loaded 1399 existing records. [2025-10-03T18:58:54.315735] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:58:54.316313] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-03T18:58:54.316501] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-03T18:58:54.317003] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-03T18:58:54.317086] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-03T18:58:54.395970] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-03T18:58:54.772747] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-03T18:58:54.816832] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:58:54.877972] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-03T18:58:55.190704] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-03T18:58:55.990715] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-03T18:58:56.182697] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:58:56.579272] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T18:58:56.610504] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T18:58:56.790699] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-03T18:58:57.590709] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-03T18:58:58.048146] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T18:58:58.390702] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-03T18:58:58.932981] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:58:59.190707] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-03T18:58:59.990631] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-03T18:59:00.068552] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-03T18:59:00.197788] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T18:59:00.790707] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-03T18:59:01.534416] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T18:59:01.590721] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-03T18:59:02.101173] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T18:59:02.390721] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-03T18:59:03.137114] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T18:59:03.140025] [INFO ] [REMOTE ] FMC: Full fetch complete (75115 records). [2025-10-03T18:59:03.140160] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-03T18:59:03.201486] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-03T18:59:03.581614] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-03T18:59:03.581851] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-03T18:59:03.583139] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-03T18:59:03.583218] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-03T18:59:03.584878] [DEBUG] [LOCAL ] FMC: Trimmed 75115 records to 52558 (keeping 200 days of data) [2025-10-03T18:59:03.823382] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T18:59:03.953824] [DEBUG] [LOCAL ] FMC: Primary data saved (52558 records). [2025-10-03T18:59:03.953986] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-03T18:59:03.954132] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMC took 41.5s. Estimated remaining: 3h 32m 0s. Rate: 7.2 symbols/min [2025-10-03T18:59:04.000789] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-03T18:59:04.142884] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:04.182543] [DEBUG] [LOCAL ] FN: Loaded 38785 existing records from primary storage. [2025-10-03T18:59:04.182881] [INFO ] [MAIN ] FN: Loaded 38785 existing records. [2025-10-03T18:59:04.380474] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:04.380781] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-03T18:59:04.380849] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-03T18:59:04.382379] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-03T18:59:04.382444] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-03T18:59:04.795784] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-03T18:59:04.802218] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:04.868292] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T18:59:05.122421] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T18:59:05.124926] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T18:59:05.127981] [INFO ] [REMOTE ] FMS: Full fetch complete (42413 records). [2025-10-03T18:59:05.128087] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-03T18:59:05.550271] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-03T18:59:05.550579] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-03T18:59:05.551282] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-03T18:59:05.551350] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-03T18:59:05.552434] [DEBUG] [LOCAL ] FMS: Trimmed 42413 records to 30400 (keeping 200 days of data) [2025-10-03T18:59:05.605482] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-03T18:59:05.743572] [DEBUG] [LOCAL ] FMS: Primary data saved (30400 records). [2025-10-03T18:59:05.743757] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-03T18:59:05.743907] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMS took 32.5s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-03T18:59:05.926948] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:05.981854] [DEBUG] [LOCAL ] FNB: Loaded 52848 existing records from primary storage. [2025-10-03T18:59:05.982223] [INFO ] [MAIN ] FNB: Loaded 52848 existing records. [2025-10-03T18:59:06.176757] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:06.177050] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-03T18:59:06.177102] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-03T18:59:06.180471] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-03T18:59:06.180537] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-03T18:59:06.397040] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-03T18:59:06.566581] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:07.120567] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T18:59:07.190676] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-03T18:59:07.611060] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-03T18:59:07.923502] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T18:59:07.990726] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-03T18:59:08.790681] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-03T18:59:09.590725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-03T18:59:09.643503] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T18:59:10.191307] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T18:59:10.230442] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T18:59:10.390702] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-03T18:59:11.190725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-03T18:59:11.606144] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T18:59:11.990715] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-03T18:59:12.135050] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T18:59:12.790725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-03T18:59:13.143856] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T18:59:13.343973] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T18:59:13.590729] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-03T18:59:14.390717] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-03T18:59:14.750188] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-03T18:59:15.157039] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:59:15.190676] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-03T18:59:15.991847] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-03T18:59:16.790727] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-03T18:59:17.033931] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T18:59:17.117262] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T18:59:17.227952] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T18:59:17.590722] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-03T18:59:18.390727] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-03T18:59:19.124967] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T18:59:19.190675] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-03T18:59:19.957629] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T18:59:19.990624] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-03T18:59:20.775767] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T18:59:20.790617] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-03T18:59:21.590692] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-03T18:59:21.836889] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T18:59:22.129558] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T18:59:22.390750] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-03T18:59:23.142847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T18:59:23.190697] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-03T18:59:23.990668] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-03T18:59:24.241002] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T18:59:24.301936] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T18:59:24.340351] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-03T18:59:24.790759] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-03T18:59:25.590720] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-03T18:59:26.031703] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-03T18:59:26.390726] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-03T18:59:26.498421] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T18:59:27.190688] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-03T18:59:27.828724] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T18:59:27.990683] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-03T18:59:28.790633] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-03T18:59:28.868256] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T18:59:29.170963] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T18:59:29.204248] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T18:59:29.204949] [INFO ] [REMOTE ] FMY: Full fetch complete (1968 records). [2025-10-03T18:59:29.205020] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-03T18:59:29.604377] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-03T18:59:29.613970] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-03T18:59:29.614039] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-03T18:59:29.614152] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-03T18:59:29.614197] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-03T18:59:29.614899] [DEBUG] [LOCAL ] FMY: Trimmed 1968 records to 1401 (keeping 200 days of data) [2025-10-03T18:59:29.625329] [DEBUG] [LOCAL ] FMY: Primary data saved (1401 records). [2025-10-03T18:59:29.625446] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-03T18:59:29.625555] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMY took 35.9s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-10-03T18:59:29.817635] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:29.881011] [DEBUG] [LOCAL ] FND: Loaded 52478 existing records from primary storage. [2025-10-03T18:59:29.881386] [INFO ] [MAIN ] FND: Loaded 52478 existing records. [2025-10-03T18:59:30.069277] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:30.069510] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-03T18:59:30.069561] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-03T18:59:30.071093] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-03T18:59:30.071157] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-03T18:59:30.404902] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-03T18:59:30.449016] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:30.992081] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T18:59:30.995142] [INFO ] [REMOTE ] FMX: Full fetch complete (57818 records). [2025-10-03T18:59:30.995236] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-03T18:59:31.199321] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-03T18:59:31.406252] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-03T18:59:31.406336] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-03T18:59:31.407067] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-03T18:59:31.407132] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-03T18:59:31.408498] [DEBUG] [LOCAL ] FMX: Trimmed 57818 records to 41194 (keeping 200 days of data) [2025-10-03T18:59:31.675378] [DEBUG] [LOCAL ] FMX: Primary data saved (41194 records). [2025-10-03T18:59:31.675511] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-03T18:59:31.677001] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FMX took 40.3s. Estimated remaining: 3h 31m 40s. Rate: 7.2 symbols/min [2025-10-03T18:59:31.898312] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:31.922012] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T18:59:31.982591] [DEBUG] [LOCAL ] FNF: Loaded 49364 existing records from primary storage. [2025-10-03T18:59:31.982949] [INFO ] [MAIN ] FNF: Loaded 49364 existing records. [2025-10-03T18:59:31.990668] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-03T18:59:32.176337] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:32.176637] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-03T18:59:32.176725] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-03T18:59:32.178170] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-03T18:59:32.178232] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-03T18:59:32.569562] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:32.790734] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-03T18:59:32.993792] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T18:59:33.274633] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T18:59:33.276449] [INFO ] [REMOTE ] FN: Full fetch complete (56283 records). [2025-10-03T18:59:33.276553] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-03T18:59:33.595839] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-03T18:59:33.702731] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-03T18:59:33.702852] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-03T18:59:33.704130] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-03T18:59:33.704208] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-03T18:59:33.705991] [DEBUG] [LOCAL ] FN: Trimmed 56283 records to 39003 (keeping 200 days of data) [2025-10-03T18:59:33.952056] [DEBUG] [LOCAL ] FN: Primary data saved (39003 records). [2025-10-03T18:59:33.952212] [INFO ] [MAIN ] FN: Full history saved. [2025-10-03T18:59:33.952298] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FN took 30.0s. Estimated remaining: 3h 31m 20s. Rate: 7.2 symbols/min [2025-10-03T18:59:34.134446] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:34.181576] [DEBUG] [LOCAL ] FNV: Loaded 46489 existing records from primary storage. [2025-10-03T18:59:34.181934] [INFO ] [MAIN ] FNV: Loaded 46489 existing records. [2025-10-03T18:59:34.377684] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:34.378019] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-03T18:59:34.378158] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-03T18:59:34.388210] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-03T18:59:34.394247] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-03T18:59:34.394088] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-03T18:59:34.471829] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T18:59:34.814246] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:35.190693] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-03T18:59:35.351585] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T18:59:35.990671] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-03T18:59:36.075034] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T18:59:36.739585] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T18:59:36.790629] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-03T18:59:37.591524] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-03T18:59:37.591433] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T18:59:38.390710] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-03T18:59:38.490256] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T18:59:39.167080] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T18:59:39.190678] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-03T18:59:39.990695] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-03T18:59:40.178986] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T18:59:40.800124] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-03T18:59:40.826799] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T18:59:41.550745] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T18:59:41.590611] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-03T18:59:42.390679] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-03T18:59:42.488110] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T18:59:43.116969] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T18:59:43.190628] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-03T18:59:43.990677] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-03T18:59:44.183960] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T18:59:44.790723] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-03T18:59:44.934031] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T18:59:45.420885] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T18:59:45.590735] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-03T18:59:46.353175] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T18:59:46.390739] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-03T18:59:47.123554] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T18:59:47.126329] [INFO ] [REMOTE ] FNB: Full fetch complete (75870 records). [2025-10-03T18:59:47.126491] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-03T18:59:47.201721] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-03T18:59:47.556334] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-03T18:59:47.556426] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-03T18:59:47.557387] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-03T18:59:47.557458] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-03T18:59:47.559144] [DEBUG] [LOCAL ] FNB: Trimmed 75870 records to 53238 (keeping 200 days of data) [2025-10-03T18:59:47.900124] [DEBUG] [LOCAL ] FNB: Primary data saved (53238 records). [2025-10-03T18:59:47.900278] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-03T18:59:47.900681] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FNB took 42.2s. Estimated remaining: 3h 31m 22s. Rate: 7.2 symbols/min [2025-10-03T18:59:47.998118] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-03T18:59:48.090026] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T18:59:48.125732] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T18:59:48.141766] [DEBUG] [LOCAL ] FOA: Loaded 13189 existing records from primary storage. [2025-10-03T18:59:48.142114] [INFO ] [MAIN ] FOA: Loaded 13189 existing records. [2025-10-03T18:59:48.331741] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T18:59:48.331980] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-03T18:59:48.332038] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-03T18:59:48.332597] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-03T18:59:48.332705] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-03T18:59:48.711517] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T18:59:48.790634] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-03T18:59:49.556990] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-03T18:59:49.590707] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-03T18:59:49.844147] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T18:59:49.890440] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T18:59:50.390706] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-03T18:59:51.117037] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T18:59:51.190690] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-03T18:59:51.543215] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T18:59:51.990717] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-03T18:59:52.790631] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-03T18:59:52.912705] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T18:59:52.973721] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T18:59:53.590705] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-03T18:59:54.171052] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T18:59:54.390732] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-03T18:59:55.193219] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-03T18:59:55.200700] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T18:59:55.719256] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T18:59:55.990755] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-03T18:59:56.790701] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-03T18:59:56.865625] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T18:59:57.590722] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-03T18:59:57.683895] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T18:59:58.390633] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-03T18:59:58.491701] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T18:59:58.672248] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T18:59:59.190708] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-03T18:59:59.961636] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T18:59:59.990637] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-03T19:00:00.790635] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-03T19:00:00.878177] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:00:01.420886] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:00:01.423858] [INFO ] [REMOTE ] FNF: Full fetch complete (69673 records). [2025-10-03T19:00:01.424049] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-03T19:00:01.600948] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-03T19:00:01.990728] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-03T19:00:01.990956] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-03T19:00:01.992458] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-03T19:00:01.992636] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-03T19:00:01.994790] [DEBUG] [LOCAL ] FNF: Trimmed 69673 records to 49705 (keeping 200 days of data) [2025-10-03T19:00:02.126525] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:00:02.363232] [DEBUG] [LOCAL ] FNF: Primary data saved (49705 records). [2025-10-03T19:00:02.363438] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-03T19:00:02.364183] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FNF took 30.7s. Estimated remaining: 3h 31m 24s. Rate: 7.2 symbols/min [2025-10-03T19:00:02.395905] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-03T19:00:02.565791] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:02.578614] [DEBUG] [LOCAL ] FOF: Loaded 8487 existing records from primary storage. [2025-10-03T19:00:02.578882] [INFO ] [MAIN ] FOF: Loaded 8487 existing records. [2025-10-03T19:00:02.781797] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:02.781998] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-03T19:00:02.782048] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-03T19:00:02.782457] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-03T19:00:02.782518] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-03T19:00:03.178534] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:03.190609] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-03T19:00:03.412629] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:00:03.990669] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-03T19:00:04.028169] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:00:04.280776] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-03T19:00:04.790748] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-03T19:00:05.515166] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:00:05.517574] [INFO ] [REMOTE ] FNV: Full fetch complete (66339 records). [2025-10-03T19:00:05.517757] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-03T19:00:05.595929] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-03T19:00:05.952405] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-03T19:00:05.952508] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-03T19:00:05.953357] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-03T19:00:05.953474] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-03T19:00:05.955389] [DEBUG] [LOCAL ] FNV: Trimmed 66339 records to 46785 (keeping 200 days of data) [2025-10-03T19:00:06.262968] [DEBUG] [LOCAL ] FNV: Primary data saved (46785 records). [2025-10-03T19:00:06.263110] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-03T19:00:06.263214] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FNV took 32.3s. Estimated remaining: 3h 31m 8s. Rate: 7.2 symbols/min [2025-10-03T19:00:06.393677] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-03T19:00:06.467838] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:06.490254] [DEBUG] [LOCAL ] FOR: Loaded 19927 existing records from primary storage. [2025-10-03T19:00:06.490538] [INFO ] [MAIN ] FOR: Loaded 19927 existing records. [2025-10-03T19:00:06.626304] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T19:00:06.721056] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:06.721347] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-03T19:00:06.721541] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-03T19:00:06.737619] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-03T19:00:06.759178] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-03T19:00:06.838916] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T19:00:07.168095] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:07.190638] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-03T19:00:07.221491] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:00:07.958945] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:00:07.990711] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-03T19:00:08.790686] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-03T19:00:09.049509] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T19:00:09.590743] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-03T19:00:10.171545] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:00:10.174226] [INFO ] [REMOTE ] FND: Full fetch complete (74640 records). [2025-10-03T19:00:10.174357] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-03T19:00:10.398515] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-03T19:00:10.605075] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-03T19:00:10.605162] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-03T19:00:10.606121] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-03T19:00:10.606207] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-03T19:00:10.607785] [DEBUG] [LOCAL ] FND: Trimmed 74640 records to 52854 (keeping 200 days of data) [2025-10-03T19:00:10.925613] [DEBUG] [LOCAL ] FND: Primary data saved (52854 records). [2025-10-03T19:00:10.925852] [INFO ] [MAIN ] FND: Full history saved. [2025-10-03T19:00:10.926038] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FND took 41.3s. Estimated remaining: 3h 30m 53s. Rate: 7.2 symbols/min [2025-10-03T19:00:11.114092] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T19:00:11.147561] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:11.195115] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-03T19:00:11.197058] [DEBUG] [LOCAL ] FOUR: Loaded 49921 existing records from primary storage. [2025-10-03T19:00:11.197416] [INFO ] [MAIN ] FOUR: Loaded 49921 existing records. [2025-10-03T19:00:11.366059] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-03T19:00:11.426856] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:11.427090] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-03T19:00:11.427141] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-03T19:00:11.428493] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-03T19:00:11.428556] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-03T19:00:11.832028] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:11.990699] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-03T19:00:12.377909] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T19:00:12.790694] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-03T19:00:12.935942] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:00:13.590729] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-03T19:00:14.061322] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:00:14.390734] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-03T19:00:15.190663] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-03T19:00:15.270614] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:00:15.717277] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:00:15.912938] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:00:15.990710] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-03T19:00:16.789451] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:00:16.792460] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-03T19:00:17.590742] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-03T19:00:17.903847] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:00:18.390738] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-03T19:00:18.904393] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-03T19:00:19.190623] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-03T19:00:19.275957] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:00:19.990701] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-03T19:00:20.183434] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:00:20.790682] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-03T19:00:21.590696] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-03T19:00:21.796178] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:00:21.828503] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:00:22.390632] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-03T19:00:22.544740] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:00:22.825306] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T19:00:23.190699] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-03T19:00:23.990700] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-03T19:00:24.773010] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:00:24.774581] [INFO ] [REMOTE ] FOA: Full fetch complete (22315 records). [2025-10-03T19:00:24.774783] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-03T19:00:24.798707] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-03T19:00:25.137557] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:00:25.230843] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-03T19:00:25.230936] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-03T19:00:25.231379] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-03T19:00:25.231422] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-03T19:00:25.232044] [DEBUG] [LOCAL ] FOA: Trimmed 22315 records to 13268 (keeping 200 days of data) [2025-10-03T19:00:25.311975] [DEBUG] [LOCAL ] FOA: Primary data saved (13268 records). [2025-10-03T19:00:25.312152] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-03T19:00:25.312268] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FOA took 37.4s. Estimated remaining: 3h 30m 55s. Rate: 7.2 symbols/min [2025-10-03T19:00:25.500336] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:25.520335] [DEBUG] [LOCAL ] FPF: Loaded 18405 existing records from primary storage. [2025-10-03T19:00:25.520622] [INFO ] [MAIN ] FPF: Loaded 18405 existing records. [2025-10-03T19:00:25.595831] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-03T19:00:25.721572] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:25.721929] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-03T19:00:25.722047] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-03T19:00:25.723339] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-03T19:00:25.723403] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-03T19:00:26.001989] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T19:00:26.131626] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:26.390721] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-03T19:00:27.190636] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-03T19:00:27.379079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:00:27.562686] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:00:27.990697] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-03T19:00:28.174941] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:00:28.790731] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-03T19:00:28.968148] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:00:29.590714] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-03T19:00:30.310258] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:00:30.390694] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-03T19:00:30.561497] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:00:31.188879] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-03T19:00:31.190249] [INFO ] [REMOTE ] FOR: Full fetch complete (29877 records). [2025-10-03T19:00:31.190334] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-03T19:00:31.195855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-03T19:00:31.589672] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-03T19:00:31.589807] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-03T19:00:31.590840] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-03T19:00:31.590926] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-03T19:00:31.592242] [DEBUG] [LOCAL ] FOR: Trimmed 29877 records to 20020 (keeping 200 days of data) [2025-10-03T19:00:31.725213] [DEBUG] [LOCAL ] FOR: Primary data saved (20020 records). [2025-10-03T19:00:31.725379] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-03T19:00:31.725491] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FOR took 25.5s. Estimated remaining: 3h 30m 43s. Rate: 7.2 symbols/min [2025-10-03T19:00:31.917192] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:31.937075] [DEBUG] [LOCAL ] FPH: Loaded 19546 existing records from primary storage. [2025-10-03T19:00:31.937355] [INFO ] [MAIN ] FPH: Loaded 19546 existing records. [2025-10-03T19:00:31.995877] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-03T19:00:32.136385] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:32.136662] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-03T19:00:32.136750] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-03T19:00:32.137457] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-03T19:00:32.137527] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-03T19:00:32.269787] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:00:32.555417] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:32.567189] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:00:32.790698] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-03T19:00:33.595721] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-03T19:00:33.600131] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T19:00:34.390722] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-03T19:00:35.190723] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-03T19:00:35.341524] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:00:35.429745] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T19:00:35.990735] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-03T19:00:36.358154] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:00:36.790709] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-03T19:00:36.810607] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:00:37.590746] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-03T19:00:37.826684] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-03T19:00:38.390759] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-03T19:00:39.194705] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-03T19:00:39.205494] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:00:39.382761] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:00:39.890546] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:00:39.891474] [INFO ] [REMOTE ] FOF: Full fetch complete (11872 records). [2025-10-03T19:00:39.891549] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-03T19:00:39.996762] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-03T19:00:40.298720] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-03T19:00:40.298816] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-03T19:00:40.299158] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-03T19:00:40.299200] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-03T19:00:40.299854] [DEBUG] [LOCAL ] FOF: Trimmed 11872 records to 8526 (keeping 200 days of data) [2025-10-03T19:00:40.356503] [DEBUG] [LOCAL ] FOF: Primary data saved (8526 records). [2025-10-03T19:00:40.356699] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-03T19:00:40.356822] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FOF took 38.0s. Estimated remaining: 3h 30m 35s. Rate: 7.2 symbols/min [2025-10-03T19:00:40.562383] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:40.603619] [DEBUG] [LOCAL ] FPI: Loaded 31264 existing records from primary storage. [2025-10-03T19:00:40.603934] [INFO ] [MAIN ] FPI: Loaded 31264 existing records. [2025-10-03T19:00:40.798969] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:40.794270] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-03T19:00:40.800117] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-03T19:00:40.800183] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-03T19:00:40.801286] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-03T19:00:40.801355] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-03T19:00:41.216510] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:41.313228] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:00:41.590627] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-03T19:00:41.827918] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:00:42.390708] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-03T19:00:42.597857] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:00:43.190735] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-03T19:00:43.368781] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:00:43.990666] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-03T19:00:44.280495] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T19:00:44.790666] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-03T19:00:45.055442] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-03T19:00:45.590682] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-03T19:00:45.658448] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T19:00:46.390707] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-03T19:00:47.002514] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:00:47.075748] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-03T19:00:47.190677] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-03T19:00:47.990701] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-03T19:00:48.119707] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T19:00:48.121480] [INFO ] [REMOTE ] FPF: Full fetch complete (26678 records). [2025-10-03T19:00:48.121619] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-03T19:00:48.541439] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-03T19:00:48.541524] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-03T19:00:48.542085] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-03T19:00:48.542152] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-03T19:00:48.542935] [DEBUG] [LOCAL ] FPF: Trimmed 26678 records to 18584 (keeping 200 days of data) [2025-10-03T19:00:48.663964] [DEBUG] [LOCAL ] FPF: Primary data saved (18584 records). [2025-10-03T19:00:48.664104] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-03T19:00:48.664218] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPF took 23.4s. Estimated remaining: 3h 30m 27s. Rate: 7.2 symbols/min [2025-10-03T19:00:48.795762] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-03T19:00:48.854639] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:00:48.906751] [DEBUG] [LOCAL ] FR: Loaded 46743 existing records from primary storage. [2025-10-03T19:00:48.907105] [INFO ] [MAIN ] FR: Loaded 46743 existing records. [2025-10-03T19:00:49.046021] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:00:49.118540] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:00:49.118801] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-03T19:00:49.118854] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-03T19:00:49.120104] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-03T19:00:49.120167] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-03T19:00:49.503447] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:00:49.590685] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-03T19:00:50.036735] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-03T19:00:50.390704] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-03T19:00:50.582380] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:00:51.190678] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-03T19:00:51.500067] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:00:51.990676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-03T19:00:52.382394] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-03T19:00:52.790687] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-03T19:00:53.242618] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:00:53.590786] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-03T19:00:54.390708] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-03T19:00:54.656849] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:00:55.016142] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:00:55.169041] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:00:55.190623] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-03T19:00:55.990686] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-03T19:00:56.570207] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:00:56.790716] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-03T19:00:57.590710] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-03T19:00:57.773953] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T19:00:57.850984] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:00:58.390684] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-03T19:00:58.909539] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T19:00:59.190693] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-03T19:00:59.990676] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-03T19:01:00.055437] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:01:00.790689] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-03T19:01:01.042494] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:01:01.103140] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:01:01.590729] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-03T19:01:01.871442] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:01:01.874461] [INFO ] [REMOTE ] FPH: Full fetch complete (31357 records). [2025-10-03T19:01:01.874551] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-03T19:01:02.322196] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-03T19:01:02.322279] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-03T19:01:02.322866] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-03T19:01:02.322932] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-03T19:01:02.323765] [DEBUG] [LOCAL ] FPH: Trimmed 31357 records to 19674 (keeping 200 days of data) [2025-10-03T19:01:02.408130] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-03T19:01:02.443327] [DEBUG] [LOCAL ] FPH: Primary data saved (19674 records). [2025-10-03T19:01:02.443470] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-03T19:01:02.443558] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FPH took 30.7s. Estimated remaining: 3h 30m 28s. Rate: 7.2 symbols/min [2025-10-03T19:01:02.628798] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:02.644625] [DEBUG] [LOCAL ] FRA: Loaded 14628 existing records from primary storage. [2025-10-03T19:01:02.644888] [INFO ] [MAIN ] FRA: Loaded 14628 existing records. [2025-10-03T19:01:02.830858] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:02.831097] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-03T19:01:02.831154] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-03T19:01:02.831861] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-03T19:01:02.832103] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-03T19:01:03.195813] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-03T19:01:03.253873] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:03.557956] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-03T19:01:03.560838] [INFO ] [REMOTE ] FOUR: Full fetch complete (72027 records). [2025-10-03T19:01:03.561121] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-03T19:01:03.957887] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:01:03.997972] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-03T19:01:04.024008] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-03T19:01:04.025439] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-03T19:01:04.026406] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-03T19:01:04.026566] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-03T19:01:04.028013] [DEBUG] [LOCAL ] FOUR: Trimmed 72027 records to 50298 (keeping 200 days of data) [2025-10-03T19:01:04.345279] [DEBUG] [LOCAL ] FOUR: Primary data saved (50298 records). [2025-10-03T19:01:04.345436] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-03T19:01:04.345541] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FOUR took 53.4s. Estimated remaining: 3h 30m 8s. Rate: 7.2 symbols/min [2025-10-03T19:01:04.535961] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:04.556717] [DEBUG] [LOCAL ] FRGE: Loaded 17758 existing records from primary storage. [2025-10-03T19:01:04.557036] [INFO ] [MAIN ] FRGE: Loaded 17758 existing records. [2025-10-03T19:01:04.750184] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:04.750456] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-03T19:01:04.750561] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-03T19:01:04.751333] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-03T19:01:04.751395] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-03T19:01:04.794387] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-03T19:01:05.181314] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:01:05.222473] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:01:05.220415] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:05.590724] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-03T19:01:05.901222] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T19:01:06.390721] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-03T19:01:06.962445] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:01:07.190708] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-03T19:01:07.550305] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T19:01:07.990717] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-03T19:01:08.564563] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:01:08.790727] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-03T19:01:09.590724] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-03T19:01:09.734422] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:01:10.026621] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:01:10.390622] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-03T19:01:10.790093] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:01:11.190756] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-03T19:01:11.959716] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:01:11.990633] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-03T19:01:12.009019] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T19:01:12.790697] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-03T19:01:13.369330] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:01:13.590732] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-03T19:01:13.666172] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:01:13.667974] [INFO ] [REMOTE ] FPI: Full fetch complete (44314 records). [2025-10-03T19:01:13.668065] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-03T19:01:14.081902] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-03T19:01:14.081986] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-03T19:01:14.082721] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-03T19:01:14.082787] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-03T19:01:14.083867] [DEBUG] [LOCAL ] FPI: Trimmed 44314 records to 31480 (keeping 200 days of data) [2025-10-03T19:01:14.279894] [DEBUG] [LOCAL ] FPI: Primary data saved (31480 records). [2025-10-03T19:01:14.280036] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-03T19:01:14.281124] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FPI took 33.9s. Estimated remaining: 3h 30m 3s. Rate: 7.2 symbols/min [2025-10-03T19:01:14.395976] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-03T19:01:14.474336] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:14.528738] [DEBUG] [LOCAL ] FRO: Loaded 52117 existing records from primary storage. [2025-10-03T19:01:14.529064] [INFO ] [MAIN ] FRO: Loaded 52117 existing records. [2025-10-03T19:01:14.739733] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:14.740095] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-03T19:01:14.740292] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-03T19:01:14.741900] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-03T19:01:14.741964] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-03T19:01:15.191158] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:15.191319] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-03T19:01:15.193575] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:01:15.363867] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:01:15.990626] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-03T19:01:16.145891] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:01:16.790717] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-03T19:01:17.590683] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-03T19:01:17.697694] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:01:17.724133] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-03T19:01:18.390717] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-03T19:01:19.190688] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-03T19:01:19.473914] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T19:01:19.604428] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-03T19:01:19.990630] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-03T19:01:20.047476] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-03T19:01:20.669726] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T19:01:20.790724] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-03T19:01:21.590740] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-03T19:01:22.386754] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:01:22.399978] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-03T19:01:23.190621] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-03T19:01:23.350377] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:01:23.690735] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T19:01:23.990739] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-03T19:01:24.543400] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:01:24.790706] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-03T19:01:24.971442] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:01:25.590682] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-03T19:01:25.868232] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:01:26.390727] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-03T19:01:27.190742] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-03T19:01:27.216440] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T19:01:27.459775] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:01:27.990688] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-03T19:01:28.593464] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:01:28.596146] [INFO ] [REMOTE ] FR: Full fetch complete (66739 records). [2025-10-03T19:01:28.596288] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-03T19:01:28.811946] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-03T19:01:29.034956] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-03T19:01:29.035055] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-03T19:01:29.036022] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-03T19:01:29.036094] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-03T19:01:29.037698] [DEBUG] [LOCAL ] FR: Trimmed 66739 records to 47072 (keeping 200 days of data) [2025-10-03T19:01:29.341880] [DEBUG] [LOCAL ] FR: Primary data saved (47072 records). [2025-10-03T19:01:29.342031] [INFO ] [MAIN ] FR: Full history saved. [2025-10-03T19:01:29.342131] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 40.7s. Estimated remaining: 3h 30m 6s. Rate: 7.1 symbols/min [2025-10-03T19:01:29.532720] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:29.532927] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-10-03T19:01:29.532984] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-10-03T19:01:29.533107] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-03T19:01:29.533284] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-03T19:01:29.533342] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-03T19:01:29.533381] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-03T19:01:29.608239] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-03T19:01:29.927722] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T19:01:29.973028] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:30.041415] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T19:01:30.390697] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-03T19:01:30.629188] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T19:01:30.630346] [INFO ] [REMOTE ] FRGE: Full fetch complete (32274 records). [2025-10-03T19:01:30.630421] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-03T19:01:31.028016] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-03T19:01:31.028102] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-03T19:01:31.028706] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-03T19:01:31.028770] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-03T19:01:31.029486] [DEBUG] [LOCAL ] FRGE: Trimmed 32274 records to 17810 (keeping 200 days of data) [2025-10-03T19:01:31.147559] [DEBUG] [LOCAL ] FRGE: Primary data saved (17810 records). [2025-10-03T19:01:31.147806] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-03T19:01:31.147938] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRGE took 26.8s. Estimated remaining: 3h 29m 46s. Rate: 7.2 symbols/min [2025-10-03T19:01:31.195765] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-03T19:01:31.361272] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:31.408305] [DEBUG] [LOCAL ] FSCO: Loaded 37913 existing records from primary storage. [2025-10-03T19:01:31.408963] [INFO ] [MAIN ] FSCO: Loaded 37913 existing records. [2025-10-03T19:01:31.610793] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:31.611178] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-03T19:01:31.611252] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-03T19:01:31.611936] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-03T19:01:31.612011] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-03T19:01:32.005456] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-03T19:01:32.011974] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:32.035575] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:01:32.790707] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-03T19:01:32.976492] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T19:01:33.234731] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:01:33.590701] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-03T19:01:34.367407] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:01:34.390623] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-03T19:01:35.190629] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-03T19:01:35.604342] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:01:35.844027] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:01:35.861392] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T19:01:35.990673] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-03T19:01:36.790723] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-03T19:01:37.543008] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:01:37.544246] [INFO ] [REMOTE ] FRA: Full fetch complete (24005 records). [2025-10-03T19:01:37.544358] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-03T19:01:37.595772] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-03T19:01:37.952965] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T19:01:38.029394] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-03T19:01:38.029517] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-03T19:01:38.030195] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-03T19:01:38.030263] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-03T19:01:38.031019] [DEBUG] [LOCAL ] FRA: Trimmed 24005 records to 14755 (keeping 200 days of data) [2025-10-03T19:01:38.129174] [DEBUG] [LOCAL ] FRA: Primary data saved (14755 records). [2025-10-03T19:01:38.129325] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-03T19:01:38.129465] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FRA took 35.7s. Estimated remaining: 3h 29m 35s. Rate: 7.2 symbols/min [2025-10-03T19:01:38.307743] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:38.361098] [DEBUG] [LOCAL ] FSK: Loaded 49800 existing records from primary storage. [2025-10-03T19:01:38.361434] [INFO ] [MAIN ] FSK: Loaded 49800 existing records. [2025-10-03T19:01:38.395883] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-03T19:01:38.555324] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:38.556439] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-03T19:01:38.556512] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-03T19:01:38.557191] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-03T19:01:38.557250] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-03T19:01:38.927933] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:39.190767] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-03T19:01:39.765242] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T19:01:39.990680] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-03T19:01:40.065866] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T19:01:40.552580] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:01:40.790684] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-03T19:01:41.590683] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-03T19:01:41.907310] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T19:01:42.397673] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-03T19:01:42.414828] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:01:43.190712] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-03T19:01:43.313302] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:01:43.777448] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:01:43.990676] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-03T19:01:44.801609] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-03T19:01:44.808373] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:01:45.349857] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:01:45.590694] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-03T19:01:46.390749] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-03T19:01:46.480518] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:01:46.744786] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-03T19:01:47.190686] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-03T19:01:47.694206] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T19:01:47.990735] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-03T19:01:48.528752] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-03T19:01:48.790705] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-03T19:01:49.450015] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:01:49.590695] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-03T19:01:50.129520] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:01:50.390738] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-03T19:01:51.190691] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-03T19:01:51.654175] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T19:01:51.990728] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-03T19:01:52.133585] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:01:52.212099] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:01:52.790698] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-03T19:01:53.423691] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:01:53.426355] [INFO ] [REMOTE ] FRO: Full fetch complete (75219 records). [2025-10-03T19:01:53.426468] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-03T19:01:53.595564] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-03T19:01:53.894313] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-03T19:01:53.894401] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-03T19:01:53.895398] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-03T19:01:53.895467] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-03T19:01:53.897280] [DEBUG] [LOCAL ] FRO: Trimmed 75219 records to 52466 (keeping 200 days of data) [2025-10-03T19:01:54.164868] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:01:54.276281] [DEBUG] [LOCAL ] FRO: Primary data saved (52466 records). [2025-10-03T19:01:54.276433] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-03T19:01:54.277136] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRO took 40.0s. Estimated remaining: 3h 29m 40s. Rate: 7.1 symbols/min [2025-10-03T19:01:54.394331] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-03T19:01:54.476667] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:01:54.535337] [DEBUG] [LOCAL ] FSLY: Loaded 51615 existing records from primary storage. [2025-10-03T19:01:54.535742] [INFO ] [MAIN ] FSLY: Loaded 51615 existing records. [2025-10-03T19:01:54.763035] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:01:54.763282] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-03T19:01:54.763332] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-03T19:01:54.765320] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-03T19:01:54.765384] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-03T19:01:55.154491] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:01:55.190762] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-03T19:01:55.505214] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:01:55.875473] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:01:55.990713] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-03T19:01:56.790687] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-03T19:01:57.187821] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:01:57.498571] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T19:01:57.590689] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-03T19:01:58.390698] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-03T19:01:58.434492] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:01:59.161523] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T19:01:59.190639] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-03T19:01:59.990629] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-03T19:02:00.098803] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:02:00.772277] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:02:00.774910] [INFO ] [REMOTE ] FSCO: Full fetch complete (54519 records). [2025-10-03T19:02:00.775056] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-03T19:02:00.799775] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-03T19:02:01.201800] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-03T19:02:01.201893] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-03T19:02:01.202814] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-03T19:02:01.202882] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-03T19:02:01.204133] [DEBUG] [LOCAL ] FSCO: Trimmed 54519 records to 38288 (keeping 200 days of data) [2025-10-03T19:02:01.446152] [DEBUG] [LOCAL ] FSCO: Primary data saved (38288 records). [2025-10-03T19:02:01.446297] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-03T19:02:01.446432] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FSCO took 30.3s. Estimated remaining: 3h 29m 30s. Rate: 7.2 symbols/min [2025-10-03T19:02:01.603677] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-03T19:02:01.633614] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:01.696146] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:02:01.724789] [DEBUG] [LOCAL ] FSM: Loaded 53680 existing records from primary storage. [2025-10-03T19:02:01.725146] [INFO ] [MAIN ] FSM: Loaded 53680 existing records. [2025-10-03T19:02:01.918977] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:01.919214] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-03T19:02:01.919262] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-03T19:02:01.919475] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-03T19:02:01.919568] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-03T19:02:02.355998] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:02.390623] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-03T19:02:02.537634] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:02:03.190706] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-03T19:02:03.320143] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:02:03.990739] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-03T19:02:04.051953] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:02:04.767769] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:02:04.790634] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-03T19:02:05.590690] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-03T19:02:05.629209] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:02:06.390704] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-03T19:02:06.491747] [DEBUG] [REMOTE ] FRT: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-03T19:02:06.492076] [WARN ] [REMOTE ] FRT: No data returned for month 2025-10 [2025-10-03T19:02:06.492170] [FATAL] [REMOTE ] FRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:02:06.492253] [FATAL] [MAIN ] FRT: Failed to fetch primary data. [2025-10-03T19:02:06.492318] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:02:06.492390] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-03T19:02:06.492500] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-03T19:02:06.492557] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-10-03T19:02:06.492632] [DEBUG] [LOCAL ] FRT: No derivative data file found to delete. [2025-10-03T19:02:06.492749] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FRT took 37.2s. Estimated remaining: 3h 29m 15s. Rate: 7.2 symbols/min [2025-10-03T19:02:06.713903] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:06.736780] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:02:06.784900] [DEBUG] [LOCAL ] FSS: Loaded 34339 existing records from primary storage. [2025-10-03T19:02:06.785205] [INFO ] [MAIN ] FSS: Loaded 34339 existing records. [2025-10-03T19:02:06.981249] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:06.981546] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-03T19:02:06.981597] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-03T19:02:06.983201] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-03T19:02:06.983266] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-03T19:02:07.201403] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-03T19:02:07.391915] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:07.425878] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T19:02:07.990729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-03T19:02:08.790719] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-03T19:02:08.951110] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:02:09.590726] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-03T19:02:09.770875] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:02:10.390706] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-03T19:02:10.629378] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T19:02:11.121190] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T19:02:11.190720] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-03T19:02:11.990680] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-03T19:02:12.181748] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:02:12.323073] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:02:12.790736] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-03T19:02:13.590683] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-03T19:02:13.759317] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:02:14.390748] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-03T19:02:14.589211] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:02:14.634828] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:02:15.190689] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-03T19:02:15.990749] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-03T19:02:16.003093] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T19:02:16.006458] [INFO ] [REMOTE ] FSK: Full fetch complete (71586 records). [2025-10-03T19:02:16.006615] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-03T19:02:16.443754] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-03T19:02:16.443897] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-03T19:02:16.444898] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-03T19:02:16.445010] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-03T19:02:16.446636] [DEBUG] [LOCAL ] FSK: Trimmed 71586 records to 50184 (keeping 200 days of data) [2025-10-03T19:02:16.778105] [DEBUG] [LOCAL ] FSK: Primary data saved (50184 records). [2025-10-03T19:02:16.778410] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-03T19:02:16.778572] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FSK took 38.6s. Estimated remaining: 3h 29m 10s. Rate: 7.2 symbols/min [2025-10-03T19:02:16.806712] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-03T19:02:16.991504] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:17.029441] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:02:17.033085] [DEBUG] [LOCAL ] FT: Loaded 6571 existing records from primary storage. [2025-10-03T19:02:17.043482] [INFO ] [MAIN ] FT: Loaded 6571 existing records. [2025-10-03T19:02:17.244854] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:17.245138] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-03T19:02:17.245206] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-03T19:02:17.245676] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-03T19:02:17.245767] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-03T19:02:17.559905] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:02:17.592298] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-03T19:02:17.692305] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:18.390734] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-03T19:02:18.610069] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:02:19.084879] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T19:02:19.190701] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-03T19:02:19.469293] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:02:19.990729] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-03T19:02:20.737893] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:02:20.790731] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-03T19:02:21.590726] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-03T19:02:21.744559] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:02:22.390745] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-03T19:02:22.563556] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:02:23.010718] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T19:02:23.060585] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:02:23.190729] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-03T19:02:23.990740] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-03T19:02:24.563976] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:02:24.599138] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:02:24.790726] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-03T19:02:25.372427] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-03T19:02:25.590701] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-03T19:02:26.390713] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-03T19:02:27.080680] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-03T19:02:27.190707] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-03T19:02:27.605725] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:02:27.990680] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-03T19:02:28.589429] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:02:28.790733] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-03T19:02:29.592211] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-03T19:02:29.595555] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:02:29.598791] [INFO ] [REMOTE ] FSLY: Full fetch complete (74892 records). [2025-10-03T19:02:29.598931] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-03T19:02:30.037981] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-03T19:02:30.038150] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-03T19:02:30.039482] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-03T19:02:30.039553] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-03T19:02:30.041495] [DEBUG] [LOCAL ] FSLY: Trimmed 74892 records to 52001 (keeping 200 days of data) [2025-10-03T19:02:30.343723] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:02:30.390759] [DEBUG] [LOCAL ] FSLY: Primary data saved (52001 records). [2025-10-03T19:02:30.390851] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-03T19:02:30.391125] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-03T19:02:30.392615] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSLY took 36.1s. Estimated remaining: 3h 29m 11s. Rate: 7.1 symbols/min [2025-10-03T19:02:30.578201] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:30.592974] [DEBUG] [LOCAL ] FTHY: Loaded 12100 existing records from primary storage. [2025-10-03T19:02:30.593215] [INFO ] [MAIN ] FTHY: Loaded 12100 existing records. [2025-10-03T19:02:30.788537] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:30.788801] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-03T19:02:30.788853] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-03T19:02:30.789576] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-03T19:02:30.789693] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-03T19:02:31.191323] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-03T19:02:31.203020] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:31.423773] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:02:31.747269] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:02:31.981828] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:02:31.990632] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-03T19:02:32.579746] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:02:32.790696] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-03T19:02:33.590728] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-03T19:02:34.390722] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-03T19:02:34.573410] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:02:34.635380] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:02:35.190628] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-03T19:02:35.504701] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:02:35.916364] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:02:35.990711] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-03T19:02:36.790693] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-03T19:02:37.527951] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T19:02:37.590631] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-03T19:02:37.857667] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-03T19:02:38.074872] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:02:38.390691] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-03T19:02:39.190706] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-03T19:02:39.883291] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-03T19:02:39.884497] [INFO ] [REMOTE ] FT: Full fetch complete (9180 records). [2025-10-03T19:02:39.884600] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-03T19:02:39.999190] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-03T19:02:40.175709] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-03T19:02:40.234344] [INFO ] [REMOTE ] FSM: Full fetch complete (76772 records). [2025-10-03T19:02:40.253526] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-03T19:02:40.755862] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-03T19:02:40.797893] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-03T19:02:40.803217] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-03T19:02:40.835318] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-03T19:02:40.845948] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-03T19:02:40.874019] [DEBUG] [LOCAL ] FT: Trimmed 9180 records to 6616 (keeping 200 days of data) [2025-10-03T19:02:41.141304] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-03T19:02:41.141422] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-03T19:02:41.142801] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-03T19:02:41.142887] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-03T19:02:41.148768] [DEBUG] [LOCAL ] FSM: Trimmed 76772 records to 54070 (keeping 200 days of data) [2025-10-03T19:02:41.151294] [DEBUG] [LOCAL ] FT: Primary data saved (6616 records). [2025-10-03T19:02:41.151831] [INFO ] [MAIN ] FT: Full history saved. [2025-10-03T19:02:41.152021] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FT took 24.4s. Estimated remaining: 3h 29m 7s. Rate: 7.1 symbols/min [2025-10-03T19:02:41.488773] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:02:41.654981] [DEBUG] [LOCAL ] FTI: Loaded 53689 existing records from primary storage. [2025-10-03T19:02:41.656519] [INFO ] [MAIN ] FTI: Loaded 53689 existing records. [2025-10-03T19:02:41.889057] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:02:41.896318] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-03T19:02:41.896467] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-03T19:02:41.930859] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-03T19:02:41.937503] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-03T19:02:42.099924] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:02:42.128968] [INFO ] [REMOTE ] FSS: Full fetch complete (48434 records). [2025-10-03T19:02:42.138859] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-03T19:02:42.193195] [DEBUG] [LOCAL ] FSM: Primary data saved (54070 records). [2025-10-03T19:02:42.316748] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-03T19:02:42.338069] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FSM took 40.9s. Estimated remaining: 3h 28m 46s. Rate: 7.2 symbols/min [2025-10-03T19:02:42.737378] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:02:42.769512] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-03T19:02:42.913134] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-03T19:02:42.913351] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-03T19:02:42.914162] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-03T19:02:42.914234] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-03T19:02:42.915495] [DEBUG] [LOCAL ] FSS: Trimmed 48434 records to 34548 (keeping 200 days of data) [2025-10-03T19:02:43.128924] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-10-03T19:02:43.142817] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-03T19:02:43.168026] [DEBUG] [LOCAL ] FSS: Primary data saved (34548 records). [2025-10-03T19:02:43.168201] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-03T19:02:43.168299] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FSS took 36.7s. Estimated remaining: 3h 28m 25s. Rate: 7.2 symbols/min [2025-10-03T19:02:43.901575] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:02:43.904475] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-03T19:02:44.632900] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:02:44.646257] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-03T19:02:44.654026] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:02:44.790745] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-03T19:02:45.819990] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-03T19:02:45.825493] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-03T19:02:46.388308] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:02:46.400708] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-03T19:02:46.566508] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T19:02:47.190694] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-03T19:02:47.781329] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:02:47.990742] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-03T19:02:48.023157] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:02:48.790675] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-03T19:02:48.860027] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-03T19:02:49.590719] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-03T19:02:50.416956] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T19:02:50.420986] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-03T19:02:50.622051] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:02:51.190713] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-03T19:02:51.222595] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:02:51.990692] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-03T19:02:52.692187] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:02:52.693950] [INFO ] [REMOTE ] FTHY: Full fetch complete (17667 records). [2025-10-03T19:02:52.694030] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-03T19:02:53.112112] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-03T19:02:53.112285] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-03T19:02:53.112757] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-03T19:02:53.112956] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-03T19:02:53.113899] [DEBUG] [LOCAL ] FTHY: Trimmed 17667 records to 12277 (keeping 200 days of data) [2025-10-03T19:02:53.203406] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:02:53.218308] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-03T19:02:53.240728] [DEBUG] [LOCAL ] FTHY: Primary data saved (12277 records). [2025-10-03T19:02:53.240845] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-03T19:02:53.240949] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTHY took 22.8s. Estimated remaining: 3h 28m 19s. Rate: 7.2 symbols/min [2025-10-03T19:02:54.780886] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:02:54.793448] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-03T19:03:06.152555] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (11.36 seconds). [2025-10-03T19:03:06.164444] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-03T19:03:07.994933] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:03:08.007285] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-03T19:03:09.897617] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:03:09.909732] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-03T19:03:11.806591] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T19:03:11.819340] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-03T19:03:13.517316] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-03T19:03:13.520715] [INFO ] [REMOTE ] FTI: Full fetch complete (77136 records). [2025-10-03T19:03:13.520892] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-03T19:03:14.022168] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-03T19:03:14.022262] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-03T19:03:14.023271] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-03T19:03:14.023351] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-03T19:03:14.024989] [DEBUG] [LOCAL ] FTI: Trimmed 77136 records to 54076 (keeping 200 days of data) [2025-10-03T19:03:14.368247] [DEBUG] [LOCAL ] FTI: Primary data saved (54076 records). [2025-10-03T19:03:14.368432] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-03T19:03:14.368541] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 33.2s. Estimated remaining: 3h 28m 32s. Rate: 7.1 symbols/min [2025-10-03T19:03:15.020053] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.083407] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.087947] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.148276] [DEBUG] [LOCAL ] FTWO: Loaded 1836 existing records from primary storage. [2025-10-03T19:03:15.153883] [INFO ] [MAIN ] FTWO: Loaded 1836 existing records. [2025-10-03T19:03:15.176549] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:15.410708] [DEBUG] [LOCAL ] FTK: Loaded 32441 existing records from primary storage. [2025-10-03T19:03:15.430099] [DEBUG] [LOCAL ] FTS: Loaded 42461 existing records from primary storage. [2025-10-03T19:03:15.434335] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:15.434950] [INFO ] [MAIN ] FTS: Loaded 42461 existing records. [2025-10-03T19:03:15.449943] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-03T19:03:15.449695] [INFO ] [MAIN ] FTK: Loaded 32441 existing records. [2025-10-03T19:03:15.455380] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-03T19:03:15.535570] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-03T19:03:15.606032] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-03T19:03:15.728394] [DEBUG] [LOCAL ] FTV: Loaded 53318 existing records from primary storage. [2025-10-03T19:03:15.750989] [INFO ] [MAIN ] FTV: Loaded 53318 existing records. [2025-10-03T19:03:16.054458] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.096325] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.096138] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.122672] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.112257] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-03T19:03:16.159234] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-03T19:03:16.153778] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-03T19:03:16.191637] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-03T19:03:16.191234] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-03T19:03:16.217599] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-03T19:03:16.510472] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:16.586730] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-03T19:03:16.596910] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-03T19:03:16.616870] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-03T19:03:16.622209] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-03T19:03:17.117951] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.301792] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-03T19:03:17.689243] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.721933] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-03T19:03:17.729351] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.747100] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-03T19:03:17.825991] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:17.826342] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-03T19:03:18.361837] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-03T19:03:18.363482] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-03T19:03:18.630900] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T19:03:18.636679] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-03T19:03:18.702263] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:03:18.704032] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-03T19:03:19.338032] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:03:19.347731] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-03T19:03:19.456265] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:03:19.458399] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-03T19:03:19.504631] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:03:19.517261] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-03T19:03:19.537040] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T19:03:19.545303] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-03T19:03:19.817927] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T19:03:19.819280] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-03T19:03:20.274505] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:03:20.275761] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-03T19:03:20.366924] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:03:20.376000] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-03T19:03:20.548008] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:03:20.555524] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-03T19:03:21.434692] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:03:21.435946] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-03T19:03:21.774326] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-03T19:03:21.781954] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-03T19:03:22.050398] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:03:22.059338] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-03T19:03:22.212159] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:03:22.213558] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-03T19:03:22.581542] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (3.06 seconds). [2025-10-03T19:03:22.593584] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-03T19:03:22.630374] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:03:22.635859] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-03T19:03:22.646083] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T19:03:22.647416] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-03T19:03:23.094799] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:03:23.096117] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-03T19:03:23.612677] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-03T19:03:23.614349] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-03T19:03:23.651893] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:03:23.665510] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-03T19:03:24.120181] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:03:24.121323] [INFO ] [REMOTE ] FTWO: Full fetch complete (3341 records). [2025-10-03T19:03:24.121440] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-03T19:03:24.247472] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:03:24.313341] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-03T19:03:24.593632] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-03T19:03:24.627987] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-03T19:03:24.655498] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-03T19:03:24.655582] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-03T19:03:24.655763] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-03T19:03:24.655828] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-03T19:03:24.656211] [DEBUG] [LOCAL ] FTWO: Trimmed 3341 records to 1873 (keeping 200 days of data) [2025-10-03T19:03:24.669472] [DEBUG] [LOCAL ] FTWO: Primary data saved (1873 records). [2025-10-03T19:03:24.669565] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-03T19:03:24.669693] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 10.3s. Estimated remaining: 3h 28m 27s. Rate: 7.1 symbols/min [2025-10-03T19:03:24.854588] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:24.917751] [DEBUG] [LOCAL ] FUBO: Loaded 54087 existing records from primary storage. [2025-10-03T19:03:24.918148] [INFO ] [MAIN ] FUBO: Loaded 54087 existing records. [2025-10-03T19:03:25.134337] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:25.134637] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-03T19:03:25.134823] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-03T19:03:25.135915] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-03T19:03:25.135978] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-03T19:03:25.601019] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:25.601852] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-03T19:03:25.606981] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T19:03:25.622048] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-03T19:03:25.724134] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:03:25.733973] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-03T19:03:26.359184] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:03:26.370861] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-03T19:03:27.050017] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T19:03:27.059894] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-03T19:03:27.134850] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:03:27.144789] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-03T19:03:27.528201] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-03T19:03:27.540474] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-03T19:03:27.686716] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T19:03:27.698517] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-03T19:03:28.221725] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:03:28.231192] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-03T19:03:28.635324] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-03T19:03:28.643539] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-03T19:03:29.175718] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:03:29.188132] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-03T19:03:29.804041] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-10-03T19:03:29.817283] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-03T19:03:29.849407] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:03:29.860779] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-03T19:03:29.896203] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T19:03:29.904590] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-03T19:03:30.528248] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-03T19:03:30.540119] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-03T19:03:31.081585] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:03:31.083698] [INFO ] [REMOTE ] FTK: Full fetch complete (43230 records). [2025-10-03T19:03:31.083810] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-03T19:03:31.538829] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T19:03:31.551234] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-03T19:03:31.551515] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-03T19:03:31.552376] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-03T19:03:31.552514] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-03T19:03:31.552994] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-03T19:03:31.555264] [DEBUG] [LOCAL ] FTK: Trimmed 43230 records to 32705 (keeping 200 days of data) [2025-10-03T19:03:31.760402] [DEBUG] [LOCAL ] FTK: Primary data saved (32705 records). [2025-10-03T19:03:31.760551] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-03T19:03:31.760692] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTK took 17.4s. Estimated remaining: 3h 28m 17s. Rate: 7.1 symbols/min [2025-10-03T19:03:31.973780] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:32.025275] [DEBUG] [LOCAL ] FUL: Loaded 33213 existing records from primary storage. [2025-10-03T19:03:32.025571] [INFO ] [MAIN ] FUL: Loaded 33213 existing records. [2025-10-03T19:03:32.226863] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:32.227699] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-03T19:03:32.227931] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-03T19:03:32.228631] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-03T19:03:32.228774] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-03T19:03:32.404897] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-10-03T19:03:32.462218] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-03T19:03:32.790873] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-03T19:03:32.855451] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-03T19:03:32.990076] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:33.032411] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-03T19:03:33.590728] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-03T19:03:34.390675] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-03T19:03:34.754963] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T19:03:34.772617] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-03T19:03:34.800852] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:03:35.190727] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-03T19:03:35.607171] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:03:35.610153] [INFO ] [REMOTE ] FTS: Full fetch complete (60211 records). [2025-10-03T19:03:35.610268] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-03T19:03:36.002573] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-03T19:03:36.048454] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-03T19:03:36.048563] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-03T19:03:36.049493] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-03T19:03:36.049559] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-03T19:03:36.052218] [DEBUG] [LOCAL ] FTS: Trimmed 60211 records to 42797 (keeping 200 days of data) [2025-10-03T19:03:36.331553] [DEBUG] [LOCAL ] FTS: Primary data saved (42797 records). [2025-10-03T19:03:36.331725] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-03T19:03:36.331828] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FTS took 22.0s. Estimated remaining: 3h 28m 2s. Rate: 7.1 symbols/min [2025-10-03T19:03:36.542181] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:36.571454] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:03:36.644880] [DEBUG] [LOCAL ] FUN: Loaded 51989 existing records from primary storage. [2025-10-03T19:03:36.645296] [INFO ] [MAIN ] FUN: Loaded 51989 existing records. [2025-10-03T19:03:36.804544] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-03T19:03:36.852385] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:36.852746] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-03T19:03:36.852991] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-03T19:03:36.853432] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-03T19:03:36.853492] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-03T19:03:37.259096] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:37.590720] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-03T19:03:38.174169] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T19:03:38.390683] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-03T19:03:38.613408] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:03:39.190679] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-03T19:03:39.459895] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:03:39.990725] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-03T19:03:40.700745] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-03T19:03:40.790704] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-03T19:03:41.354111] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-03T19:03:41.357169] [INFO ] [REMOTE ] FTV: Full fetch complete (76349 records). [2025-10-03T19:03:41.357346] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-03T19:03:41.595623] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-03T19:03:41.854843] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-03T19:03:41.855009] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-03T19:03:41.856090] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-03T19:03:41.856217] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-03T19:03:41.858632] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-03T19:03:41.869512] [DEBUG] [LOCAL ] FTV: Trimmed 76349 records to 53708 (keeping 200 days of data) [2025-10-03T19:03:42.232630] [DEBUG] [LOCAL ] FTV: Primary data saved (53708 records). [2025-10-03T19:03:42.232998] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-03T19:03:42.233966] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 27.9s. Estimated remaining: 3h 27m 49s. Rate: 7.2 symbols/min [2025-10-03T19:03:42.401026] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-03T19:03:42.432178] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:42.461437] [DEBUG] [LOCAL ] FVR: Loaded 21880 existing records from primary storage. [2025-10-03T19:03:42.461728] [INFO ] [MAIN ] FVR: Loaded 21880 existing records. [2025-10-03T19:03:42.671814] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:42.672117] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-03T19:03:42.672229] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-03T19:03:42.673139] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-03T19:03:42.673396] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-03T19:03:42.973766] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-03T19:03:43.148486] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:03:43.155011] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:43.190664] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-03T19:03:43.990684] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-03T19:03:44.078945] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:03:44.676817] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:03:44.790699] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-03T19:03:45.188598] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:03:45.590713] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-03T19:03:46.390688] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-03T19:03:46.872549] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T19:03:47.190677] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-03T19:03:47.280934] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:03:47.771600] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:03:47.990711] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-03T19:03:48.790681] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-03T19:03:49.160825] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T19:03:49.602540] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-03T19:03:49.608794] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:03:49.741330] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:03:50.390759] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-03T19:03:50.757690] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:03:51.190703] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-03T19:03:51.335707] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:03:51.990735] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-03T19:03:52.790760] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-03T19:03:53.378128] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T19:03:53.590695] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-03T19:03:53.701620] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:03:54.152069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:03:54.390715] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-03T19:03:55.190672] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-03T19:03:55.500902] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:03:55.589613] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T19:03:55.592960] [INFO ] [REMOTE ] FUBO: Full fetch complete (77768 records). [2025-10-03T19:03:55.593132] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-03T19:03:55.995879] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-03T19:03:56.092355] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-03T19:03:56.092469] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-03T19:03:56.093749] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-03T19:03:56.093830] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-03T19:03:56.095723] [DEBUG] [LOCAL ] FUBO: Trimmed 77768 records to 54477 (keeping 200 days of data) [2025-10-03T19:03:56.453163] [DEBUG] [LOCAL ] FUBO: Primary data saved (54477 records). [2025-10-03T19:03:56.453350] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-03T19:03:56.453449] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUBO took 31.8s. Estimated remaining: 3h 27m 50s. Rate: 7.1 symbols/min [2025-10-03T19:03:56.666929] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:03:56.709813] [DEBUG] [LOCAL ] FVRR: Loaded 40323 existing records from primary storage. [2025-10-03T19:03:56.710137] [INFO ] [MAIN ] FVRR: Loaded 40323 existing records. [2025-10-03T19:03:56.793797] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-03T19:03:56.916161] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:03:56.916607] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-03T19:03:56.916783] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-03T19:03:56.928713] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-03T19:03:56.946167] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-03T19:03:57.011886] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:03:57.374484] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:03:57.547423] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:03:57.590628] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-03T19:03:57.851921] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:03:58.390748] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-03T19:03:58.810418] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T19:03:59.074981] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-03T19:03:59.190694] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-03T19:03:59.990710] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-03T19:04:00.790671] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-03T19:04:00.989915] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:04:01.126075] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-03T19:04:01.590687] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-03T19:04:02.378091] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:04:02.391038] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-03T19:04:03.190735] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-03T19:04:03.379204] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:04:03.820851] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:04:03.917193] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:04:03.990721] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-03T19:04:04.790720] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-03T19:04:05.089899] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:04:05.590709] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-03T19:04:06.266430] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T19:04:06.390678] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-03T19:04:06.476535] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:04:07.088595] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-03T19:04:07.090160] [INFO ] [REMOTE ] FVR: Full fetch complete (30227 records). [2025-10-03T19:04:07.090241] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-03T19:04:07.195883] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-03T19:04:07.510198] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-03T19:04:07.510285] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-03T19:04:07.510891] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-03T19:04:07.510955] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-03T19:04:07.511842] [DEBUG] [LOCAL ] FVR: Trimmed 30227 records to 21967 (keeping 200 days of data) [2025-10-03T19:04:07.649999] [DEBUG] [LOCAL ] FVR: Primary data saved (21967 records). [2025-10-03T19:04:07.650128] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-03T19:04:07.650212] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FVR took 25.4s. Estimated remaining: 3h 27m 47s. Rate: 7.1 symbols/min [2025-10-03T19:04:07.849718] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:07.853403] [DEBUG] [LOCAL ] FXED: Loaded 1253 existing records from primary storage. [2025-10-03T19:04:07.853538] [INFO ] [MAIN ] FXED: Loaded 1253 existing records. [2025-10-03T19:04:08.004633] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-03T19:04:08.050975] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:08.051235] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-03T19:04:08.051289] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-03T19:04:08.051592] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-03T19:04:08.051678] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-03T19:04:08.444071] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:08.790673] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-03T19:04:09.077375] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T19:04:09.367969] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:04:09.369996] [INFO ] [REMOTE ] FUL: Full fetch complete (47714 records). [2025-10-03T19:04:09.370115] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-03T19:04:09.599432] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-03T19:04:09.832591] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-03T19:04:09.832716] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-03T19:04:09.833456] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-03T19:04:09.833523] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-03T19:04:09.834909] [DEBUG] [LOCAL ] FUL: Trimmed 47714 records to 33460 (keeping 200 days of data) [2025-10-03T19:04:10.054603] [DEBUG] [LOCAL ] FUL: Primary data saved (33460 records). [2025-10-03T19:04:10.054783] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-03T19:04:10.054927] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FUL took 38.3s. Estimated remaining: 3h 27m 28s. Rate: 7.1 symbols/min [2025-10-03T19:04:10.240176] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:10.266814] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:04:10.321241] [DEBUG] [LOCAL ] G: Loaded 50210 existing records from primary storage. [2025-10-03T19:04:10.321693] [INFO ] [MAIN ] G: Loaded 50210 existing records. [2025-10-03T19:04:10.396949] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-03T19:04:10.537967] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:10.538210] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-03T19:04:10.538266] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-03T19:04:10.541218] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-03T19:04:10.541290] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-03T19:04:10.967226] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:11.079149] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T19:04:11.082119] [INFO ] [REMOTE ] FUN: Full fetch complete (72918 records). [2025-10-03T19:04:11.082237] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-03T19:04:11.195856] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-03T19:04:11.549320] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-03T19:04:11.549592] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-03T19:04:11.550611] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-03T19:04:11.550704] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-03T19:04:11.552420] [DEBUG] [LOCAL ] FUN: Trimmed 72918 records to 52377 (keeping 200 days of data) [2025-10-03T19:04:11.877546] [DEBUG] [LOCAL ] FUN: Primary data saved (52377 records). [2025-10-03T19:04:11.877716] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-03T19:04:11.877815] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FUN took 35.5s. Estimated remaining: 3h 27m 9s. Rate: 7.2 symbols/min [2025-10-03T19:04:11.997864] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-03T19:04:12.083114] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:12.110480] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:04:12.145292] [DEBUG] [LOCAL ] GAB: Loaded 28112 existing records from primary storage. [2025-10-03T19:04:12.145579] [INFO ] [MAIN ] GAB: Loaded 28112 existing records. [2025-10-03T19:04:12.351867] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:12.352153] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-03T19:04:12.352235] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-03T19:04:12.352737] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-03T19:04:12.352798] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-03T19:04:12.451054] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T19:04:12.800191] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-03T19:04:12.807760] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:12.833799] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:04:13.590697] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-03T19:04:14.269769] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:04:14.390735] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-03T19:04:15.024616] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:04:15.190723] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-03T19:04:15.606558] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:04:15.990681] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-03T19:04:16.081104] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-03T19:04:16.790639] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-03T19:04:17.037883] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:04:17.180663] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T19:04:17.590735] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-03T19:04:18.011543] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-03T19:04:18.390633] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-03T19:04:19.190730] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-03T19:04:19.606283] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T19:04:19.776100] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:04:19.990676] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-03T19:04:20.271440] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-03T19:04:20.790698] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-03T19:04:21.175972] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-03T19:04:21.590697] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-03T19:04:22.390708] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-03T19:04:23.195780] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-03T19:04:23.219107] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:04:23.270758] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:04:23.990731] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-03T19:04:24.644291] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:04:24.790710] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-03T19:04:25.590745] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-03T19:04:25.646116] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:04:26.033987] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:04:26.390737] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-03T19:04:26.492493] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:04:26.826264] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:04:27.190692] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-03T19:04:27.990712] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-03T19:04:28.541828] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T19:04:28.587813] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T19:04:28.790699] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-03T19:04:29.590709] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-03T19:04:30.210821] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:04:30.390692] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-03T19:04:31.190719] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-03T19:04:31.340833] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T19:04:31.574200] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-03T19:04:31.574955] [INFO ] [REMOTE ] FXED: Full fetch complete (1802 records). [2025-10-03T19:04:31.575060] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-03T19:04:31.969302] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-03T19:04:31.969436] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-03T19:04:31.969895] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-03T19:04:31.970132] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-03T19:04:31.970792] [DEBUG] [LOCAL ] FXED: Trimmed 1802 records to 1259 (keeping 200 days of data) [2025-10-03T19:04:31.980232] [DEBUG] [LOCAL ] FXED: Primary data saved (1259 records). [2025-10-03T19:04:31.994285] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-03T19:04:31.988527] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-03T19:04:32.005556] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 24.4s. Estimated remaining: 3h 27m 20s. Rate: 7.1 symbols/min [2025-10-03T19:04:32.007154] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:04:32.208453] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:32.216243] [DEBUG] [LOCAL ] GAM: Loaded 4081 existing records from primary storage. [2025-10-03T19:04:32.216413] [INFO ] [MAIN ] GAM: Loaded 4081 existing records. [2025-10-03T19:04:32.409846] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:32.410094] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-03T19:04:32.410156] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-03T19:04:32.410368] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-03T19:04:32.410428] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-03T19:04:32.803280] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-03T19:04:32.809431] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:33.590720] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-03T19:04:33.793991] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:04:34.002672] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:04:34.347498] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:04:34.390701] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-03T19:04:35.057279] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-03T19:04:35.190697] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-03T19:04:35.990684] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-03T19:04:36.343047] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T19:04:36.345469] [INFO ] [REMOTE ] FVRR: Full fetch complete (59069 records). [2025-10-03T19:04:36.345563] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-03T19:04:36.796872] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-03T19:04:36.797820] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-03T19:04:36.798956] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-03T19:04:36.799881] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-03T19:04:36.800051] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-03T19:04:36.801499] [DEBUG] [LOCAL ] FVRR: Trimmed 59069 records to 40657 (keeping 200 days of data) [2025-10-03T19:04:37.031044] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:04:37.078539] [DEBUG] [LOCAL ] FVRR: Primary data saved (40657 records). [2025-10-03T19:04:37.078698] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-03T19:04:37.078818] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. FVRR took 40.6s. Estimated remaining: 3h 27m 6s. Rate: 7.1 symbols/min [2025-10-03T19:04:37.263344] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:37.318857] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-10-03T19:04:37.319196] [INFO ] [MAIN ] GAP: Loaded 54045 existing records. [2025-10-03T19:04:37.514301] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:37.519387] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:04:37.521596] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-03T19:04:37.521683] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-03T19:04:37.522142] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-03T19:04:37.522203] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-03T19:04:37.595743] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-03T19:04:37.911587] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:38.390686] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-03T19:04:39.190688] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-03T19:04:39.340626] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:04:39.398070] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:04:39.990675] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-03T19:04:40.786554] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:04:40.790585] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-03T19:04:40.991540] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:04:41.411600] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T19:04:41.590691] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-03T19:04:42.390694] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-03T19:04:42.741223] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:04:43.190686] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-03T19:04:43.990698] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-03T19:04:44.139057] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:04:44.780132] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:04:44.790816] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-03T19:04:45.235319] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T19:04:45.590735] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-03T19:04:46.354118] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:04:46.390717] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-03T19:04:47.022011] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-03T19:04:47.175402] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:04:47.190622] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-03T19:04:47.990706] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-03T19:04:48.172703] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:04:48.174227] [INFO ] [REMOTE ] GAB: Full fetch complete (39614 records). [2025-10-03T19:04:48.174312] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-03T19:04:48.598270] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-03T19:04:48.598405] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-03T19:04:48.599542] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-03T19:04:48.599608] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-03T19:04:48.600740] [DEBUG] [LOCAL ] GAB: Trimmed 39614 records to 28299 (keeping 200 days of data) [2025-10-03T19:04:48.773513] [DEBUG] [LOCAL ] GAB: Primary data saved (28299 records). [2025-10-03T19:04:48.774009] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-03T19:04:48.774174] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 36.9s. Estimated remaining: 3h 27m 3s. Rate: 7.1 symbols/min [2025-10-03T19:04:48.797543] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-03T19:04:48.971754] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:48.993837] [DEBUG] [LOCAL ] GATX: Loaded 18259 existing records from primary storage. [2025-10-03T19:04:48.994101] [INFO ] [MAIN ] GATX: Loaded 18259 existing records. [2025-10-03T19:04:49.194660] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:49.194973] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-03T19:04:49.195032] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-03T19:04:49.195325] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-03T19:04:49.195405] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-03T19:04:49.604215] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:49.598462] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-03T19:04:49.640380] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:04:50.160956] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:04:50.390751] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-03T19:04:50.816877] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-03T19:04:51.016557] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:04:51.190694] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-03T19:04:51.990701] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-03T19:04:52.269011] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:04:52.790734] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-03T19:04:53.590730] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-03T19:04:53.967430] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:04:54.390703] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-03T19:04:54.471027] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:04:54.618636] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:04:55.010202] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T19:04:55.190683] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-03T19:04:55.990632] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-03T19:04:56.105191] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:04:56.790712] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-03T19:04:57.263842] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-03T19:04:57.432242] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:04:57.438274] [INFO ] [REMOTE ] G: Full fetch complete (71663 records). [2025-10-03T19:04:57.438511] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-03T19:04:57.595772] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-03T19:04:57.880386] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-03T19:04:57.880477] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-03T19:04:57.881539] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-03T19:04:57.881613] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-03T19:04:57.883262] [DEBUG] [LOCAL ] G: Trimmed 71663 records to 50591 (keeping 200 days of data) [2025-10-03T19:04:58.209398] [DEBUG] [LOCAL ] G: Primary data saved (50591 records). [2025-10-03T19:04:58.209540] [INFO ] [MAIN ] G: Full history saved. [2025-10-03T19:04:58.209660] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. G took 48.2s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-03T19:04:58.397074] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-03T19:04:58.401276] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:04:58.419056] [DEBUG] [LOCAL ] GBAB: Loaded 13143 existing records from primary storage. [2025-10-03T19:04:58.419358] [INFO ] [MAIN ] GBAB: Loaded 13143 existing records. [2025-10-03T19:04:58.624899] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:04:58.625113] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-03T19:04:58.625162] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-03T19:04:58.625365] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-03T19:04:58.625439] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-03T19:04:59.024281] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:04:59.190734] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-03T19:04:59.366396] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-03T19:04:59.438840] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:04:59.920061] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:04:59.990706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-03T19:05:00.790699] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-03T19:05:01.185815] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T19:05:01.590711] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-03T19:05:01.615687] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:05:02.390624] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-03T19:05:02.704174] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:05:03.190722] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-03T19:05:03.329039] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:05:03.639068] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-03T19:05:03.640045] [INFO ] [REMOTE ] GAM: Full fetch complete (6733 records). [2025-10-03T19:05:03.640119] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-03T19:05:03.999276] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-03T19:05:04.050976] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-03T19:05:04.051083] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-03T19:05:04.051313] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-03T19:05:04.051409] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-03T19:05:04.052058] [DEBUG] [LOCAL ] GAM: Trimmed 6733 records to 4101 (keeping 200 days of data) [2025-10-03T19:05:04.078416] [DEBUG] [LOCAL ] GAM: Primary data saved (4101 records). [2025-10-03T19:05:04.078599] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-03T19:05:04.078753] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. GAM took 32.1s. Estimated remaining: 3h 26m 44s. Rate: 7.1 symbols/min [2025-10-03T19:05:04.270713] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:04.323922] [DEBUG] [LOCAL ] GBCI: Loaded 40436 existing records from primary storage. [2025-10-03T19:05:04.324289] [INFO ] [MAIN ] GBCI: Loaded 40436 existing records. [2025-10-03T19:05:04.553275] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:04.553561] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-03T19:05:04.553669] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-03T19:05:04.554197] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-03T19:05:04.554257] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-03T19:05:04.795821] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-03T19:05:05.000201] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:05.590733] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-03T19:05:05.699301] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:05:06.122418] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-03T19:05:06.390708] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-03T19:05:07.153062] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:05:07.190626] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-03T19:05:07.299896] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-03T19:05:07.990666] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-03T19:05:08.700964] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:05:08.790732] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-03T19:05:09.590698] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-03T19:05:09.633973] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:05:09.867834] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:05:10.390727] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-03T19:05:10.890120] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:05:11.185564] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:05:11.190609] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-03T19:05:11.990675] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-03T19:05:12.143259] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T19:05:12.694171] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T19:05:12.790706] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-03T19:05:13.590720] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-03T19:05:13.774211] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:05:14.390787] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-03T19:05:15.190670] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-03T19:05:15.229426] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:05:15.431633] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:05:15.990729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-03T19:05:16.790696] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-03T19:05:16.966628] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:05:17.590725] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-03T19:05:17.648767] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:05:17.667021] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:05:17.668317] [INFO ] [REMOTE ] GATX: Full fetch complete (25184 records). [2025-10-03T19:05:17.668433] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-03T19:05:18.077448] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-03T19:05:18.077552] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-03T19:05:18.078150] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-03T19:05:18.078219] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-03T19:05:18.079217] [DEBUG] [LOCAL ] GATX: Trimmed 25184 records to 18362 (keeping 200 days of data) [2025-10-03T19:05:18.202590] [DEBUG] [LOCAL ] GATX: Primary data saved (18362 records). [2025-10-03T19:05:18.202799] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-03T19:05:18.202936] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GATX took 29.4s. Estimated remaining: 3h 26m 45s. Rate: 7.1 symbols/min [2025-10-03T19:05:18.394636] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-03T19:05:18.396604] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:18.398353] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-03T19:05:18.398417] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-03T19:05:18.398551] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-03T19:05:18.398595] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-03T19:05:18.398638] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-03T19:05:18.398763] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-03T19:05:18.791383] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:19.190700] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-03T19:05:19.384210] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T19:05:19.994166] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-03T19:05:20.000801] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:05:20.174836] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:05:20.790758] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-03T19:05:21.265803] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:05:21.590742] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-03T19:05:21.773076] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:05:21.776194] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-10-03T19:05:21.776492] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-03T19:05:22.208883] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-03T19:05:22.209002] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-03T19:05:22.210340] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-03T19:05:22.210442] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-03T19:05:22.212608] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54434 (keeping 200 days of data) [2025-10-03T19:05:22.411291] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-03T19:05:22.577523] [DEBUG] [LOCAL ] GAP: Primary data saved (54434 records). [2025-10-03T19:05:22.577821] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-03T19:05:22.578018] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GAP took 45.5s. Estimated remaining: 3h 26m 30s. Rate: 7.1 symbols/min [2025-10-03T19:05:22.762054] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:22.787327] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T19:05:22.832295] [DEBUG] [LOCAL ] GBTG: Loaded 40317 existing records from primary storage. [2025-10-03T19:05:22.832761] [INFO ] [MAIN ] GBTG: Loaded 40317 existing records. [2025-10-03T19:05:23.014827] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:23.015310] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-03T19:05:23.015398] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-03T19:05:23.016604] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-03T19:05:23.016935] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-03T19:05:23.195207] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-03T19:05:23.391112] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:05:23.476930] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:23.990713] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-03T19:05:24.327343] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:05:24.790688] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-03T19:05:24.921596] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-03T19:05:25.112140] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-03T19:05:25.590739] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-03T19:05:26.342926] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:05:26.390693] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-03T19:05:27.047392] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T19:05:27.049145] [INFO ] [REMOTE ] GBAB: Full fetch complete (19627 records). [2025-10-03T19:05:27.049275] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-03T19:05:27.195754] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-03T19:05:27.471516] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-03T19:05:27.471624] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-03T19:05:27.472337] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-03T19:05:27.472393] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-03T19:05:27.473136] [DEBUG] [LOCAL ] GBAB: Trimmed 19627 records to 13203 (keeping 200 days of data) [2025-10-03T19:05:27.559952] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-03T19:05:27.578836] [DEBUG] [LOCAL ] GBAB: Primary data saved (13203 records). [2025-10-03T19:05:27.579072] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-03T19:05:27.579190] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBAB took 29.4s. Estimated remaining: 3h 26m 16s. Rate: 7.1 symbols/min [2025-10-03T19:05:27.754717] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:27.792575] [DEBUG] [LOCAL ] GBX: Loaded 29327 existing records from primary storage. [2025-10-03T19:05:27.793087] [INFO ] [MAIN ] GBX: Loaded 29327 existing records. [2025-10-03T19:05:27.980601] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:27.980934] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-03T19:05:27.980988] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-03T19:05:27.981352] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-03T19:05:27.981411] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-03T19:05:27.995744] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-03T19:05:28.375677] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:28.790704] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-03T19:05:29.209304] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-03T19:05:29.398613] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:05:29.590698] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-03T19:05:29.933161] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-03T19:05:30.390719] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-03T19:05:30.616368] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-03T19:05:31.190701] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-03T19:05:31.990729] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-03T19:05:32.262119] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:05:32.790722] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-03T19:05:33.048442] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-03T19:05:33.426374] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:05:33.590714] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-03T19:05:34.390734] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-03T19:05:34.930713] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:05:35.190762] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-03T19:05:35.689871] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T19:05:35.990668] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-03T19:05:36.234832] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:05:36.237986] [INFO ] [REMOTE ] GBCI: Full fetch complete (58408 records). [2025-10-03T19:05:36.238104] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-03T19:05:36.666921] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-03T19:05:36.667044] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-03T19:05:36.668453] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-03T19:05:36.668555] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-03T19:05:36.670436] [DEBUG] [LOCAL ] GBCI: Trimmed 58408 records to 40821 (keeping 200 days of data) [2025-10-03T19:05:36.790874] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-03T19:05:36.958915] [DEBUG] [LOCAL ] GBCI: Primary data saved (40821 records). [2025-10-03T19:05:36.959082] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-03T19:05:36.959823] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBCI took 32.9s. Estimated remaining: 3h 26m 9s. Rate: 7.1 symbols/min [2025-10-03T19:05:37.145618] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:37.199887] [DEBUG] [LOCAL ] GCI: Loaded 44426 existing records from primary storage. [2025-10-03T19:05:37.200197] [INFO ] [MAIN ] GCI: Loaded 44426 existing records. [2025-10-03T19:05:37.413885] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:37.414519] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-03T19:05:37.414594] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-03T19:05:37.420907] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-03T19:05:37.432562] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-03T19:05:37.439883] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:05:37.595766] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-03T19:05:37.844541] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:38.079816] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:05:38.104585] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:05:38.390684] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-03T19:05:39.190683] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-03T19:05:39.565845] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-03T19:05:39.712250] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T19:05:39.990638] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-03T19:05:40.346002] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-03T19:05:40.346911] [INFO ] [REMOTE ] GBLI: Full fetch complete (1327 records). [2025-10-03T19:05:40.347006] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-03T19:05:40.563220] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-03T19:05:40.563470] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:05:40.563542] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:05:40.563627] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-03T19:05:40.563734] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-03T19:05:40.563784] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-03T19:05:40.563829] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-03T19:05:40.563903] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GBLI took 22.4s. Estimated remaining: 3h 25m 53s. Rate: 7.1 symbols/min [2025-10-03T19:05:40.751228] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:05:40.777417] [DEBUG] [LOCAL ] GCO: Loaded 24786 existing records from primary storage. [2025-10-03T19:05:40.777725] [INFO ] [MAIN ] GCO: Loaded 24786 existing records. [2025-10-03T19:05:40.799721] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-03T19:05:40.975033] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:05:40.975342] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-03T19:05:40.975411] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-03T19:05:40.975679] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-03T19:05:40.975752] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-03T19:05:41.377015] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:05:41.590737] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-03T19:05:42.035337] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:05:42.390737] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-03T19:05:42.571078] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:05:43.190689] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-03T19:05:43.723760] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T19:05:43.990628] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-03T19:05:44.384271] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-03T19:05:44.790725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-03T19:05:45.485001] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:05:45.573790] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:05:45.590614] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-03T19:05:46.390713] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-03T19:05:46.745400] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:05:47.190734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-03T19:05:47.876304] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:05:47.990712] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-03T19:05:48.546011] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:05:48.790624] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-03T19:05:49.181308] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:05:49.590715] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-03T19:05:50.090268] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:05:50.390633] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-03T19:05:50.718467] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:05:51.190747] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-03T19:05:51.929155] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T19:05:51.990726] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-03T19:05:52.707931] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-03T19:05:52.790676] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-03T19:05:53.598746] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-03T19:05:53.604703] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:05:54.187143] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:05:54.390739] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-03T19:05:54.639739] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T19:05:55.190722] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-03T19:05:55.416142] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:05:55.990683] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-03T19:05:56.297852] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-03T19:05:56.790726] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-03T19:05:57.069244] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:05:57.590726] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-03T19:05:58.403883] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-03T19:05:58.411076] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:05:58.965453] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T19:05:59.190637] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-03T19:05:59.516772] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:05:59.990715] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-03T19:06:00.408888] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:06:00.790681] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-03T19:06:00.875373] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-03T19:06:01.590714] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-03T19:06:01.813139] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:06:02.390722] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-03T19:06:02.771381] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:06:02.774245] [INFO ] [REMOTE ] GBTG: Full fetch complete (56556 records). [2025-10-03T19:06:02.774434] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-03T19:06:03.194271] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-03T19:06:03.215583] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-03T19:06:03.215710] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-03T19:06:03.216512] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-03T19:06:03.216558] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-03T19:06:03.218167] [DEBUG] [LOCAL ] GBTG: Trimmed 56556 records to 40575 (keeping 200 days of data) [2025-10-03T19:06:03.458998] [DEBUG] [LOCAL ] GBTG: Primary data saved (40575 records). [2025-10-03T19:06:03.459125] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-03T19:06:03.459227] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GBTG took 40.9s. Estimated remaining: 3h 26m 8s. Rate: 7.1 symbols/min [2025-10-03T19:06:03.646036] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:03.668604] [DEBUG] [LOCAL ] GCTS: Loaded 20086 existing records from primary storage. [2025-10-03T19:06:03.668920] [INFO ] [MAIN ] GCTS: Loaded 20086 existing records. [2025-10-03T19:06:03.879505] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:03.879871] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-03T19:06:03.879930] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-03T19:06:03.880153] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-03T19:06:03.880212] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-03T19:06:03.991580] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-03T19:06:04.213834] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:06:04.266585] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:06:04.293717] [INFO ] [REMOTE ] GBX: Full fetch complete (42832 records). [2025-10-03T19:06:04.318193] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-03T19:06:04.430841] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:04.805734] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-03T19:06:04.810151] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-03T19:06:04.810238] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-03T19:06:04.811058] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-03T19:06:04.811238] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-03T19:06:04.812666] [DEBUG] [LOCAL ] GBX: Trimmed 42832 records to 29520 (keeping 200 days of data) [2025-10-03T19:06:05.007293] [DEBUG] [LOCAL ] GBX: Primary data saved (29520 records). [2025-10-03T19:06:05.007450] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-03T19:06:05.007560] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GBX took 37.4s. Estimated remaining: 3h 25m 49s. Rate: 7.1 symbols/min [2025-10-03T19:06:05.202262] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:05.225139] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:06:05.236373] [DEBUG] [LOCAL ] GCV: Loaded 7454 existing records from primary storage. [2025-10-03T19:06:05.236674] [INFO ] [MAIN ] GCV: Loaded 7454 existing records. [2025-10-03T19:06:05.426445] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:05.426684] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-03T19:06:05.426745] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-03T19:06:05.426956] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-03T19:06:05.427029] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-03T19:06:05.600583] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-03T19:06:05.851331] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:06.390625] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-03T19:06:06.444020] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:06:06.704133] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T19:06:07.190723] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-03T19:06:07.522471] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T19:06:07.990628] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-03T19:06:08.134932] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:06:08.790714] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-03T19:06:08.894752] [DEBUG] [REMOTE ] GCV: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-10-03T19:06:08.895094] [WARN ] [REMOTE ] GCV: No data returned for month 2024-12 [2025-10-03T19:06:08.895213] [FATAL] [REMOTE ] GCV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:06:08.895311] [FATAL] [MAIN ] GCV: Failed to fetch primary data. [2025-10-03T19:06:08.895425] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:06:08.895527] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-03T19:06:08.895686] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-10-03T19:06:08.895746] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-10-03T19:06:08.896168] [DEBUG] [LOCAL ] GCV: Deleted derivative data file. [2025-10-03T19:06:08.896271] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GCV took 3.9s. Estimated remaining: 3h 25m 33s. Rate: 7.1 symbols/min [2025-10-03T19:06:09.117690] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:09.134025] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-03T19:06:09.182473] [DEBUG] [LOCAL ] GD: Loaded 47468 existing records from primary storage. [2025-10-03T19:06:09.182833] [INFO ] [MAIN ] GD: Loaded 47468 existing records. [2025-10-03T19:06:09.372855] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:09.373096] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-03T19:06:09.373154] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-03T19:06:09.374760] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-03T19:06:09.374823] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-03T19:06:09.595790] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-03T19:06:09.757481] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:10.390709] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-03T19:06:11.190708] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-03T19:06:11.260354] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:06:11.305949] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-03T19:06:11.990714] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-03T19:06:12.790725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-03T19:06:12.865260] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-03T19:06:13.527420] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:06:13.553097] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:06:13.590623] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-03T19:06:14.390734] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-03T19:06:14.416145] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:06:14.417548] [INFO ] [REMOTE ] GCO: Full fetch complete (35378 records). [2025-10-03T19:06:14.417631] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-03T19:06:14.844368] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-03T19:06:14.844463] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-03T19:06:14.845128] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-03T19:06:14.845197] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-03T19:06:14.846292] [DEBUG] [LOCAL ] GCO: Trimmed 35378 records to 24918 (keeping 200 days of data) [2025-10-03T19:06:15.009243] [DEBUG] [LOCAL ] GCO: Primary data saved (24918 records). [2025-10-03T19:06:15.009400] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-03T19:06:15.009549] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCO took 34.4s. Estimated remaining: 3h 25m 21s. Rate: 7.1 symbols/min [2025-10-03T19:06:15.198580] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-03T19:06:15.202592] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:15.259159] [DEBUG] [LOCAL ] GDDY: Loaded 50069 existing records from primary storage. [2025-10-03T19:06:15.259499] [INFO ] [MAIN ] GDDY: Loaded 50069 existing records. [2025-10-03T19:06:15.469796] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:15.470091] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-03T19:06:15.470142] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-03T19:06:15.471810] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-03T19:06:15.471877] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-03T19:06:15.584585] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:06:15.613124] [INFO ] [REMOTE ] GCI: Full fetch complete (63174 records). [2025-10-03T19:06:15.623723] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-03T19:06:16.024146] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-03T19:06:16.223534] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:16.297936] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:06:16.402003] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-03T19:06:16.402093] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-03T19:06:16.402868] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-03T19:06:16.402936] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-03T19:06:16.404352] [DEBUG] [LOCAL ] GCI: Trimmed 63174 records to 44716 (keeping 200 days of data) [2025-10-03T19:06:16.669761] [DEBUG] [LOCAL ] GCI: Primary data saved (44716 records). [2025-10-03T19:06:16.669919] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-03T19:06:16.671587] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GCI took 39.7s. Estimated remaining: 3h 25m 2s. Rate: 7.2 symbols/min [2025-10-03T19:06:16.795873] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-03T19:06:16.865586] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:16.874136] [DEBUG] [LOCAL ] GDIV: Loaded 3648 existing records from primary storage. [2025-10-03T19:06:16.874366] [INFO ] [MAIN ] GDIV: Loaded 3648 existing records. [2025-10-03T19:06:17.068120] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:17.068366] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-03T19:06:17.068425] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-03T19:06:17.068687] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-03T19:06:17.068746] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-03T19:06:17.467041] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:17.590745] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-03T19:06:17.802393] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-03T19:06:17.803570] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:06:18.274383] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-03T19:06:18.390695] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-03T19:06:19.190727] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-03T19:06:20.000298] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-03T19:06:20.020421] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:06:20.454520] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:06:20.561167] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T19:06:20.790747] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-03T19:06:21.590704] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-03T19:06:22.179099] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:06:22.390714] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-03T19:06:23.190694] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-03T19:06:23.346422] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:06:23.756564] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:06:23.997487] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-03T19:06:24.006269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T19:06:24.790701] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-03T19:06:25.425742] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:06:25.590713] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-03T19:06:25.806630] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T19:06:26.390693] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-03T19:06:27.006447] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-03T19:06:27.190719] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-03T19:06:27.458268] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:06:27.752717] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:06:27.990797] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-03T19:06:28.790699] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-03T19:06:29.590694] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-03T19:06:29.971719] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:06:30.390679] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-03T19:06:30.567512] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:06:30.685316] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:06:30.940993] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T19:06:31.190703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-03T19:06:31.990690] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-03T19:06:32.790698] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-03T19:06:32.884138] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:06:33.074870] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:06:33.363436] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:06:33.590706] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-03T19:06:34.390637] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-03T19:06:34.710065] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:06:35.190682] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-03T19:06:36.000393] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-03T19:06:36.009028] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-03T19:06:36.203312] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:06:36.204697] [INFO ] [REMOTE ] GCTS: Full fetch complete (26901 records). [2025-10-03T19:06:36.204822] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-03T19:06:36.605547] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T19:06:36.640287] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-03T19:06:36.640447] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-03T19:06:36.641501] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-03T19:06:36.641735] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-03T19:06:36.643238] [DEBUG] [LOCAL ] GCTS: Trimmed 26901 records to 20197 (keeping 200 days of data) [2025-10-03T19:06:36.775322] [DEBUG] [LOCAL ] GCTS: Primary data saved (20197 records). [2025-10-03T19:06:36.775453] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-03T19:06:36.775566] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCTS took 33.3s. Estimated remaining: 3h 25m 12s. Rate: 7.1 symbols/min [2025-10-03T19:06:36.797577] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-03T19:06:36.969404] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:36.974404] [DEBUG] [LOCAL ] GDL: Loaded 2576 existing records from primary storage. [2025-10-03T19:06:36.974593] [INFO ] [MAIN ] GDL: Loaded 2576 existing records. [2025-10-03T19:06:37.181962] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:37.182272] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-03T19:06:37.182365] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-03T19:06:37.182847] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-03T19:06:37.182909] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-03T19:06:37.567121] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:37.590619] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-03T19:06:38.071722] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:06:38.390636] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-03T19:06:38.649593] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:06:38.855321] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T19:06:39.190727] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-03T19:06:39.700379] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:06:39.990688] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-03T19:06:40.479600] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T19:06:40.790708] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-03T19:06:41.590709] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-03T19:06:42.390706] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-03T19:06:42.595150] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:06:42.815419] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:06:43.020875] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-03T19:06:43.190751] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-03T19:06:43.783745] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:06:43.784688] [INFO ] [REMOTE ] GDIV: Full fetch complete (5468 records). [2025-10-03T19:06:43.784782] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-03T19:06:43.995843] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-03T19:06:44.182465] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-03T19:06:44.182552] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-03T19:06:44.182749] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-03T19:06:44.182830] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-03T19:06:44.183273] [DEBUG] [LOCAL ] GDIV: Trimmed 5468 records to 3667 (keeping 200 days of data) [2025-10-03T19:06:44.211169] [DEBUG] [LOCAL ] GDIV: Primary data saved (3667 records). [2025-10-03T19:06:44.211322] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-03T19:06:44.211429] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDIV took 27.5s. Estimated remaining: 3h 25m 2s. Rate: 7.1 symbols/min [2025-10-03T19:06:44.397201] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:44.406803] [DEBUG] [LOCAL ] GDO: Loaded 6027 existing records from primary storage. [2025-10-03T19:06:44.407080] [INFO ] [MAIN ] GDO: Loaded 6027 existing records. [2025-10-03T19:06:44.576968] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T19:06:44.632888] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:44.633111] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-03T19:06:44.633162] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-03T19:06:44.633570] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-03T19:06:44.633634] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-03T19:06:44.799899] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-03T19:06:45.011293] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:45.590685] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-03T19:06:46.020122] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-03T19:06:46.390712] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-03T19:06:46.785097] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:06:47.190729] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-03T19:06:47.971451] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:06:47.990605] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-03T19:06:48.084342] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:06:48.384303] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-03T19:06:48.790702] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-03T19:06:49.590730] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-03T19:06:50.218380] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:06:50.395801] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-03T19:06:50.409956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:06:51.116449] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-03T19:06:51.190626] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-03T19:06:51.990692] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-03T19:06:52.451990] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-03T19:06:52.790675] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-03T19:06:52.911254] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:06:53.590735] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-03T19:06:54.390633] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-03T19:06:54.447636] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:06:54.954202] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:06:55.108597] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:06:55.111588] [INFO ] [REMOTE ] GD: Full fetch complete (70233 records). [2025-10-03T19:06:55.111736] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-03T19:06:55.195971] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-03T19:06:55.576827] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-03T19:06:55.576941] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-03T19:06:55.578197] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-03T19:06:55.578273] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-03T19:06:55.579827] [DEBUG] [LOCAL ] GD: Trimmed 70233 records to 47780 (keeping 200 days of data) [2025-10-03T19:06:55.703243] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:06:55.916130] [DEBUG] [LOCAL ] GD: Primary data saved (47780 records). [2025-10-03T19:06:55.916276] [INFO ] [MAIN ] GD: Full history saved. [2025-10-03T19:06:55.916367] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GD took 47.0s. Estimated remaining: 3h 24m 59s. Rate: 7.1 symbols/min [2025-10-03T19:06:55.995872] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-03T19:06:56.101172] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:06:56.137551] [DEBUG] [LOCAL ] GDOT: Loaded 38623 existing records from primary storage. [2025-10-03T19:06:56.137874] [INFO ] [MAIN ] GDOT: Loaded 38623 existing records. [2025-10-03T19:06:56.337890] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:06:56.338129] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-03T19:06:56.338184] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-03T19:06:56.339430] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-03T19:06:56.339491] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-03T19:06:56.712840] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-03T19:06:56.726811] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:06:56.790720] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-03T19:06:57.590728] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-03T19:06:58.091752] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:06:58.390719] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-03T19:06:59.100134] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-03T19:06:59.190735] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-03T19:06:59.272269] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:06:59.990741] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-03T19:07:00.538382] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:07:00.539160] [INFO ] [REMOTE ] GDL: Full fetch complete (3632 records). [2025-10-03T19:07:00.539265] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-03T19:07:00.674601] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:07:00.798294] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-03T19:07:00.964485] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-03T19:07:00.964566] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-03T19:07:00.964721] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-03T19:07:00.964783] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-03T19:07:00.965170] [DEBUG] [LOCAL ] GDL: Trimmed 3632 records to 2587 (keeping 200 days of data) [2025-10-03T19:07:00.981934] [DEBUG] [LOCAL ] GDL: Primary data saved (2587 records). [2025-10-03T19:07:00.982030] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-03T19:07:00.982154] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDL took 24.2s. Estimated remaining: 3h 24m 45s. Rate: 7.1 symbols/min [2025-10-03T19:07:01.170223] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:01.192318] [DEBUG] [LOCAL ] GDV: Loaded 19585 existing records from primary storage. [2025-10-03T19:07:01.192611] [INFO ] [MAIN ] GDV: Loaded 19585 existing records. [2025-10-03T19:07:01.384460] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:01.384739] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-03T19:07:01.384805] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-03T19:07:01.385034] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-03T19:07:01.385093] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-03T19:07:01.516784] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:07:01.594139] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-03T19:07:01.812429] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:02.390752] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-03T19:07:03.016515] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T19:07:03.016324] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T19:07:03.190725] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-03T19:07:03.778246] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-03T19:07:03.990715] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-03T19:07:04.790703] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-03T19:07:05.076732] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:07:05.590743] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-03T19:07:06.254468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:07:06.261197] [INFO ] [REMOTE ] GDDY: Full fetch complete (71580 records). [2025-10-03T19:07:06.261370] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-03T19:07:06.382950] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:07:06.395761] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-03T19:07:06.717958] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-03T19:07:06.718047] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-03T19:07:06.718974] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-03T19:07:06.719045] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-03T19:07:06.720579] [DEBUG] [LOCAL ] GDDY: Trimmed 71580 records to 50457 (keeping 200 days of data) [2025-10-03T19:07:07.040978] [DEBUG] [LOCAL ] GDDY: Primary data saved (50457 records). [2025-10-03T19:07:07.041135] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-03T19:07:07.041227] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GDDY took 52.0s. Estimated remaining: 3h 24m 33s. Rate: 7.1 symbols/min [2025-10-03T19:07:07.197861] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-03T19:07:07.235312] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:07.295690] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-10-03T19:07:07.296076] [INFO ] [MAIN ] GE: Loaded 54103 existing records. [2025-10-03T19:07:07.487698] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:07.487959] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-03T19:07:07.488006] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-03T19:07:07.488511] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-03T19:07:07.488571] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-03T19:07:07.881471] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:07.915267] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:07:07.990686] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-03T19:07:08.228849] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:07:08.590542] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-03T19:07:08.790716] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-03T19:07:09.590695] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-03T19:07:10.203248] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-03T19:07:10.390688] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-03T19:07:11.190689] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-03T19:07:11.359389] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T19:07:11.605853] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-03T19:07:11.990706] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-03T19:07:12.549827] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:07:12.551116] [INFO ] [REMOTE ] GDO: Full fetch complete (9108 records). [2025-10-03T19:07:12.551226] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-03T19:07:12.794690] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-03T19:07:12.889463] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:07:13.013282] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-03T19:07:13.013360] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-03T19:07:13.013580] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-03T19:07:13.013620] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-03T19:07:13.014108] [DEBUG] [LOCAL ] GDO: Trimmed 9108 records to 6068 (keeping 200 days of data) [2025-10-03T19:07:13.053876] [DEBUG] [LOCAL ] GDO: Primary data saved (6068 records). [2025-10-03T19:07:13.054012] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-03T19:07:13.054148] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDO took 28.8s. Estimated remaining: 3h 24m 21s. Rate: 7.1 symbols/min [2025-10-03T19:07:13.229400] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:13.252800] [DEBUG] [LOCAL ] GEF: Loaded 20830 existing records from primary storage. [2025-10-03T19:07:13.253080] [INFO ] [MAIN ] GEF: Loaded 20830 existing records. [2025-10-03T19:07:13.444512] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:13.444783] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-03T19:07:13.444837] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-03T19:07:13.445067] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-03T19:07:13.445125] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-03T19:07:13.604198] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-03T19:07:13.839948] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:13.942224] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T19:07:14.390711] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-03T19:07:15.190725] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-03T19:07:15.529409] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:07:15.708349] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-03T19:07:15.990716] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-03T19:07:16.618301] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:07:16.790689] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-03T19:07:17.235916] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T19:07:17.590713] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-03T19:07:17.801827] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:07:18.390686] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-03T19:07:19.190628] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-03T19:07:19.418468] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:07:19.695829] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-03T19:07:19.990729] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-03T19:07:20.764100] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T19:07:20.790739] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-03T19:07:21.590686] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-03T19:07:22.086084] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-03T19:07:22.199733] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:07:22.390717] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-03T19:07:22.498286] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:07:23.190686] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-03T19:07:23.990691] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-03T19:07:24.210564] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:07:24.349893] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:07:24.790735] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-03T19:07:25.520238] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:07:25.590675] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-03T19:07:25.881898] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:07:26.390689] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-03T19:07:26.756316] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:07:26.758640] [INFO ] [REMOTE ] GDOT: Full fetch complete (53187 records). [2025-10-03T19:07:26.758792] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-03T19:07:27.195785] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-03T19:07:27.218336] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-03T19:07:27.218421] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-03T19:07:27.219355] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-03T19:07:27.219425] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-03T19:07:27.220834] [DEBUG] [LOCAL ] GDOT: Trimmed 53187 records to 38866 (keeping 200 days of data) [2025-10-03T19:07:27.447735] [DEBUG] [LOCAL ] GDOT: Primary data saved (38866 records). [2025-10-03T19:07:27.447879] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-03T19:07:27.447985] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDOT took 31.5s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-10-03T19:07:27.629262] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:07:27.650306] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:27.690804] [DEBUG] [LOCAL ] GEL: Loaded 33312 existing records from primary storage. [2025-10-03T19:07:27.691093] [INFO ] [MAIN ] GEL: Loaded 33312 existing records. [2025-10-03T19:07:27.887304] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:27.887513] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-03T19:07:27.887562] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-03T19:07:27.887827] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-03T19:07:27.887920] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-03T19:07:27.994337] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-03T19:07:28.284530] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:28.296203] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:07:28.790680] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-03T19:07:29.590693] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-03T19:07:29.982860] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:07:30.311186] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-03T19:07:30.390674] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-03T19:07:30.663386] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-03T19:07:31.190692] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-03T19:07:31.990665] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-03T19:07:32.102968] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:07:32.406808] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-03T19:07:32.790693] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-03T19:07:32.927265] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:07:33.590716] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-03T19:07:33.664464] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T19:07:34.390713] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-03T19:07:35.190696] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-03T19:07:35.722016] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T19:07:35.792452] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T19:07:35.990618] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-03T19:07:36.243154] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:07:36.790708] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-03T19:07:37.590696] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-03T19:07:38.026972] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:07:38.202055] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-03T19:07:38.265880] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:07:38.267411] [INFO ] [REMOTE ] GDV: Full fetch complete (28597 records). [2025-10-03T19:07:38.267512] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-03T19:07:38.395868] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-03T19:07:38.695568] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-03T19:07:38.695720] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-03T19:07:38.696346] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-03T19:07:38.696436] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-03T19:07:38.697883] [DEBUG] [LOCAL ] GDV: Trimmed 28597 records to 19748 (keeping 200 days of data) [2025-10-03T19:07:38.822630] [DEBUG] [LOCAL ] GDV: Primary data saved (19748 records). [2025-10-03T19:07:38.822809] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-03T19:07:38.822920] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GDV took 37.8s. Estimated remaining: 3h 24m 19s. Rate: 7.1 symbols/min [2025-10-03T19:07:39.011365] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:39.075956] [DEBUG] [LOCAL ] GENI: Loaded 53320 existing records from primary storage. [2025-10-03T19:07:39.076379] [INFO ] [MAIN ] GENI: Loaded 53320 existing records. [2025-10-03T19:07:39.195848] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-03T19:07:39.322297] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:39.322510] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-03T19:07:39.322559] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-03T19:07:39.322804] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-03T19:07:39.322865] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-03T19:07:39.734473] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:39.990683] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-03T19:07:40.588088] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-03T19:07:40.648406] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:07:40.790688] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-03T19:07:41.595758] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-03T19:07:41.615603] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T19:07:42.390696] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-03T19:07:42.789216] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-03T19:07:42.791925] [INFO ] [REMOTE ] GE: Full fetch complete (77779 records). [2025-10-03T19:07:42.792038] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-03T19:07:43.111234] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:07:43.212694] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-03T19:07:43.275401] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-03T19:07:43.275515] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-03T19:07:43.289341] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-03T19:07:43.290118] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-03T19:07:43.290706] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:07:43.297831] [DEBUG] [LOCAL ] GE: Trimmed 77779 records to 54493 (keeping 200 days of data) [2025-10-03T19:07:43.661530] [DEBUG] [LOCAL ] GE: Primary data saved (54493 records). [2025-10-03T19:07:43.661800] [INFO ] [MAIN ] GE: Full history saved. [2025-10-03T19:07:43.661924] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GE took 36.6s. Estimated remaining: 3h 24m 5s. Rate: 7.1 symbols/min [2025-10-03T19:07:43.851313] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:43.902358] [DEBUG] [LOCAL ] GEO: Loaded 52324 existing records from primary storage. [2025-10-03T19:07:43.902701] [INFO ] [MAIN ] GEO: Loaded 52324 existing records. [2025-10-03T19:07:43.995873] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-03T19:07:44.098238] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:44.098464] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-03T19:07:44.098512] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-03T19:07:44.098808] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-03T19:07:44.098866] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-03T19:07:44.484158] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:44.790688] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-03T19:07:44.917448] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:07:45.280831] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:07:45.590739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-03T19:07:45.720077] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:07:46.390719] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-03T19:07:47.197509] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-03T19:07:47.204128] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:07:47.990680] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-03T19:07:48.256901] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:07:48.461075] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-03T19:07:48.790713] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-03T19:07:49.535090] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-03T19:07:49.590721] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-03T19:07:50.390624] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-03T19:07:50.737398] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:07:51.190638] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-03T19:07:51.442781] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:07:51.447519] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-03T19:07:51.447773] [INFO ] [REMOTE ] GEF: Full fetch complete (29533 records). [2025-10-03T19:07:51.459391] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-03T19:07:51.885305] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-03T19:07:51.885409] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-03T19:07:51.886075] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-03T19:07:51.886143] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-03T19:07:51.887153] [DEBUG] [LOCAL ] GEF: Trimmed 29533 records to 20967 (keeping 200 days of data) [2025-10-03T19:07:51.990882] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-03T19:07:52.028260] [DEBUG] [LOCAL ] GEF: Primary data saved (20967 records). [2025-10-03T19:07:52.030934] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-03T19:07:52.031109] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GEF took 39.0s. Estimated remaining: 3h 23m 56s. Rate: 7.1 symbols/min [2025-10-03T19:07:52.210680] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:07:52.257316] [DEBUG] [LOCAL ] GES: Loaded 39655 existing records from primary storage. [2025-10-03T19:07:52.257720] [INFO ] [MAIN ] GES: Loaded 39655 existing records. [2025-10-03T19:07:52.442816] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:07:52.443033] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-03T19:07:52.443081] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-03T19:07:52.443433] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-03T19:07:52.443493] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-03T19:07:52.802927] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-03T19:07:52.825425] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:07:52.882105] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:07:53.442579] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:07:53.590716] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-03T19:07:54.390720] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-03T19:07:54.575069] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:07:54.836843] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:07:55.190697] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-03T19:07:55.795859] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:07:55.990686] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-03T19:07:56.790726] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-03T19:07:56.846394] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T19:07:57.599375] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-03T19:07:57.621332] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:07:57.817834] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:07:58.390714] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-03T19:07:59.190673] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-03T19:07:59.412165] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:07:59.639193] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-03T19:07:59.990724] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-03T19:08:00.233735] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:08:00.235338] [INFO ] [REMOTE ] GEL: Full fetch complete (48489 records). [2025-10-03T19:08:00.235424] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-03T19:08:00.636094] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-03T19:08:00.636178] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-03T19:08:00.636863] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-03T19:08:00.636928] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-03T19:08:00.637925] [DEBUG] [LOCAL ] GEL: Trimmed 48489 records to 33461 (keeping 200 days of data) [2025-10-03T19:08:00.799009] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-03T19:08:00.852676] [DEBUG] [LOCAL ] GEL: Primary data saved (33461 records). [2025-10-03T19:08:00.852892] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-03T19:08:00.853175] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GEL took 33.4s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-10-03T19:08:01.037860] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:01.079287] [DEBUG] [LOCAL ] GETY: Loaded 35780 existing records from primary storage. [2025-10-03T19:08:01.079586] [INFO ] [MAIN ] GETY: Loaded 35780 existing records. [2025-10-03T19:08:01.272056] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:01.272266] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-03T19:08:01.272314] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-03T19:08:01.272602] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-03T19:08:01.272709] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-03T19:08:01.592338] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-03T19:08:01.689232] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:01.719870] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T19:08:02.390685] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-03T19:08:02.446433] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:08:03.190693] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-03T19:08:03.360720] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-03T19:08:03.824151] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:08:03.990696] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-03T19:08:04.596259] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T19:08:04.790720] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-03T19:08:05.590681] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-03T19:08:05.665810] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:08:06.390710] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-03T19:08:06.636895] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:08:07.193991] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-03T19:08:07.202186] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T19:08:07.990625] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-03T19:08:08.100885] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:08:08.587689] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T19:08:08.591000] [INFO ] [REMOTE ] GENI: Full fetch complete (75515 records). [2025-10-03T19:08:08.591132] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-03T19:08:08.795762] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-03T19:08:09.038240] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-03T19:08:09.038368] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-03T19:08:09.039340] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-03T19:08:09.039410] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-03T19:08:09.041197] [DEBUG] [LOCAL ] GENI: Trimmed 75515 records to 53710 (keeping 200 days of data) [2025-10-03T19:08:09.381444] [DEBUG] [LOCAL ] GENI: Primary data saved (53710 records). [2025-10-03T19:08:09.381600] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-03T19:08:09.381734] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GENI took 30.6s. Estimated remaining: 3h 23m 40s. Rate: 7.1 symbols/min [2025-10-03T19:08:09.566715] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:09.600799] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-03T19:08:09.623192] [DEBUG] [LOCAL ] GEV: Loaded 53424 existing records from primary storage. [2025-10-03T19:08:09.623522] [INFO ] [MAIN ] GEV: Loaded 53424 existing records. [2025-10-03T19:08:09.828668] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:09.829087] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-03T19:08:09.829162] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-03T19:08:09.829552] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-03T19:08:09.829615] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-03T19:08:10.121765] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-03T19:08:10.269929] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:10.390711] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-03T19:08:10.441430] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:08:11.035277] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:08:11.190714] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-03T19:08:11.990633] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-03T19:08:12.380572] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T19:08:12.790736] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-03T19:08:12.857680] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:08:13.604504] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-03T19:08:13.633752] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:08:14.242480] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:08:14.245131] [INFO ] [REMOTE ] GEO: Full fetch complete (75458 records). [2025-10-03T19:08:14.245240] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-03T19:08:14.404913] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-03T19:08:14.691390] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-03T19:08:14.691489] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-03T19:08:14.692490] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-03T19:08:14.692561] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-03T19:08:14.694286] [DEBUG] [LOCAL ] GEO: Trimmed 75458 records to 52673 (keeping 200 days of data) [2025-10-03T19:08:15.031957] [DEBUG] [LOCAL ] GEO: Primary data saved (52673 records). [2025-10-03T19:08:15.032361] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-03T19:08:15.032508] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GEO took 31.4s. Estimated remaining: 3h 23m 27s. Rate: 7.1 symbols/min [2025-10-03T19:08:15.199432] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-03T19:08:15.235834] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:15.265441] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:08:15.277576] [DEBUG] [LOCAL ] GF: Loaded 2981 existing records from primary storage. [2025-10-03T19:08:15.278580] [INFO ] [MAIN ] GF: Loaded 2981 existing records. [2025-10-03T19:08:15.484027] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:15.484393] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-03T19:08:15.484459] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-03T19:08:15.484618] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-03T19:08:15.484761] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-03T19:08:15.908463] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:15.990686] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-03T19:08:16.056988] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T19:08:16.790718] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-03T19:08:17.590734] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-03T19:08:17.657797] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-10-03T19:08:17.713243] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:08:18.216032] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-03T19:08:18.239770] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:08:18.390710] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-03T19:08:18.985871] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:08:19.190704] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-03T19:08:19.762852] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:08:19.990707] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-03T19:08:20.790747] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-03T19:08:21.473997] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:08:21.590686] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-03T19:08:22.390699] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-03T19:08:23.065069] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:08:23.089932] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:08:23.129041] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-10-03T19:08:23.190698] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-03T19:08:23.990703] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-03T19:08:24.790721] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-03T19:08:25.316613] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:08:25.537772] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-03T19:08:25.586383] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:08:25.594729] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-03T19:08:26.390700] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-03T19:08:27.056597] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:08:27.190693] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-03T19:08:27.843921] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T19:08:27.867605] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:08:27.990713] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-03T19:08:28.790704] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-03T19:08:29.393243] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:08:29.590723] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-03T19:08:30.176716] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:08:30.390697] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-03T19:08:31.190715] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-03T19:08:31.600133] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:08:31.602732] [INFO ] [REMOTE ] GES: Full fetch complete (59391 records). [2025-10-03T19:08:31.603021] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-03T19:08:31.857272] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T19:08:31.998388] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-03T19:08:32.104208] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-03T19:08:32.104299] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-03T19:08:32.105190] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-03T19:08:32.105258] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-03T19:08:32.106679] [DEBUG] [LOCAL ] GES: Trimmed 59391 records to 39908 (keeping 200 days of data) [2025-10-03T19:08:32.379104] [DEBUG] [LOCAL ] GES: Primary data saved (39908 records). [2025-10-03T19:08:32.379320] [INFO ] [MAIN ] GES: Full history saved. [2025-10-03T19:08:32.380289] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GES took 40.3s. Estimated remaining: 3h 23m 33s. Rate: 7.1 symbols/min [2025-10-03T19:08:32.508690] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T19:08:32.790676] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-03T19:08:33.273426] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T19:08:33.590718] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-03T19:08:34.037190] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:08:34.390678] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-03T19:08:34.492500] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-10-03T19:08:35.190734] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-03T19:08:35.602282] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:08:35.604411] [INFO ] [REMOTE ] GETY: Full fetch complete (55522 records). [2025-10-03T19:08:35.604520] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-03T19:08:35.700691] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-03T19:08:35.990697] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-03T19:08:36.048159] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-03T19:08:36.048248] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-03T19:08:36.049374] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-03T19:08:36.049597] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-03T19:08:36.051185] [DEBUG] [LOCAL ] GETY: Trimmed 55522 records to 36087 (keeping 200 days of data) [2025-10-03T19:08:36.265947] [DEBUG] [LOCAL ] GETY: Primary data saved (36087 records). [2025-10-03T19:08:36.266107] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-03T19:08:36.266199] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GETY took 35.4s. Estimated remaining: 3h 23m 18s. Rate: 7.1 symbols/min [2025-10-03T19:08:36.790713] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-03T19:08:37.197737] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-03T19:08:37.590763] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-03T19:08:38.068690] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T19:08:38.069405] [INFO ] [REMOTE ] GF: Full fetch complete (5155 records). [2025-10-03T19:08:38.069476] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-03T19:08:38.510260] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-03T19:08:38.510373] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-03T19:08:38.510585] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-03T19:08:38.510728] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-03T19:08:38.511559] [DEBUG] [LOCAL ] GF: Trimmed 5155 records to 2996 (keeping 200 days of data) [2025-10-03T19:08:38.574133] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-03T19:08:38.593144] [DEBUG] [LOCAL ] GF: Primary data saved (2996 records). [2025-10-03T19:08:38.593265] [INFO ] [MAIN ] GF: Full history saved. [2025-10-03T19:08:38.593418] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GF took 23.6s. Estimated remaining: 3h 22m 60s. Rate: 7.1 symbols/min [2025-10-03T19:08:38.593047] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-03T19:08:40.937386] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-03T19:08:40.950072] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-03T19:08:43.395989] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-10-03T19:08:43.419575] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-03T19:08:45.843060] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-10-03T19:08:45.855220] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-03T19:08:48.097244] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-03T19:08:48.100074] [INFO ] [REMOTE ] GEV: Full fetch complete (76913 records). [2025-10-03T19:08:48.100195] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-03T19:08:48.537559] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-03T19:08:48.537679] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-03T19:08:48.538903] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-03T19:08:48.538973] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-03T19:08:48.540600] [DEBUG] [LOCAL ] GEV: Trimmed 76913 records to 53810 (keeping 200 days of data) [2025-10-03T19:08:48.896869] [DEBUG] [LOCAL ] GEV: Primary data saved (53810 records). [2025-10-03T19:08:48.897017] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-03T19:08:48.897102] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 39.5s. Estimated remaining: 3h 22m 54s. Rate: 7.1 symbols/min [2025-10-03T19:08:49.646141] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.692976] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.635179] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.694681] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:08:49.710066] [DEBUG] [LOCAL ] GFR: Loaded 8355 existing records from primary storage. [2025-10-03T19:08:49.710532] [INFO ] [MAIN ] GFR: Loaded 8355 existing records. [2025-10-03T19:08:49.940548] [DEBUG] [LOCAL ] GFF: Loaded 30582 existing records from primary storage. [2025-10-03T19:08:49.966946] [INFO ] [MAIN ] GFF: Loaded 30582 existing records. [2025-10-03T19:08:49.966015] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.069919] [DEBUG] [LOCAL ] GFI: Loaded 53491 existing records from primary storage. [2025-10-03T19:08:50.068988] [DEBUG] [LOCAL ] GFL: Loaded 48290 existing records from primary storage. [2025-10-03T19:08:49.997282] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.085820] [INFO ] [MAIN ] GFL: Loaded 48290 existing records. [2025-10-03T19:08:50.096345] [INFO ] [MAIN ] GFI: Loaded 53491 existing records. [2025-10-03T19:08:50.108113] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-03T19:08:50.326291] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-03T19:08:50.348862] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-03T19:08:50.647076] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.676680] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.703989] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.697201] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:08:50.704250] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-03T19:08:50.704579] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.719887] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-03T19:08:50.720050] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-03T19:08:50.720164] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-03T19:08:50.720450] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-03T19:08:50.720381] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-03T19:08:50.742904] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-03T19:08:50.759728] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-03T19:08:50.770230] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-03T19:08:50.759821] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-03T19:08:51.961751] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.009077] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-03T19:08:52.125967] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.140125] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-03T19:08:52.196773] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.220017] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-03T19:08:52.245071] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:08:52.245579] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-03T19:08:52.810028] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:08:52.813816] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-03T19:08:53.070731] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T19:08:53.076948] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-03T19:08:53.313435] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-03T19:08:53.322902] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-03T19:08:53.559718] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:08:53.562244] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-03T19:08:53.811701] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:08:53.822837] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-03T19:08:54.286440] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:08:54.289144] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-03T19:08:54.491188] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:08:54.497940] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-03T19:08:54.816512] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:08:54.826445] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-03T19:08:55.155281] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-03T19:08:55.158635] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-03T19:08:55.303381] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:08:55.314442] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-03T19:08:55.535928] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:08:55.542822] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-03T19:08:55.650982] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T19:08:55.654546] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-03T19:08:56.174358] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:08:56.184872] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-03T19:08:56.414938] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:08:56.419895] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-03T19:08:56.445742] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:08:56.454021] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-03T19:08:57.016212] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:08:57.027347] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-03T19:08:57.159812] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:08:57.565710] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-03T19:08:57.603259] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-03T19:08:57.609996] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:08:58.224808] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-03T19:08:58.390681] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-03T19:08:58.853524] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:08:59.190739] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-03T19:08:59.995777] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-03T19:09:00.012852] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:09:00.649733] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T19:09:00.790717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-03T19:09:01.408379] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T19:09:01.458593] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-03T19:09:01.590724] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-03T19:09:02.390725] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-03T19:09:02.873002] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:09:02.920795] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:09:02.921828] [INFO ] [REMOTE ] GFR: Full fetch complete (12490 records). [2025-10-03T19:09:02.921903] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-03T19:09:03.195911] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-03T19:09:03.318191] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-03T19:09:03.318271] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-03T19:09:03.318578] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-03T19:09:03.318637] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-03T19:09:03.319162] [DEBUG] [LOCAL ] GFR: Trimmed 12490 records to 8439 (keeping 200 days of data) [2025-10-03T19:09:03.367505] [DEBUG] [LOCAL ] GFR: Primary data saved (8439 records). [2025-10-03T19:09:03.367691] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-03T19:09:03.367811] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 14.5s. Estimated remaining: 3h 22m 55s. Rate: 7.1 symbols/min [2025-10-03T19:09:03.552946] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:03.614885] [DEBUG] [LOCAL ] GGB: Loaded 51478 existing records from primary storage. [2025-10-03T19:09:03.615281] [INFO ] [MAIN ] GGB: Loaded 51478 existing records. [2025-10-03T19:09:03.809300] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:03.809551] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-03T19:09:03.809599] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-03T19:09:03.810121] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-03T19:09:03.810183] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-03T19:09:04.001437] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-03T19:09:04.203720] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:04.790630] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-03T19:09:04.839103] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:09:05.305063] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:09:05.590742] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-03T19:09:06.390708] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-03T19:09:06.633105] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:09:06.811616] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T19:09:07.190701] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-03T19:09:07.990674] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-03T19:09:08.126722] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:09:08.539083] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T19:09:08.790733] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-03T19:09:09.590625] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-03T19:09:10.068095] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:09:10.124272] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-03T19:09:10.390702] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-03T19:09:11.190632] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-03T19:09:11.303075] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:09:11.899125] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:09:11.990689] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-03T19:09:12.790621] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-03T19:09:12.910463] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:09:13.471285] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-03T19:09:13.590708] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-03T19:09:14.269318] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:09:14.390743] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-03T19:09:15.190908] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-03T19:09:15.245744] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:09:15.879251] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:09:15.990722] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-03T19:09:16.371307] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-03T19:09:16.790733] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-03T19:09:17.590674] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-03T19:09:17.799247] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:09:17.802941] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:09:17.814615] [INFO ] [REMOTE ] GFF: Full fetch complete (44237 records). [2025-10-03T19:09:17.815233] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-03T19:09:18.248290] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-03T19:09:18.248455] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-03T19:09:18.249224] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-03T19:09:18.249291] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-03T19:09:18.250316] [DEBUG] [LOCAL ] GFF: Trimmed 44237 records to 30788 (keeping 200 days of data) [2025-10-03T19:09:18.423526] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-03T19:09:18.469074] [DEBUG] [LOCAL ] GFF: Primary data saved (30788 records). [2025-10-03T19:09:18.469251] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-03T19:09:18.469395] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GFF took 29.6s. Estimated remaining: 3h 22m 58s. Rate: 7.1 symbols/min [2025-10-03T19:09:18.650458] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:18.690887] [DEBUG] [LOCAL ] GGG: Loaded 41247 existing records from primary storage. [2025-10-03T19:09:18.691232] [INFO ] [MAIN ] GGG: Loaded 41247 existing records. [2025-10-03T19:09:18.883917] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:18.884327] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-03T19:09:18.884388] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-03T19:09:18.884732] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-03T19:09:18.884792] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-03T19:09:19.089367] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-03T19:09:19.200453] [INFO ] [REMOTE ] GFL: Full fetch complete (69258 records). [2025-10-03T19:09:19.200050] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-03T19:09:19.205549] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-03T19:09:19.401852] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:19.739456] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-03T19:09:19.739555] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-03T19:09:19.740549] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-03T19:09:19.740619] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-03T19:09:19.742290] [DEBUG] [LOCAL ] GFL: Trimmed 69258 records to 48679 (keeping 200 days of data) [2025-10-03T19:09:19.990678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-03T19:09:20.051408] [DEBUG] [LOCAL ] GFL: Primary data saved (48679 records). [2025-10-03T19:09:20.051579] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-03T19:09:20.051742] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 31.2s. Estimated remaining: 3h 22m 38s. Rate: 7.1 symbols/min [2025-10-03T19:09:20.244557] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:20.262299] [DEBUG] [LOCAL ] GGT: Loaded 14175 existing records from primary storage. [2025-10-03T19:09:20.262555] [INFO ] [MAIN ] GGT: Loaded 14175 existing records. [2025-10-03T19:09:20.498857] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:20.502311] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-03T19:09:20.502393] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-03T19:09:20.502064] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T19:09:20.513515] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-03T19:09:20.514038] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-03T19:09:20.796882] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-03T19:09:20.912751] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:21.363633] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-10-03T19:09:21.406036] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:09:21.590718] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-03T19:09:22.390735] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-03T19:09:22.560216] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:09:23.190676] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-03T19:09:23.493414] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:09:23.496295] [INFO ] [REMOTE ] GFI: Full fetch complete (76435 records). [2025-10-03T19:09:23.496444] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-03T19:09:23.920587] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-03T19:09:23.920722] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-03T19:09:23.921720] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-03T19:09:23.921814] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-03T19:09:23.949346] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:09:23.949539] [DEBUG] [LOCAL ] GFI: Trimmed 76435 records to 53875 (keeping 200 days of data) [2025-10-03T19:09:24.024888] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-03T19:09:24.323786] [DEBUG] [LOCAL ] GFI: Primary data saved (53875 records). [2025-10-03T19:09:24.323947] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-03T19:09:24.324053] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 35.4s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-03T19:09:24.517059] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:24.517277] [DEBUG] [LOCAL ] GGZ: No existing data file found in primary storage. [2025-10-03T19:09:24.517324] [WARN ] [MAIN ] GGZ: No existing data found, performing full refresh instead. [2025-10-03T19:09:24.517439] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-03T19:09:24.517487] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-03T19:09:24.517531] [DEBUG] [LOCAL ] GGZ: No primary data file found to delete. [2025-10-03T19:09:24.517622] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-03T19:09:24.797018] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-03T19:09:24.814586] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:09:24.934976] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:09:24.983763] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:25.590698] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-03T19:09:26.395804] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-03T19:09:26.416084] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:09:26.998814] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T19:09:27.190676] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-03T19:09:27.482006] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:09:27.732898] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:09:27.990677] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-03T19:09:28.790697] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-03T19:09:29.468833] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-03T19:09:29.529011] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:09:29.590692] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-03T19:09:30.390630] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-03T19:09:30.824213] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T19:09:31.041269] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:09:31.190728] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-03T19:09:31.626007] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T19:09:31.990715] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-03T19:09:32.790713] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-03T19:09:33.590634] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-03T19:09:33.630142] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:09:34.044882] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T19:09:34.251783] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:09:34.390711] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-03T19:09:35.190714] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-03T19:09:35.224622] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T19:09:35.990729] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-03T19:09:36.524366] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:09:36.680662] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T19:09:36.683482] [INFO ] [REMOTE ] GGB: Full fetch complete (74084 records). [2025-10-03T19:09:36.683621] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-03T19:09:36.795768] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-03T19:09:37.141151] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-03T19:09:37.141245] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-03T19:09:37.142286] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-03T19:09:37.142359] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-03T19:09:37.144377] [DEBUG] [LOCAL ] GGB: Trimmed 74084 records to 51859 (keeping 200 days of data) [2025-10-03T19:09:37.476254] [DEBUG] [LOCAL ] GGB: Primary data saved (51859 records). [2025-10-03T19:09:37.476413] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-03T19:09:37.476545] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGB took 34.1s. Estimated remaining: 3h 22m 23s. Rate: 7.1 symbols/min [2025-10-03T19:09:37.593021] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-03T19:09:37.671179] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:37.676916] [DEBUG] [LOCAL ] GHC: Loaded 2690 existing records from primary storage. [2025-10-03T19:09:37.677108] [INFO ] [MAIN ] GHC: Loaded 2690 existing records. [2025-10-03T19:09:37.883151] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:37.891668] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-03T19:09:37.891762] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-03T19:09:37.892921] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-03T19:09:37.892853] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:09:37.893060] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-03T19:09:38.296069] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:38.390669] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-03T19:09:39.006755] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:09:39.039491] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:09:39.190715] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-03T19:09:39.748281] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:09:39.990688] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-03T19:09:40.790709] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-03T19:09:40.987738] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:09:41.590710] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-03T19:09:41.845369] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-03T19:09:42.390716] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-03T19:09:42.550126] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:09:42.826853] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:09:43.190722] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-03T19:09:43.681171] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T19:09:43.990719] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-03T19:09:44.492501] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T19:09:44.790669] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-03T19:09:45.285059] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-03T19:09:45.590740] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-03T19:09:46.036874] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:09:46.390681] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-03T19:09:47.190685] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-03T19:09:47.836773] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:09:47.990621] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-03T19:09:48.152846] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:09:48.370580] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T19:09:48.790670] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-03T19:09:49.241297] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:09:49.590712] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-03T19:09:50.390678] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-03T19:09:50.446260] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:09:51.190726] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-03T19:09:51.647165] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-03T19:09:51.857428] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T19:09:51.990707] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-03T19:09:52.790696] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-03T19:09:53.163414] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-03T19:09:53.164227] [INFO ] [REMOTE ] GGZ: Full fetch complete (4150 records). [2025-10-03T19:09:53.164304] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-03T19:09:53.487479] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:09:53.579873] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-03T19:09:53.579957] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-03T19:09:53.580093] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-03T19:09:53.580133] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-03T19:09:53.580530] [DEBUG] [LOCAL ] GGZ: Trimmed 4150 records to 2447 (keeping 200 days of data) [2025-10-03T19:09:53.592246] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-03T19:09:53.599443] [DEBUG] [LOCAL ] GGZ: Primary data saved (2447 records). [2025-10-03T19:09:53.599557] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-03T19:09:53.599670] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGZ took 29.3s. Estimated remaining: 3h 22m 26s. Rate: 7.1 symbols/min [2025-10-03T19:09:53.799521] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:53.805884] [DEBUG] [LOCAL ] GHG: Loaded 3197 existing records from primary storage. [2025-10-03T19:09:53.806104] [INFO ] [MAIN ] GHG: Loaded 3197 existing records. [2025-10-03T19:09:53.997434] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:53.997676] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-03T19:09:53.997738] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-03T19:09:53.997969] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-03T19:09:53.998030] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-03T19:09:54.397868] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:54.397976] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-03T19:09:54.604077] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:09:54.914877] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-03T19:09:55.190723] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-03T19:09:55.777732] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:09:55.990747] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-03T19:09:56.790717] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-03T19:09:57.151966] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T19:09:57.154211] [INFO ] [REMOTE ] GGG: Full fetch complete (59407 records). [2025-10-03T19:09:57.154332] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-03T19:09:57.268696] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:09:57.580969] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-03T19:09:57.581084] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-03T19:09:57.581866] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-03T19:09:57.581946] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-03T19:09:57.583203] [DEBUG] [LOCAL ] GGG: Trimmed 59407 records to 41546 (keeping 200 days of data) [2025-10-03T19:09:57.640866] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-03T19:09:57.854891] [DEBUG] [LOCAL ] GGG: Primary data saved (41546 records). [2025-10-03T19:09:57.855020] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-03T19:09:57.856133] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGG took 39.4s. Estimated remaining: 3h 22m 11s. Rate: 7.1 symbols/min [2025-10-03T19:09:58.043375] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:09:58.055041] [DEBUG] [LOCAL ] GHI: Loaded 7089 existing records from primary storage. [2025-10-03T19:09:58.057462] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:09:58.058927] [INFO ] [MAIN ] GHI: Loaded 7089 existing records. [2025-10-03T19:09:58.247225] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:09:58.247483] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-03T19:09:58.247536] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-03T19:09:58.247775] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-03T19:09:58.247867] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-03T19:09:58.395739] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-03T19:09:58.624826] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:09:58.872872] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-03T19:09:59.190765] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-03T19:09:59.990636] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-03T19:10:00.122540] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:10:00.456719] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-03T19:10:00.790690] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-03T19:10:01.516711] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:10:01.590735] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-03T19:10:02.390738] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-03T19:10:02.441945] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:10:03.011522] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-03T19:10:03.190702] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-03T19:10:03.759173] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T19:10:03.990702] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-03T19:10:04.771758] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-03T19:10:04.790691] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-03T19:10:05.590632] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-03T19:10:05.666964] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:10:06.178105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:10:06.390738] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-03T19:10:07.182739] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T19:10:07.184035] [INFO ] [REMOTE ] GGT: Full fetch complete (18813 records). [2025-10-03T19:10:07.184112] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-03T19:10:07.195817] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-03T19:10:07.588704] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-03T19:10:07.588788] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-03T19:10:07.589236] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-03T19:10:07.589304] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-03T19:10:07.589994] [DEBUG] [LOCAL ] GGT: Trimmed 18813 records to 14275 (keeping 200 days of data) [2025-10-03T19:10:07.681240] [DEBUG] [LOCAL ] GGT: Primary data saved (14275 records). [2025-10-03T19:10:07.681389] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-03T19:10:07.681478] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GGT took 47.6s. Estimated remaining: 3h 22m 5s. Rate: 7.1 symbols/min [2025-10-03T19:10:07.868860] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:07.869078] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:10:07.870957] [INFO ] [REMOTE ] GHC: Full fetch complete (3380 records). [2025-10-03T19:10:07.871179] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-03T19:10:07.963948] [DEBUG] [LOCAL ] GHLD: Loaded 4203 existing records from primary storage. [2025-10-03T19:10:07.994486] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-03T19:10:07.984601] [INFO ] [MAIN ] GHLD: Loaded 4203 existing records. [2025-10-03T19:10:08.382718] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:08.400493] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-03T19:10:08.424991] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-03T19:10:08.429573] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-03T19:10:08.435063] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-03T19:10:08.642584] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-03T19:10:08.653983] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-03T19:10:08.670161] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-03T19:10:08.702087] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-03T19:10:08.736477] [DEBUG] [LOCAL ] GHC: Trimmed 3380 records to 2749 (keeping 200 days of data) [2025-10-03T19:10:08.794541] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-03T19:10:08.821517] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-03T19:10:08.867409] [DEBUG] [LOCAL ] GHC: Primary data saved (2749 records). [2025-10-03T19:10:08.875732] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-03T19:10:08.875911] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHC took 31.4s. Estimated remaining: 3h 21m 46s. Rate: 7.1 symbols/min [2025-10-03T19:10:09.143363] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:09.179207] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:09.196320] [DEBUG] [LOCAL ] GHM: Loaded 14163 existing records from primary storage. [2025-10-03T19:10:09.196568] [INFO ] [MAIN ] GHM: Loaded 14163 existing records. [2025-10-03T19:10:09.310448] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T19:10:09.397314] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:09.397566] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-03T19:10:09.397624] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-03T19:10:09.397865] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-03T19:10:09.397966] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-03T19:10:09.596173] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-03T19:10:09.823190] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:10.390671] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-03T19:10:10.430509] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T19:10:10.929512] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-03T19:10:11.190688] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-03T19:10:11.607443] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T19:10:11.990684] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-03T19:10:12.790636] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-03T19:10:12.867507] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-03T19:10:13.460232] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T19:10:13.590697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-03T19:10:14.014190] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-03T19:10:14.390750] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-03T19:10:14.871980] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T19:10:15.190727] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-03T19:10:15.826554] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-03T19:10:15.990694] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-03T19:10:16.541545] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:10:16.542426] [INFO ] [REMOTE ] GHG: Full fetch complete (4054 records). [2025-10-03T19:10:16.542517] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-03T19:10:16.795812] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-03T19:10:16.971623] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-03T19:10:16.971735] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-03T19:10:16.971885] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-03T19:10:16.971927] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-03T19:10:16.972310] [DEBUG] [LOCAL ] GHG: Trimmed 4054 records to 3234 (keeping 200 days of data) [2025-10-03T19:10:16.990547] [DEBUG] [LOCAL ] GHG: Primary data saved (3234 records). [2025-10-03T19:10:16.990634] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-03T19:10:16.990757] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHG took 23.4s. Estimated remaining: 3h 21m 37s. Rate: 7.1 symbols/min [2025-10-03T19:10:17.186913] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:17.208873] [DEBUG] [LOCAL ] GHY: Loaded 20989 existing records from primary storage. [2025-10-03T19:10:17.209170] [INFO ] [MAIN ] GHY: Loaded 20989 existing records. [2025-10-03T19:10:17.402701] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:17.403028] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-03T19:10:17.403148] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-03T19:10:17.403961] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-03T19:10:17.404025] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-03T19:10:17.533715] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:10:17.591866] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-03T19:10:17.838851] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:18.003990] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-03T19:10:18.390739] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-03T19:10:19.158561] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:10:19.190623] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-03T19:10:19.904425] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T19:10:19.990678] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-03T19:10:20.663585] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-03T19:10:20.790689] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-03T19:10:21.375223] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-03T19:10:21.376304] [INFO ] [REMOTE ] GHI: Full fetch complete (11625 records). [2025-10-03T19:10:21.376376] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-03T19:10:21.597441] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-03T19:10:21.777315] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-03T19:10:21.777437] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-03T19:10:21.777798] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-03T19:10:21.777864] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-03T19:10:21.778638] [DEBUG] [LOCAL ] GHI: Trimmed 11625 records to 7159 (keeping 200 days of data) [2025-10-03T19:10:21.828971] [DEBUG] [LOCAL ] GHI: Primary data saved (7159 records). [2025-10-03T19:10:21.829128] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-03T19:10:21.829221] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHI took 24.0s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-03T19:10:22.028189] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:22.067315] [DEBUG] [LOCAL ] GIB: Loaded 32317 existing records from primary storage. [2025-10-03T19:10:22.067716] [INFO ] [MAIN ] GIB: Loaded 32317 existing records. [2025-10-03T19:10:22.301498] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:22.301779] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-03T19:10:22.301841] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-03T19:10:22.303167] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-03T19:10:22.303232] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-03T19:10:22.395805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-03T19:10:22.726571] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:22.740232] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T19:10:22.908281] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T19:10:23.190701] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-03T19:10:23.990685] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-03T19:10:24.285545] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:10:24.467584] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T19:10:24.790689] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-03T19:10:25.045843] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-03T19:10:25.590697] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-03T19:10:26.172192] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T19:10:26.390688] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-03T19:10:27.190704] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-03T19:10:27.650193] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:10:27.766822] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-03T19:10:27.990677] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-03T19:10:28.790671] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-03T19:10:29.032515] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:10:29.185286] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-03T19:10:29.590693] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-03T19:10:30.390711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-03T19:10:30.488709] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-03T19:10:31.190712] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-03T19:10:31.678329] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:10:31.990737] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-03T19:10:32.221453] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:10:32.796721] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-03T19:10:32.799097] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:10:33.590712] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-03T19:10:33.829956] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:10:34.196000] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T19:10:34.390709] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-03T19:10:35.190736] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-03T19:10:35.380268] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:10:35.990625] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-03T19:10:36.316056] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:10:36.790692] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-03T19:10:36.837669] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:10:37.590708] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-03T19:10:37.790713] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:10:38.390707] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-03T19:10:39.042033] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T19:10:39.068121] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:10:39.190716] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-03T19:10:39.778553] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:10:39.779404] [INFO ] [REMOTE ] GHLD: Full fetch complete (4808 records). [2025-10-03T19:10:39.779480] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-03T19:10:39.997919] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-03T19:10:40.187842] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-03T19:10:40.188137] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-03T19:10:40.188346] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-03T19:10:40.188410] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-03T19:10:40.188950] [DEBUG] [LOCAL ] GHLD: Trimmed 4808 records to 4227 (keeping 200 days of data) [2025-10-03T19:10:40.219725] [DEBUG] [LOCAL ] GHLD: Primary data saved (4227 records). [2025-10-03T19:10:40.219862] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-03T19:10:40.219999] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHLD took 32.5s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-03T19:10:40.406905] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:40.422831] [DEBUG] [LOCAL ] GIC: Loaded 13577 existing records from primary storage. [2025-10-03T19:10:40.423114] [INFO ] [MAIN ] GIC: Loaded 13577 existing records. [2025-10-03T19:10:40.626978] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:40.627247] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-03T19:10:40.627299] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-03T19:10:40.627917] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-03T19:10:40.627980] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-03T19:10:40.790764] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-03T19:10:41.040706] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-03T19:10:41.047482] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:41.590708] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-03T19:10:41.884671] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:10:42.390737] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-03T19:10:42.559538] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:10:43.190731] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-03T19:10:43.355391] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:10:43.990680] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-03T19:10:44.141450] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:10:44.790701] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-03T19:10:44.962728] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:10:45.590707] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-03T19:10:45.635635] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T19:10:46.390696] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-03T19:10:46.530458] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-03T19:10:47.190634] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-03T19:10:47.337039] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:10:47.990699] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-03T19:10:48.635412] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:10:48.790698] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-03T19:10:48.824212] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:10:48.826020] [INFO ] [REMOTE ] GHY: Full fetch complete (32283 records). [2025-10-03T19:10:48.826103] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-03T19:10:49.264359] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-03T19:10:49.264449] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-03T19:10:49.265076] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-03T19:10:49.265147] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-03T19:10:49.266059] [DEBUG] [LOCAL ] GHY: Trimmed 32283 records to 21190 (keeping 200 days of data) [2025-10-03T19:10:49.404511] [DEBUG] [LOCAL ] GHY: Primary data saved (21190 records). [2025-10-03T19:10:49.404673] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-03T19:10:49.404796] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GHY took 32.4s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-03T19:10:49.594490] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-03T19:10:49.594411] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:49.639886] [DEBUG] [LOCAL ] GIL: Loaded 43689 existing records from primary storage. [2025-10-03T19:10:49.640309] [INFO ] [MAIN ] GIL: Loaded 43689 existing records. [2025-10-03T19:10:49.840837] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:49.851607] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-03T19:10:49.851763] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-03T19:10:49.852919] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:10:49.857538] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-03T19:10:49.857682] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-03T19:10:50.244250] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:50.390682] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-03T19:10:50.593900] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-03T19:10:51.190733] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-03T19:10:51.203392] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:10:51.990674] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-03T19:10:52.380115] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:10:52.550949] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T19:10:52.790720] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-03T19:10:53.590738] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-03T19:10:54.015740] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:10:54.390695] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-03T19:10:54.535426] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:10:55.190683] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-03T19:10:55.687125] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:10:55.990758] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-03T19:10:56.004137] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:10:56.790720] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-03T19:10:57.501077] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:10:57.519468] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T19:10:57.520631] [INFO ] [REMOTE ] GHM: Full fetch complete (21801 records). [2025-10-03T19:10:57.520748] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-03T19:10:57.595864] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-03T19:10:57.928471] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-03T19:10:57.928554] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-03T19:10:57.929263] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-03T19:10:57.929341] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-03T19:10:57.930039] [DEBUG] [LOCAL ] GHM: Trimmed 21801 records to 14245 (keeping 200 days of data) [2025-10-03T19:10:58.016129] [DEBUG] [LOCAL ] GHM: Primary data saved (14245 records). [2025-10-03T19:10:58.016297] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-03T19:10:58.016482] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GHM took 49.1s. Estimated remaining: 3h 21m 14s. Rate: 7.1 symbols/min [2025-10-03T19:10:58.194635] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:10:58.251247] [DEBUG] [LOCAL ] GIS: Loaded 54062 existing records from primary storage. [2025-10-03T19:10:58.251631] [INFO ] [MAIN ] GIS: Loaded 54062 existing records. [2025-10-03T19:10:58.399942] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-03T19:10:58.446329] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:10:58.446576] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-03T19:10:58.446626] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-03T19:10:58.449659] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-03T19:10:58.449781] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-03T19:10:58.843742] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:10:58.950026] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-03T19:10:59.190708] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-03T19:10:59.334788] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-03T19:10:59.990712] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-03T19:11:00.790701] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-03T19:11:00.943600] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:11:01.186019] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:11:01.590715] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-03T19:11:02.309394] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-03T19:11:02.354978] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:11:02.390713] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-03T19:11:03.190741] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-03T19:11:03.816079] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:11:03.817197] [INFO ] [REMOTE ] GIC: Full fetch complete (20159 records). [2025-10-03T19:11:03.817281] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-03T19:11:03.993539] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-03T19:11:04.292973] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-03T19:11:04.293245] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-03T19:11:04.294012] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-03T19:11:04.294433] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-03T19:11:04.296588] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-03T19:11:04.308830] [DEBUG] [LOCAL ] GIC: Trimmed 20159 records to 13632 (keeping 200 days of data) [2025-10-03T19:11:04.397409] [DEBUG] [LOCAL ] GIC: Primary data saved (13632 records). [2025-10-03T19:11:04.397561] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-03T19:11:04.397692] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GIC took 24.2s. Estimated remaining: 3h 21m 3s. Rate: 7.1 symbols/min [2025-10-03T19:11:04.585464] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:04.630009] [DEBUG] [LOCAL ] GKOS: Loaded 42984 existing records from primary storage. [2025-10-03T19:11:04.630334] [INFO ] [MAIN ] GKOS: Loaded 42984 existing records. [2025-10-03T19:11:04.795811] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-03T19:11:04.826496] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:04.827842] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-03T19:11:04.827939] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-03T19:11:04.829197] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-03T19:11:04.829264] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-03T19:11:05.235771] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:05.459715] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-03T19:11:05.590700] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-03T19:11:06.390678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-03T19:11:06.498509] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:11:07.031945] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:11:07.190748] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-03T19:11:07.830238] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T19:11:07.990737] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-03T19:11:08.579893] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:11:08.790714] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-03T19:11:09.590686] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-03T19:11:09.784485] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:11:09.972926] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:11:09.974894] [INFO ] [REMOTE ] GIB: Full fetch complete (45738 records). [2025-10-03T19:11:09.974991] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-03T19:11:10.383185] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-03T19:11:10.383276] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-03T19:11:10.384014] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-03T19:11:10.384083] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-03T19:11:10.385216] [DEBUG] [LOCAL ] GIB: Trimmed 45738 records to 32516 (keeping 200 days of data) [2025-10-03T19:11:10.390702] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-03T19:11:10.615258] [DEBUG] [LOCAL ] GIB: Primary data saved (32516 records). [2025-10-03T19:11:10.615428] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-03T19:11:10.617773] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIB took 48.8s. Estimated remaining: 3h 20m 51s. Rate: 7.1 symbols/min [2025-10-03T19:11:10.796626] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:10.841626] [DEBUG] [LOCAL ] GL: Loaded 38054 existing records from primary storage. [2025-10-03T19:11:10.841990] [INFO ] [MAIN ] GL: Loaded 38054 existing records. [2025-10-03T19:11:11.032812] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:11.033169] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-03T19:11:11.033220] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-03T19:11:11.034436] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-03T19:11:11.034499] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-03T19:11:11.201357] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-03T19:11:11.440792] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:11.471863] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:11:11.960094] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T19:11:11.990627] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-03T19:11:12.653519] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:11:12.790730] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-03T19:11:13.556973] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:11:13.590690] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-03T19:11:14.390675] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-03T19:11:14.676550] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:11:14.923259] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:11:15.190694] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-03T19:11:15.893844] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-03T19:11:15.990697] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-03T19:11:16.262729] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:11:16.790693] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-03T19:11:17.410169] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:11:17.590700] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-03T19:11:18.319607] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:11:18.390716] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-03T19:11:18.900838] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:11:19.190730] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-03T19:11:19.990704] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-03T19:11:20.282660] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:11:20.706296] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:11:20.790678] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-03T19:11:21.590707] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-03T19:11:21.656231] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:11:22.225363] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:11:22.390691] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-03T19:11:23.190667] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-03T19:11:23.243572] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:11:23.713296] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:11:23.990694] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-03T19:11:24.790686] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-03T19:11:24.997975] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:11:25.038228] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T19:11:25.590679] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-03T19:11:25.870398] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-03T19:11:26.390704] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-03T19:11:26.955667] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:11:27.190699] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-03T19:11:27.352368] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:11:27.355133] [INFO ] [REMOTE ] GIL: Full fetch complete (61556 records). [2025-10-03T19:11:27.355287] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-03T19:11:27.814352] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-03T19:11:27.814452] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-03T19:11:27.815267] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-03T19:11:27.815335] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-03T19:11:27.816700] [DEBUG] [LOCAL ] GIL: Trimmed 61556 records to 44048 (keeping 200 days of data) [2025-10-03T19:11:27.995925] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-03T19:11:28.096685] [DEBUG] [LOCAL ] GIL: Primary data saved (44048 records). [2025-10-03T19:11:28.096837] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-03T19:11:28.096935] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GIL took 38.7s. Estimated remaining: 3h 20m 57s. Rate: 7.1 symbols/min [2025-10-03T19:11:28.287328] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:28.332822] [DEBUG] [LOCAL ] GLOB: Loaded 47963 existing records from primary storage. [2025-10-03T19:11:28.333160] [INFO ] [MAIN ] GLOB: Loaded 47963 existing records. [2025-10-03T19:11:28.539201] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:28.539420] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-03T19:11:28.539469] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-03T19:11:28.541333] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-03T19:11:28.541398] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-03T19:11:28.795362] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-03T19:11:28.980858] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:29.052233] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:11:29.089484] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-03T19:11:29.590730] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-03T19:11:30.079541] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:11:30.082016] [INFO ] [REMOTE ] GKOS: Full fetch complete (60060 records). [2025-10-03T19:11:30.082133] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-03T19:11:30.395757] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-03T19:11:30.510867] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-03T19:11:30.510957] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-03T19:11:30.511785] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-03T19:11:30.511908] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-03T19:11:30.513332] [DEBUG] [LOCAL ] GKOS: Trimmed 60060 records to 43313 (keeping 200 days of data) [2025-10-03T19:11:30.799730] [DEBUG] [LOCAL ] GKOS: Primary data saved (43313 records). [2025-10-03T19:11:30.799863] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-03T19:11:30.799967] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GKOS took 26.4s. Estimated remaining: 3h 20m 40s. Rate: 7.1 symbols/min [2025-10-03T19:11:30.940416] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:11:31.012048] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:31.012246] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-10-03T19:11:31.012286] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-10-03T19:11:31.012428] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-03T19:11:31.012497] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-03T19:11:31.012557] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-10-03T19:11:31.012594] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-03T19:11:31.206589] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-03T19:11:31.421114] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:31.767732] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:11:31.770905] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-03T19:11:31.771075] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-03T19:11:31.999882] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-03T19:11:32.207704] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-03T19:11:32.207807] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-03T19:11:32.208820] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-03T19:11:32.208918] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-03T19:11:32.210676] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54452 (keeping 200 days of data) [2025-10-03T19:11:32.340392] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:11:32.609684] [DEBUG] [LOCAL ] GIS: Primary data saved (54452 records). [2025-10-03T19:11:32.610139] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-03T19:11:32.610331] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GIS took 34.6s. Estimated remaining: 3h 20m 21s. Rate: 7.1 symbols/min [2025-10-03T19:11:32.797715] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-03T19:11:32.802222] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:32.856538] [DEBUG] [LOCAL ] GLW: Loaded 54026 existing records from primary storage. [2025-10-03T19:11:32.856994] [INFO ] [MAIN ] GLW: Loaded 54026 existing records. [2025-10-03T19:11:32.992050] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T19:11:33.088282] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:33.088670] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-03T19:11:33.088746] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-03T19:11:33.089099] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-03T19:11:33.089158] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-03T19:11:33.468562] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:33.590703] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-03T19:11:34.346971] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:11:34.390697] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-03T19:11:35.190675] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-03T19:11:35.454491] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:11:35.820564] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:11:35.990740] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-03T19:11:36.575974] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:11:36.790676] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-03T19:11:37.471678] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T19:11:37.590729] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-03T19:11:38.308840] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:11:38.390733] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-03T19:11:38.869334] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-03T19:11:39.190705] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-03T19:11:39.947886] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-03T19:11:39.990715] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-03T19:11:40.025772] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:11:40.790709] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-03T19:11:41.590709] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-03T19:11:41.867136] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:11:42.099191] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:11:42.207594] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:11:42.390729] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-03T19:11:43.136251] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:11:43.190705] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-03T19:11:43.990749] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-03T19:11:44.738811] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:11:44.790721] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-03T19:11:45.590699] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-03T19:11:45.696243] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:11:46.247745] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:11:46.390689] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-03T19:11:46.984450] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:11:47.190723] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-03T19:11:47.990704] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-03T19:11:48.039621] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:11:48.380917] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-03T19:11:48.790715] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-03T19:11:49.429969] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:11:49.590695] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-03T19:11:50.390721] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-03T19:11:50.769678] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-03T19:11:50.769450] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:11:50.783827] [INFO ] [REMOTE ] GL: Full fetch complete (55387 records). [2025-10-03T19:11:50.784020] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-03T19:11:51.197252] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-03T19:11:51.224881] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:11:51.231709] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-03T19:11:51.231812] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-03T19:11:51.232852] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-03T19:11:51.232924] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-03T19:11:51.236782] [DEBUG] [LOCAL ] GL: Trimmed 55387 records to 38326 (keeping 200 days of data) [2025-10-03T19:11:51.503434] [DEBUG] [LOCAL ] GL: Primary data saved (38326 records). [2025-10-03T19:11:51.503589] [INFO ] [MAIN ] GL: Full history saved. [2025-10-03T19:11:51.504408] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GL took 40.9s. Estimated remaining: 3h 20m 29s. Rate: 7.1 symbols/min [2025-10-03T19:11:51.734537] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:11:51.796867] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-10-03T19:11:51.797234] [INFO ] [MAIN ] GM: Loaded 54118 existing records. [2025-10-03T19:11:51.991789] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-03T19:11:51.995882] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:11:51.997317] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-03T19:11:51.997372] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-03T19:11:51.997839] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-03T19:11:51.997990] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-03T19:11:52.391349] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:11:52.741750] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:11:52.790625] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-03T19:11:53.590639] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-03T19:11:54.069792] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-03T19:11:54.336732] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:11:54.363746] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:11:54.390701] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-03T19:11:55.016022] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:11:55.190713] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-03T19:11:55.990734] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-03T19:11:56.774057] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:11:56.790606] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-03T19:11:57.590689] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-03T19:11:57.863035] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:11:58.024679] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T19:11:58.390667] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-03T19:11:58.646557] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:11:59.190725] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-03T19:11:59.990857] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-03T19:12:00.289585] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:12:00.791423] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-03T19:12:00.799288] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:12:01.079455] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:12:01.590719] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-03T19:12:02.374501] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:12:02.375532] [INFO ] [REMOTE ] GLP: Full fetch complete (14287 records). [2025-10-03T19:12:02.375611] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-03T19:12:02.398763] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-03T19:12:02.816825] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-03T19:12:02.817077] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-03T19:12:02.817460] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-03T19:12:02.817532] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-03T19:12:02.818606] [DEBUG] [LOCAL ] GLP: Trimmed 14287 records to 9445 (keeping 200 days of data) [2025-10-03T19:12:02.906899] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-03T19:12:02.929681] [DEBUG] [LOCAL ] GLP: Primary data saved (9445 records). [2025-10-03T19:12:02.929839] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-03T19:12:02.929945] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GLP took 32.1s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-10-03T19:12:03.127808] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:03.190624] [DEBUG] [LOCAL ] GME: Loaded 54152 existing records from primary storage. [2025-10-03T19:12:03.190750] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-03T19:12:03.192228] [INFO ] [MAIN ] GME: Loaded 54152 existing records. [2025-10-03T19:12:03.400537] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:03.400800] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-03T19:12:03.400856] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-03T19:12:03.402612] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-03T19:12:03.402703] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-03T19:12:03.808405] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:03.990689] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-03T19:12:04.125936] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:12:04.790697] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-03T19:12:05.285051] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:12:05.590734] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-03T19:12:06.384357] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-03T19:12:06.395926] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-03T19:12:06.562572] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:12:07.190756] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-03T19:12:07.199123] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-03T19:12:07.204385] [INFO ] [REMOTE ] GLOB: Full fetch complete (64350 records). [2025-10-03T19:12:07.204560] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-03T19:12:07.653486] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-03T19:12:07.653574] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-03T19:12:07.654434] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-03T19:12:07.654503] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-03T19:12:07.656394] [DEBUG] [LOCAL ] GLOB: Trimmed 64350 records to 48346 (keeping 200 days of data) [2025-10-03T19:12:07.974867] [DEBUG] [LOCAL ] GLOB: Primary data saved (48346 records). [2025-10-03T19:12:07.975021] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-03T19:12:07.975164] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GLOB took 39.9s. Estimated remaining: 3h 20m 11s. Rate: 7.1 symbols/min [2025-10-03T19:12:08.009308] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-03T19:12:08.179549] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:08.228216] [DEBUG] [LOCAL ] GMED: Loaded 48729 existing records from primary storage. [2025-10-03T19:12:08.228639] [INFO ] [MAIN ] GMED: Loaded 48729 existing records. [2025-10-03T19:12:08.433630] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:08.434243] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-03T19:12:08.434309] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-03T19:12:08.435958] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-03T19:12:08.436040] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-03T19:12:08.757090] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-03T19:12:08.826954] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-03T19:12:08.889413] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:09.518516] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T19:12:09.590705] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-03T19:12:09.965442] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:12:10.390695] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-03T19:12:10.975145] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-03T19:12:10.978929] [INFO ] [REMOTE ] GLW: Full fetch complete (77618 records). [2025-10-03T19:12:10.979086] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-03T19:12:11.204120] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-03T19:12:11.433529] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-03T19:12:11.433915] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-03T19:12:11.435013] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-03T19:12:11.435181] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-03T19:12:11.437107] [DEBUG] [LOCAL ] GLW: Trimmed 77618 records to 54416 (keeping 200 days of data) [2025-10-03T19:12:11.704200] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:12:11.753813] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-03T19:12:11.887986] [DEBUG] [LOCAL ] GLW: Primary data saved (54416 records). [2025-10-03T19:12:11.888146] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-03T19:12:11.888286] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLW took 39.3s. Estimated remaining: 3h 19m 56s. Rate: 7.1 symbols/min [2025-10-03T19:12:11.995850] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-03T19:12:12.080403] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:12.118277] [DEBUG] [LOCAL ] GMRE: Loaded 37572 existing records from primary storage. [2025-10-03T19:12:12.118623] [INFO ] [MAIN ] GMRE: Loaded 37572 existing records. [2025-10-03T19:12:12.326959] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:12.327195] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-03T19:12:12.327244] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-03T19:12:12.327532] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-03T19:12:12.327592] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-03T19:12:12.727429] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:12.790680] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-03T19:12:13.319558] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-03T19:12:13.590681] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-03T19:12:14.059521] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:12:14.390673] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-03T19:12:14.644463] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-10-03T19:12:15.073274] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:12:15.190704] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-03T19:12:15.990692] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-03T19:12:16.238005] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-03T19:12:16.720110] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:12:16.790717] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-03T19:12:17.504928] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:12:17.590704] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-03T19:12:18.390740] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-03T19:12:18.778411] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:12:19.190698] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-03T19:12:19.533782] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:12:19.990670] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-03T19:12:20.159140] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-03T19:12:20.790701] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-03T19:12:21.173824] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T19:12:21.280193] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:12:21.590720] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-03T19:12:22.120131] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-03T19:12:22.390690] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-03T19:12:23.192138] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-03T19:12:23.198009] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:12:23.990731] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-03T19:12:24.663747] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:12:24.790670] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-03T19:12:24.997703] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-10-03T19:12:25.590734] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-03T19:12:25.652018] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:12:26.390736] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-03T19:12:26.802363] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-03T19:12:27.190740] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-03T19:12:27.769984] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-03T19:12:27.881168] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:12:27.990714] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-03T19:12:28.790686] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-03T19:12:28.836107] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-03T19:12:28.838932] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-03T19:12:28.839063] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-03T19:12:29.306395] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-03T19:12:29.306488] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-03T19:12:29.307634] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-03T19:12:29.307726] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-03T19:12:29.309326] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54508 (keeping 200 days of data) [2025-10-03T19:12:29.563813] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:12:29.590677] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-03T19:12:29.694925] [DEBUG] [LOCAL ] GM: Primary data saved (54508 records). [2025-10-03T19:12:29.695087] [INFO ] [MAIN ] GM: Full history saved. [2025-10-03T19:12:29.695703] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GM took 38.2s. Estimated remaining: 3h 20m 2s. Rate: 7.1 symbols/min [2025-10-03T19:12:29.883803] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:29.903331] [DEBUG] [LOCAL ] GNE: Loaded 17926 existing records from primary storage. [2025-10-03T19:12:29.903588] [INFO ] [MAIN ] GNE: Loaded 17926 existing records. [2025-10-03T19:12:30.100250] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:30.100511] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-03T19:12:30.100587] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-03T19:12:30.101297] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-03T19:12:30.101358] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-03T19:12:30.398412] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-03T19:12:30.488167] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:31.182397] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-03T19:12:31.195343] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-03T19:12:31.405126] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:12:31.692132] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-03T19:12:31.995753] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-03T19:12:32.014362] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:12:32.790728] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-03T19:12:33.406359] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:12:33.528864] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-03T19:12:33.590703] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-03T19:12:34.390718] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-03T19:12:35.051859] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:12:35.190728] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-03T19:12:35.990681] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-03T19:12:36.541357] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-03T19:12:36.581207] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T19:12:36.790736] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-03T19:12:37.050453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-03T19:12:37.053343] [INFO ] [REMOTE ] GMED: Full fetch complete (69707 records). [2025-10-03T19:12:37.053486] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-03T19:12:37.495002] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-03T19:12:37.495093] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-03T19:12:37.496106] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-03T19:12:37.496182] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-03T19:12:37.498065] [DEBUG] [LOCAL ] GMED: Trimmed 69707 records to 49085 (keeping 200 days of data) [2025-10-03T19:12:37.590854] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-03T19:12:37.803603] [DEBUG] [LOCAL ] GMED: Primary data saved (49085 records). [2025-10-03T19:12:37.803781] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-03T19:12:37.803887] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GMED took 29.8s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-03T19:12:37.996869] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:38.036094] [DEBUG] [LOCAL ] GNK: Loaded 40592 existing records from primary storage. [2025-10-03T19:12:38.036443] [INFO ] [MAIN ] GNK: Loaded 40592 existing records. [2025-10-03T19:12:38.242382] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:38.242990] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-03T19:12:38.243173] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-03T19:12:38.243456] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-03T19:12:38.243596] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-03T19:12:38.395852] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-03T19:12:38.505384] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:12:38.529834] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:12:38.728589] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:39.190725] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-03T19:12:39.965782] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:12:39.990629] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-03T19:12:40.610859] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T19:12:40.790732] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-03T19:12:41.513064] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:12:41.590734] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-03T19:12:42.166881] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:12:42.390729] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-03T19:12:42.534465] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T19:12:42.535977] [INFO ] [REMOTE ] GMRE: Full fetch complete (53233 records). [2025-10-03T19:12:42.536057] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-03T19:12:42.960735] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-03T19:12:42.960848] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-03T19:12:42.961699] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-03T19:12:42.961763] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-03T19:12:42.962979] [DEBUG] [LOCAL ] GMRE: Trimmed 53233 records to 37705 (keeping 200 days of data) [2025-10-03T19:12:43.191005] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-03T19:12:43.199009] [DEBUG] [LOCAL ] GMRE: Primary data saved (37705 records). [2025-10-03T19:12:43.199118] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-03T19:12:43.199220] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GMRE took 31.3s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-03T19:12:43.283183] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:12:43.392277] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:43.434395] [DEBUG] [LOCAL ] GNL: Loaded 47148 existing records from primary storage. [2025-10-03T19:12:43.434766] [INFO ] [MAIN ] GNL: Loaded 47148 existing records. [2025-10-03T19:12:43.637737] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:43.638059] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-03T19:12:43.638122] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-03T19:12:43.638442] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-03T19:12:43.638501] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-03T19:12:44.010860] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-03T19:12:44.017412] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:44.790723] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-03T19:12:45.326075] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:12:45.392299] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-03T19:12:45.395026] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-03T19:12:45.395172] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-03T19:12:45.600888] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-03T19:12:45.822243] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-03T19:12:45.822356] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-03T19:12:45.823331] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-03T19:12:45.823397] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-03T19:12:45.825526] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54542 (keeping 200 days of data) [2025-10-03T19:12:46.182404] [DEBUG] [LOCAL ] GME: Primary data saved (54542 records). [2025-10-03T19:12:46.182619] [INFO ] [MAIN ] GME: Full history saved. [2025-10-03T19:12:46.182809] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GME took 43.3s. Estimated remaining: 3h 19m 23s. Rate: 7.1 symbols/min [2025-10-03T19:12:46.361250] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:12:46.391594] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:12:46.391709] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-03T19:12:46.441876] [DEBUG] [LOCAL ] GNRC: Loaded 45434 existing records from primary storage. [2025-10-03T19:12:46.442204] [INFO ] [MAIN ] GNRC: Loaded 45434 existing records. [2025-10-03T19:12:46.641938] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:12:46.642167] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-03T19:12:46.642217] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-03T19:12:46.642455] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-03T19:12:46.642515] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-03T19:12:47.048884] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:12:47.086149] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:12:47.190716] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-03T19:12:47.366535] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T19:12:47.990737] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-03T19:12:48.790705] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-03T19:12:48.867407] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:12:49.524526] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:12:49.590678] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-03T19:12:50.111510] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T19:12:50.353623] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:12:50.390693] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-03T19:12:51.190717] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-03T19:12:51.494680] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T19:12:51.990697] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-03T19:12:52.650253] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:12:52.790690] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-03T19:12:52.967401] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:12:53.590734] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-03T19:12:54.337940] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T19:12:54.390624] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-03T19:12:55.028226] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:12:55.067467] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-03T19:12:55.190719] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-03T19:12:55.990695] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-03T19:12:56.639832] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:12:56.790719] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-03T19:12:57.314579] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:12:57.590745] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-03T19:12:58.354811] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:12:58.390631] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-03T19:12:59.182571] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:12:59.192519] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-03T19:12:59.990683] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-03T19:13:00.076119] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:13:00.545134] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:13:00.790712] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-03T19:13:00.977048] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:13:00.978378] [INFO ] [REMOTE ] GNE: Full fetch complete (22497 records). [2025-10-03T19:13:00.978459] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-03T19:13:01.376856] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-03T19:13:01.376983] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-03T19:13:01.377545] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-03T19:13:01.377612] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-03T19:13:01.378341] [DEBUG] [LOCAL ] GNE: Trimmed 22497 records to 18024 (keeping 200 days of data) [2025-10-03T19:13:01.513677] [DEBUG] [LOCAL ] GNE: Primary data saved (18024 records). [2025-10-03T19:13:01.513876] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-03T19:13:01.514030] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GNE took 31.8s. Estimated remaining: 3h 19m 25s. Rate: 7.1 symbols/min [2025-10-03T19:13:01.598337] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-03T19:13:01.725419] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:01.737944] [DEBUG] [LOCAL ] GNT: Loaded 8217 existing records from primary storage. [2025-10-03T19:13:01.738263] [INFO ] [MAIN ] GNT: Loaded 8217 existing records. [2025-10-03T19:13:01.938052] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:01.938282] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-03T19:13:01.938372] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-03T19:13:01.938626] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-03T19:13:01.938724] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-03T19:13:02.336347] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:02.362142] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:13:02.390626] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-03T19:13:03.010283] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:13:03.192853] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-03T19:13:03.195901] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:13:03.990713] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-03T19:13:04.790709] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-03T19:13:04.835858] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:13:05.424314] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:13:05.590700] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-03T19:13:06.389281] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:13:06.398590] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-03T19:13:07.048722] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T19:13:07.190729] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-03T19:13:07.403709] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:13:07.830134] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T19:13:07.990684] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-03T19:13:08.576502] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-03T19:13:08.790696] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-03T19:13:09.590739] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-03T19:13:09.884137] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-03T19:13:09.886834] [INFO ] [REMOTE ] GNK: Full fetch complete (57192 records). [2025-10-03T19:13:09.887038] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-03T19:13:10.393245] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-03T19:13:10.416295] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-03T19:13:10.416400] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-03T19:13:10.417359] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-03T19:13:10.417588] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-03T19:13:10.419064] [DEBUG] [LOCAL ] GNK: Trimmed 57192 records to 40862 (keeping 200 days of data) [2025-10-03T19:13:10.681858] [DEBUG] [LOCAL ] GNK: Primary data saved (40862 records). [2025-10-03T19:13:10.681996] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-03T19:13:10.682111] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNK took 32.9s. Estimated remaining: 3h 19m 18s. Rate: 7.1 symbols/min [2025-10-03T19:13:10.889202] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:10.937405] [DEBUG] [LOCAL ] GNW: Loaded 51722 existing records from primary storage. [2025-10-03T19:13:10.937783] [INFO ] [MAIN ] GNW: Loaded 51722 existing records. [2025-10-03T19:13:11.131880] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:11.132265] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-03T19:13:11.132503] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-03T19:13:11.133083] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-03T19:13:11.133186] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-03T19:13:11.201619] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-03T19:13:11.255469] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:13:11.384002] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:13:11.590539] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:11.990711] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-03T19:13:12.790697] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-03T19:13:13.058460] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:13:13.590739] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-03T19:13:13.623944] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:13:14.179750] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:13:14.390723] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-03T19:13:14.737272] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:13:15.190701] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-03T19:13:15.909074] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:13:15.990690] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-03T19:13:16.073448] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:13:16.790723] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-03T19:13:17.590703] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-03T19:13:17.744393] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:13:18.308526] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:13:18.396629] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-03T19:13:18.418222] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:13:19.190708] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-03T19:13:19.887009] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-03T19:13:19.916985] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:13:19.990699] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-03T19:13:20.620879] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:13:20.790678] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-03T19:13:21.590708] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-03T19:13:22.017033] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:13:22.019543] [INFO ] [REMOTE ] GNRC: Full fetch complete (65292 records). [2025-10-03T19:13:22.019691] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-03T19:13:22.395880] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-03T19:13:22.446887] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-03T19:13:22.447058] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-03T19:13:22.456710] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-03T19:13:22.457107] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:13:22.457303] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-03T19:13:22.462357] [DEBUG] [LOCAL ] GNRC: Trimmed 65292 records to 45779 (keeping 200 days of data) [2025-10-03T19:13:22.754300] [DEBUG] [LOCAL ] GNRC: Primary data saved (45779 records). [2025-10-03T19:13:22.754461] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-03T19:13:22.754687] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNRC took 36.6s. Estimated remaining: 3h 19m 15s. Rate: 7.1 symbols/min [2025-10-03T19:13:22.944805] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:22.990324] [DEBUG] [LOCAL ] GOF: Loaded 42879 existing records from primary storage. [2025-10-03T19:13:22.990678] [INFO ] [MAIN ] GOF: Loaded 42879 existing records. [2025-10-03T19:13:23.185671] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:23.185929] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-03T19:13:23.185979] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-03T19:13:23.186325] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-03T19:13:23.186437] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-03T19:13:23.198124] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-03T19:13:23.590459] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:23.990706] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-03T19:13:24.211218] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-03T19:13:24.479384] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:13:24.528581] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-03T19:13:24.529688] [INFO ] [REMOTE ] GNT: Full fetch complete (10864 records). [2025-10-03T19:13:24.529764] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-03T19:13:24.795899] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-03T19:13:24.916210] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-03T19:13:24.916289] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-03T19:13:24.916586] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-03T19:13:24.916676] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-03T19:13:24.917152] [DEBUG] [LOCAL ] GNT: Trimmed 10864 records to 8269 (keeping 200 days of data) [2025-10-03T19:13:24.966963] [DEBUG] [LOCAL ] GNT: Primary data saved (8269 records). [2025-10-03T19:13:24.967112] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-03T19:13:24.967202] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNT took 23.5s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-10-03T19:13:25.157833] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:25.198494] [DEBUG] [LOCAL ] GOLF: Loaded 31420 existing records from primary storage. [2025-10-03T19:13:25.198805] [INFO ] [MAIN ] GOLF: Loaded 31420 existing records. [2025-10-03T19:13:25.398004] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:25.398253] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-03T19:13:25.398339] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-03T19:13:25.398583] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-03T19:13:25.398681] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-03T19:13:25.593885] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-03T19:13:25.842910] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:26.390686] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-03T19:13:26.508910] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:13:27.190813] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-03T19:13:27.196667] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-03T19:13:27.990637] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-03T19:13:28.150548] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:13:28.787799] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:13:28.796538] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-03T19:13:29.059481] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:13:29.062096] [INFO ] [REMOTE ] GNL: Full fetch complete (68259 records). [2025-10-03T19:13:29.062236] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-03T19:13:29.504004] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-03T19:13:29.504236] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-03T19:13:29.505379] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-03T19:13:29.505491] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-03T19:13:29.507363] [DEBUG] [LOCAL ] GNL: Trimmed 68259 records to 47502 (keeping 200 days of data) [2025-10-03T19:13:29.599190] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-03T19:13:29.623418] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T19:13:29.828809] [DEBUG] [LOCAL ] GNL: Primary data saved (47502 records). [2025-10-03T19:13:29.828950] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-03T19:13:29.829036] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNL took 46.6s. Estimated remaining: 3h 18m 44s. Rate: 7.1 symbols/min [2025-10-03T19:13:30.023381] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:30.072704] [DEBUG] [LOCAL ] GOOS: Loaded 45342 existing records from primary storage. [2025-10-03T19:13:30.073016] [INFO ] [MAIN ] GOOS: Loaded 45342 existing records. [2025-10-03T19:13:30.264888] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:30.265097] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-03T19:13:30.265147] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-03T19:13:30.265464] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-03T19:13:30.265544] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-03T19:13:30.395867] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-03T19:13:30.669197] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:31.190668] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-03T19:13:31.269815] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:13:31.809603] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:13:31.990728] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-03T19:13:32.790695] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-03T19:13:32.909876] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:13:33.590735] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-03T19:13:33.763312] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:13:34.390671] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-03T19:13:34.469981] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-03T19:13:35.134886] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:13:35.190705] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-03T19:13:35.990688] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-03T19:13:36.063004] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:13:36.505856] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-03T19:13:36.790672] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-03T19:13:37.115366] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:13:37.590749] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-03T19:13:38.395817] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-03T19:13:38.415629] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:13:38.957265] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:13:39.190698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-03T19:13:39.990634] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-03T19:13:40.087799] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:13:40.707213] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:13:40.790727] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-03T19:13:41.569811] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:13:41.590705] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-03T19:13:42.290134] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-03T19:13:42.390715] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-03T19:13:43.203027] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-03T19:13:43.211120] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:13:43.815410] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:13:43.990684] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-03T19:13:44.791396] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-03T19:13:44.794896] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:13:45.590672] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-03T19:13:45.726039] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:13:45.797150] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:13:46.390728] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-03T19:13:47.195831] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-03T19:13:47.218233] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T19:13:47.990623] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-03T19:13:48.066819] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T19:13:48.069617] [INFO ] [REMOTE ] GNW: Full fetch complete (73604 records). [2025-10-03T19:13:48.069788] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-03T19:13:48.488518] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-03T19:13:48.488616] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-03T19:13:48.489660] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-03T19:13:48.489737] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-03T19:13:48.491323] [DEBUG] [LOCAL ] GNW: Trimmed 73604 records to 52096 (keeping 200 days of data) [2025-10-03T19:13:48.790897] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-03T19:13:48.809013] [DEBUG] [LOCAL ] GNW: Primary data saved (52096 records). [2025-10-03T19:13:48.809166] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-03T19:13:48.809255] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GNW took 38.1s. Estimated remaining: 3h 18m 51s. Rate: 7.1 symbols/min [2025-10-03T19:13:49.019157] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:13:49.036873] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:49.069845] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:13:49.110959] [DEBUG] [LOCAL ] GOTU: Loaded 38626 existing records from primary storage. [2025-10-03T19:13:49.111282] [INFO ] [MAIN ] GOTU: Loaded 38626 existing records. [2025-10-03T19:13:49.309726] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:13:49.310578] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-03T19:13:49.310638] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-03T19:13:49.311074] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-03T19:13:49.311134] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-03T19:13:49.595974] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-03T19:13:49.703047] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:13:50.390690] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-03T19:13:50.452610] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:13:51.047276] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:13:51.190739] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-03T19:13:51.661256] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:13:51.990704] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-03T19:13:52.790637] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-03T19:13:52.909452] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:13:53.586754] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:13:53.596336] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-03T19:13:54.277617] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:13:54.390690] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-03T19:13:54.532209] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:13:55.190706] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-03T19:13:55.990626] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-03T19:13:56.078480] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:13:56.340522] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T19:13:56.790742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-03T19:13:57.590697] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-03T19:13:57.689234] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:13:58.147933] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:13:58.150768] [INFO ] [REMOTE ] GOF: Full fetch complete (62105 records). [2025-10-03T19:13:58.150912] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-03T19:13:58.392311] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-03T19:13:58.637544] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-03T19:13:58.638234] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-03T19:13:58.639313] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-03T19:13:58.639677] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-03T19:13:58.639554] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:13:58.642792] [INFO ] [REMOTE ] GOLF: Full fetch complete (45146 records). [2025-10-03T19:13:58.643042] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-03T19:13:58.649274] [DEBUG] [LOCAL ] GOF: Trimmed 62105 records to 43182 (keeping 200 days of data) [2025-10-03T19:13:59.229634] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-03T19:13:59.256078] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-03T19:13:59.286987] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-03T19:13:59.291632] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-03T19:13:59.292094] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-03T19:13:59.297972] [DEBUG] [LOCAL ] GOLF: Trimmed 45146 records to 31654 (keeping 200 days of data) [2025-10-03T19:13:59.464205] [DEBUG] [LOCAL ] GOF: Primary data saved (43182 records). [2025-10-03T19:13:59.464942] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-03T19:13:59.468355] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOF took 36.7s. Estimated remaining: 3h 18m 46s. Rate: 7.1 symbols/min [2025-10-03T19:13:59.713203] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:59.753535] [DEBUG] [LOCAL ] GOLF: Primary data saved (31654 records). [2025-10-03T19:13:59.753749] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-03T19:13:59.754747] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GOLF took 34.8s. Estimated remaining: 3h 18m 26s. Rate: 7.1 symbols/min [2025-10-03T19:13:59.971991] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:13:59.992457] [DEBUG] [LOCAL ] GPC: Loaded 46702 existing records from primary storage. [2025-10-03T19:13:59.992881] [INFO ] [MAIN ] GPC: Loaded 46702 existing records. [2025-10-03T19:14:00.134796] [DEBUG] [LOCAL ] GPI: Loaded 14747 existing records from primary storage. [2025-10-03T19:14:00.150966] [INFO ] [MAIN ] GPI: Loaded 14747 existing records. [2025-10-03T19:14:00.234085] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:00.309068] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-03T19:14:00.339357] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-03T19:14:00.376332] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-03T19:14:00.389212] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-03T19:14:00.389343] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-03T19:14:00.511020] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:00.526088] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-03T19:14:00.540955] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-03T19:14:00.570119] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-03T19:14:00.600824] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-03T19:14:00.611789] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-03T19:14:01.157658] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:01.194742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-03T19:14:01.313269] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:01.353198] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-03T19:14:01.590737] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-03T19:14:02.148833] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:14:02.390770] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-03T19:14:03.023462] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:14:03.130042] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:14:03.190683] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-03T19:14:03.231528] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:14:03.990685] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-03T19:14:04.790630] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-03T19:14:04.832179] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:14:05.304922] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T19:14:05.308186] [INFO ] [REMOTE ] GOOS: Full fetch complete (65438 records). [2025-10-03T19:14:05.308344] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-03T19:14:05.598979] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-03T19:14:05.743894] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-03T19:14:05.743981] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-03T19:14:05.744903] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-03T19:14:05.744971] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-03T19:14:05.746409] [DEBUG] [LOCAL ] GOOS: Trimmed 65438 records to 45626 (keeping 200 days of data) [2025-10-03T19:14:06.045120] [DEBUG] [LOCAL ] GOOS: Primary data saved (45626 records). [2025-10-03T19:14:06.045259] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-03T19:14:06.045351] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOOS took 36.2s. Estimated remaining: 3h 18m 14s. Rate: 7.1 symbols/min [2025-10-03T19:14:06.241306] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:06.248782] [DEBUG] [LOCAL ] GPJA: Loaded 4260 existing records from primary storage. [2025-10-03T19:14:06.249057] [INFO ] [MAIN ] GPJA: Loaded 4260 existing records. [2025-10-03T19:14:06.392360] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-03T19:14:06.457788] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:06.458392] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-03T19:14:06.458527] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-03T19:14:06.458999] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-03T19:14:06.459351] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-03T19:14:06.544168] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:14:06.816301] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:14:06.917853] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:07.190711] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-03T19:14:07.990667] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-03T19:14:08.107681] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:14:08.521276] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:14:08.790688] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-03T19:14:08.865853] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:14:09.590690] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-03T19:14:10.390714] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-03T19:14:10.473258] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:14:10.627971] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-03T19:14:11.190681] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-03T19:14:11.346594] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:14:11.990709] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-03T19:14:12.790697] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-03T19:14:12.931469] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:14:13.379105] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:14:13.394305] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-03T19:14:13.590690] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-03T19:14:13.699299] [DEBUG] [REMOTE ] GPC: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T19:14:13.699621] [WARN ] [REMOTE ] GPC: No data returned for month 2025-05 [2025-10-03T19:14:13.699736] [FATAL] [REMOTE ] GPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:14:13.699848] [FATAL] [MAIN ] GPC: Failed to fetch primary data. [2025-10-03T19:14:13.699932] [WARN ] [MAIN ] GPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:14:13.700023] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-03T19:14:13.700109] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-10-03T19:14:13.700164] [INFO ] [LOCAL ] GPC: Starting deletion of derivative data. [2025-10-03T19:14:13.700536] [DEBUG] [LOCAL ] GPC: Deleted derivative data file. [2025-10-03T19:14:13.700679] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GPC took 14.2s. Estimated remaining: 3h 18m 4s. Rate: 7.1 symbols/min [2025-10-03T19:14:14.390707] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-03T19:14:15.190678] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-03T19:14:15.826230] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:14:15.958592] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:14:15.990606] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-03T19:14:16.542398] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T19:14:16.790690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-03T19:14:17.349879] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T19:14:17.590704] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-03T19:14:18.390689] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-03T19:14:18.871893] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:14:18.874725] [INFO ] [REMOTE ] GOTU: Full fetch complete (58991 records). [2025-10-03T19:14:18.874903] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-03T19:14:19.199422] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-03T19:14:19.199344] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:14:19.315411] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-03T19:14:19.315507] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-03T19:14:19.316965] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-03T19:14:19.317035] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-03T19:14:19.319487] [DEBUG] [LOCAL ] GOTU: Trimmed 58991 records to 38853 (keeping 200 days of data) [2025-10-03T19:14:19.550954] [DEBUG] [LOCAL ] GOTU: Primary data saved (38853 records). [2025-10-03T19:14:19.551107] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-03T19:14:19.551216] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GOTU took 30.7s. Estimated remaining: 3h 17m 52s. Rate: 7.1 symbols/min [2025-10-03T19:14:19.990749] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-03T19:14:20.294747] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:14:20.455296] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T19:14:20.790716] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-03T19:14:21.590710] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-03T19:14:21.684036] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-03T19:14:22.172058] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-03T19:14:22.390690] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-03T19:14:22.956239] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-03T19:14:23.190731] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-03T19:14:23.990731] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-03T19:14:24.095686] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-03T19:14:24.573747] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T19:14:24.790727] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-03T19:14:25.495306] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T19:14:25.590703] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-03T19:14:26.124779] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:14:26.125601] [INFO ] [REMOTE ] GPJA: Full fetch complete (7320 records). [2025-10-03T19:14:26.125703] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-03T19:14:26.396816] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-03T19:14:26.530944] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-03T19:14:26.531027] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-03T19:14:26.531229] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-03T19:14:26.531274] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-03T19:14:26.531815] [DEBUG] [LOCAL ] GPJA: Trimmed 7320 records to 4272 (keeping 200 days of data) [2025-10-03T19:14:26.559573] [DEBUG] [LOCAL ] GPJA: Primary data saved (4272 records). [2025-10-03T19:14:26.559744] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-03T19:14:26.559855] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPJA took 20.5s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-03T19:14:27.447663] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:14:27.452839] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-03T19:14:28.105104] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-03T19:14:28.108977] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-03T19:14:29.016316] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T19:14:29.020521] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-03T19:14:29.793054] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T19:14:29.794865] [INFO ] [REMOTE ] GPI: Full fetch complete (21080 records). [2025-10-03T19:14:29.794959] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-03T19:14:30.196503] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-03T19:14:30.196591] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-03T19:14:30.197099] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-03T19:14:30.197166] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-03T19:14:30.197795] [DEBUG] [LOCAL ] GPI: Trimmed 21080 records to 14844 (keeping 200 days of data) [2025-10-03T19:14:30.293514] [DEBUG] [LOCAL ] GPI: Primary data saved (14844 records). [2025-10-03T19:14:30.293688] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-03T19:14:30.293816] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GPI took 30.5s. Estimated remaining: 3h 17m 27s. Rate: 7.1 symbols/min [2025-10-03T19:14:30.859178] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.009358] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.038268] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.100943] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:31.140457] [DEBUG] [LOCAL ] GPMT: Loaded 26208 existing records from primary storage. [2025-10-03T19:14:31.141329] [INFO ] [MAIN ] GPMT: Loaded 26208 existing records. [2025-10-03T19:14:31.296008] [DEBUG] [LOCAL ] GPOR: Loaded 23347 existing records from primary storage. [2025-10-03T19:14:31.333828] [INFO ] [MAIN ] GPOR: Loaded 23347 existing records. [2025-10-03T19:14:31.295024] [DEBUG] [LOCAL ] GPK: Loaded 53044 existing records from primary storage. [2025-10-03T19:14:31.340100] [INFO ] [MAIN ] GPK: Loaded 53044 existing records. [2025-10-03T19:14:31.615834] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:31.610085] [DEBUG] [LOCAL ] GPN: Loaded 52423 existing records from primary storage. [2025-10-03T19:14:31.680452] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-03T19:14:31.701422] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-03T19:14:31.669366] [INFO ] [MAIN ] GPN: Loaded 52423 existing records. [2025-10-03T19:14:31.808769] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-03T19:14:31.842809] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:31.889780] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-03T19:14:31.900019] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-03T19:14:31.905416] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-03T19:14:32.093066] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-03T19:14:32.102116] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-03T19:14:32.101854] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:32.229404] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-03T19:14:32.251866] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-03T19:14:32.319915] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-03T19:14:32.320107] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-03T19:14:32.309461] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:32.420545] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-03T19:14:32.494216] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-03T19:14:32.586928] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-03T19:14:32.647173] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-03T19:14:33.390831] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.457574] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-03T19:14:33.498327] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.542965] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-03T19:14:33.657024] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.690974] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-03T19:14:33.821715] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:33.822087] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-03T19:14:34.847319] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:14:34.854633] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-03T19:14:34.932722] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:14:34.939613] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-03T19:14:35.565372] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-03T19:14:35.578933] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-03T19:14:35.616235] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:14:35.627828] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-03T19:14:35.690590] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:14:35.903685] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:14:35.990706] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-03T19:14:36.790664] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-03T19:14:36.957232] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-03T19:14:37.031962] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:14:37.210453] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:14:37.538807] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:14:37.590706] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-03T19:14:38.390697] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-03T19:14:39.190730] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-03T19:14:39.261878] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:14:39.990630] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-03T19:14:40.048039] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:14:40.322219] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-03T19:14:40.790742] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-03T19:14:41.590730] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-03T19:14:41.676288] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:14:41.886411] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-03T19:14:42.390732] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-03T19:14:43.190702] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-03T19:14:43.381140] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:14:43.990631] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-03T19:14:44.110292] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:14:44.253567] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:14:44.790633] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-03T19:14:44.854375] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T19:14:45.590680] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-03T19:14:45.891143] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:14:46.390683] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-03T19:14:46.646076] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:14:47.190734] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-03T19:14:47.534920] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-03T19:14:47.990763] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-03T19:14:48.517248] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-03T19:14:48.790764] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-03T19:14:49.590722] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-03T19:14:49.724259] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:14:50.220568] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:14:50.390707] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-03T19:14:50.707527] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:14:51.190719] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-03T19:14:51.446027] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T19:14:51.990733] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-03T19:14:52.457147] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-03T19:14:52.790710] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-03T19:14:53.137985] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:14:53.590755] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-03T19:14:53.871359] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:14:53.873250] [INFO ] [REMOTE ] GPOR: Full fetch complete (35067 records). [2025-10-03T19:14:53.873340] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-03T19:14:54.396816] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-03T19:14:54.400038] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-03T19:14:54.401717] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-03T19:14:54.403685] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-03T19:14:54.403973] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-03T19:14:54.405575] [DEBUG] [LOCAL ] GPOR: Trimmed 35067 records to 23529 (keeping 200 days of data) [2025-10-03T19:14:54.565317] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:14:54.645082] [DEBUG] [LOCAL ] GPOR: Primary data saved (23529 records). [2025-10-03T19:14:54.645291] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-03T19:14:54.645478] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPOR took 24.3s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-03T19:14:54.935627] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:54.988258] [DEBUG] [LOCAL ] GPRK: Loaded 39690 existing records from primary storage. [2025-10-03T19:14:54.988753] [INFO ] [MAIN ] GPRK: Loaded 39690 existing records. [2025-10-03T19:14:55.193874] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-03T19:14:55.219029] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:55.220504] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-03T19:14:55.220635] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-03T19:14:55.221097] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-03T19:14:55.221173] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-03T19:14:55.633449] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:55.990719] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-03T19:14:56.063377] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:14:56.095925] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:14:56.097487] [INFO ] [REMOTE ] GPMT: Full fetch complete (37202 records). [2025-10-03T19:14:56.097713] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-03T19:14:56.511285] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-03T19:14:56.511388] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-03T19:14:56.512101] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-03T19:14:56.512168] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-03T19:14:56.513182] [DEBUG] [LOCAL ] GPMT: Trimmed 37202 records to 26308 (keeping 200 days of data) [2025-10-03T19:14:56.691755] [DEBUG] [LOCAL ] GPMT: Primary data saved (26308 records). [2025-10-03T19:14:56.691936] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-03T19:14:56.692078] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPMT took 26.4s. Estimated remaining: 3h 17m 24s. Rate: 7.1 symbols/min [2025-10-03T19:14:56.799353] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-03T19:14:56.889093] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:14:56.916609] [DEBUG] [LOCAL ] GRBK: Loaded 27074 existing records from primary storage. [2025-10-03T19:14:56.916962] [INFO ] [MAIN ] GRBK: Loaded 27074 existing records. [2025-10-03T19:14:57.113714] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:14:57.114000] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-03T19:14:57.114259] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-03T19:14:57.114612] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-03T19:14:57.114728] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-03T19:14:57.238235] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-03T19:14:57.563169] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:14:57.590633] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-03T19:14:58.390639] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-03T19:14:58.596383] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:14:58.718472] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:14:59.190717] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-03T19:14:59.470190] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:14:59.990701] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-03T19:15:00.553070] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:15:00.790748] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-03T19:15:01.590765] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-03T19:15:02.023608] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:15:02.160376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:15:02.390707] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-03T19:15:03.190728] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-03T19:15:03.335040] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-03T19:15:03.990678] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-03T19:15:04.289759] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:15:04.561107] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T19:15:04.790720] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-03T19:15:05.464461] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:15:05.590711] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-03T19:15:06.390629] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-03T19:15:06.587080] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:15:06.875048] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:15:07.190718] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-03T19:15:07.734726] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:15:07.990706] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-03T19:15:08.648073] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:15:08.650999] [INFO ] [REMOTE ] GPK: Full fetch complete (75586 records). [2025-10-03T19:15:08.651146] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-03T19:15:08.795742] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-03T19:15:09.087053] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-03T19:15:09.087184] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-03T19:15:09.088250] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-03T19:15:09.088380] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-03T19:15:09.090177] [DEBUG] [LOCAL ] GPK: Trimmed 75586 records to 53416 (keeping 200 days of data) [2025-10-03T19:15:09.443588] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:15:09.476338] [DEBUG] [LOCAL ] GPK: Primary data saved (53416 records). [2025-10-03T19:15:09.476503] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-03T19:15:09.476622] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 39.2s. Estimated remaining: 3h 17m 22s. Rate: 7.1 symbols/min [2025-10-03T19:15:09.595749] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-03T19:15:09.662953] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:09.674054] [DEBUG] [LOCAL ] GRC: Loaded 9062 existing records from primary storage. [2025-10-03T19:15:09.674278] [INFO ] [MAIN ] GRC: Loaded 9062 existing records. [2025-10-03T19:15:09.860233] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:09.860486] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-03T19:15:09.860537] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-03T19:15:09.860752] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-03T19:15:09.860814] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-03T19:15:10.251580] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:10.390631] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-03T19:15:10.828435] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:15:10.997770] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:15:11.187180] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:15:11.190614] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-03T19:15:11.990690] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-03T19:15:12.033411] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-03T19:15:12.790696] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-03T19:15:13.320971] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:15:13.590693] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-03T19:15:14.262601] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-03T19:15:14.390688] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-03T19:15:14.496195] [DEBUG] [REMOTE ] GPRK: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-03T19:15:14.496559] [WARN ] [REMOTE ] GPRK: No data returned for month 2025-07 [2025-10-03T19:15:14.496685] [FATAL] [REMOTE ] GPRK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:15:14.496784] [FATAL] [MAIN ] GPRK: Failed to fetch primary data. [2025-10-03T19:15:14.496827] [WARN ] [MAIN ] GPRK: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:15:14.496895] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-03T19:15:14.496978] [DEBUG] [LOCAL ] GPRK: No primary data file found to delete. [2025-10-03T19:15:14.497034] [INFO ] [LOCAL ] GPRK: Starting deletion of derivative data. [2025-10-03T19:15:14.497315] [DEBUG] [LOCAL ] GPRK: Deleted derivative data file. [2025-10-03T19:15:14.498028] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPRK took 19.9s. Estimated remaining: 3h 17m 8s. Rate: 7.1 symbols/min [2025-10-03T19:15:14.689052] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:14.712782] [DEBUG] [LOCAL ] GRDN: Loaded 20716 existing records from primary storage. [2025-10-03T19:15:14.713103] [INFO ] [MAIN ] GRDN: Loaded 20716 existing records. [2025-10-03T19:15:14.935215] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T19:15:14.948455] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:14.949536] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-03T19:15:14.949620] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-03T19:15:14.950386] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-03T19:15:14.950453] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-03T19:15:15.197016] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-03T19:15:15.325235] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:15.990621] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-03T19:15:16.513320] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:15:16.790732] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-03T19:15:17.564897] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:15:17.590714] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-03T19:15:17.753737] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:15:18.390744] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-03T19:15:18.851487] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:15:19.190746] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-03T19:15:19.990634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-03T19:15:20.139936] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:15:20.306707] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T19:15:20.790721] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-03T19:15:20.924230] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T19:15:21.575977] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:15:21.590619] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-03T19:15:22.390693] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-03T19:15:22.440138] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-03T19:15:23.181401] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:15:23.190611] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-03T19:15:23.964389] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:15:23.990635] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-03T19:15:24.790713] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-03T19:15:24.892538] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-03T19:15:25.590704] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-03T19:15:26.153420] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-03T19:15:26.332198] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:15:26.335085] [INFO ] [REMOTE ] GPN: Full fetch complete (74907 records). [2025-10-03T19:15:26.335226] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-03T19:15:26.399405] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-03T19:15:26.764729] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-03T19:15:26.764859] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-03T19:15:26.765898] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-03T19:15:26.765968] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-03T19:15:26.767547] [DEBUG] [LOCAL ] GPN: Trimmed 74907 records to 52797 (keeping 200 days of data) [2025-10-03T19:15:27.137117] [DEBUG] [LOCAL ] GPN: Primary data saved (52797 records). [2025-10-03T19:15:27.137357] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-03T19:15:27.137488] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPN took 56.8s. Estimated remaining: 3h 17m 6s. Rate: 7.1 symbols/min [2025-10-03T19:15:27.195834] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-03T19:15:27.324384] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:27.383680] [DEBUG] [LOCAL ] GRMN: Loaded 41310 existing records from primary storage. [2025-10-03T19:15:27.390157] [INFO ] [MAIN ] GRMN: Loaded 41310 existing records. [2025-10-03T19:15:27.389940] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T19:15:27.583338] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:27.583627] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-03T19:15:27.583718] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-03T19:15:27.584248] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-03T19:15:27.584336] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-03T19:15:27.749955] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-03T19:15:27.979159] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:27.990613] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-03T19:15:28.790757] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-03T19:15:29.523415] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:15:29.590638] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-03T19:15:29.996634] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:15:30.390737] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-03T19:15:30.673423] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T19:15:31.190736] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-03T19:15:31.894573] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:15:31.990705] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-03T19:15:32.185930] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T19:15:32.756246] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:15:32.790672] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-03T19:15:33.590740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-03T19:15:34.279281] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:15:34.390710] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-03T19:15:34.686678] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:15:34.689137] [INFO ] [REMOTE ] GRBK: Full fetch complete (40565 records). [2025-10-03T19:15:34.689362] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-03T19:15:35.146556] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-03T19:15:35.146678] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-03T19:15:35.147339] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-03T19:15:35.147384] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-03T19:15:35.148625] [DEBUG] [LOCAL ] GRBK: Trimmed 40565 records to 27305 (keeping 200 days of data) [2025-10-03T19:15:35.197217] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-03T19:15:35.316476] [DEBUG] [LOCAL ] GRBK: Primary data saved (27305 records). [2025-10-03T19:15:35.316629] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-03T19:15:35.316790] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 38.6s. Estimated remaining: 3h 16m 57s. Rate: 7.1 symbols/min [2025-10-03T19:15:35.499395] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:35.548667] [DEBUG] [LOCAL ] GRND: Loaded 50304 existing records from primary storage. [2025-10-03T19:15:35.549038] [INFO ] [MAIN ] GRND: Loaded 50304 existing records. [2025-10-03T19:15:35.770743] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:35.770977] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-03T19:15:35.771031] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-03T19:15:35.771326] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-03T19:15:35.771410] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-03T19:15:35.997561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-03T19:15:36.181290] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:15:36.253229] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:36.279875] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T19:15:36.790631] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-03T19:15:36.849784] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:15:37.590694] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-03T19:15:37.940510] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-03T19:15:38.390692] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-03T19:15:39.190702] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-03T19:15:39.259918] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:15:39.988757] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:15:39.991268] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-03T19:15:40.159726] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:15:40.790715] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-03T19:15:41.189625] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:15:41.590759] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-03T19:15:41.824515] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:15:42.390721] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-03T19:15:43.101934] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:15:43.190743] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-03T19:15:43.463509] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-03T19:15:43.465242] [INFO ] [REMOTE ] GRDN: Full fetch complete (26332 records). [2025-10-03T19:15:43.465325] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-03T19:15:43.904495] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-03T19:15:43.904578] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-03T19:15:43.905193] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-03T19:15:43.905296] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-03T19:15:43.906127] [DEBUG] [LOCAL ] GRDN: Trimmed 26332 records to 20872 (keeping 200 days of data) [2025-10-03T19:15:43.993080] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-03T19:15:44.033264] [DEBUG] [LOCAL ] GRDN: Primary data saved (20872 records). [2025-10-03T19:15:44.033409] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-03T19:15:44.033520] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRDN took 29.5s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-03T19:15:44.213954] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:44.253999] [DEBUG] [LOCAL ] GRNT: Loaded 34012 existing records from primary storage. [2025-10-03T19:15:44.254303] [INFO ] [MAIN ] GRNT: Loaded 34012 existing records. [2025-10-03T19:15:44.451131] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:44.451764] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-03T19:15:44.451869] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-03T19:15:44.452479] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-03T19:15:44.452545] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-03T19:15:44.793152] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-03T19:15:44.875328] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:15:44.879521] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:45.152945] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:15:45.566921] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-03T19:15:45.568965] [INFO ] [REMOTE ] GRC: Full fetch complete (13211 records). [2025-10-03T19:15:45.569071] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-03T19:15:45.595766] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-03T19:15:45.996779] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-03T19:15:45.996863] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-03T19:15:45.997208] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-03T19:15:45.997258] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-03T19:15:45.997885] [DEBUG] [LOCAL ] GRC: Trimmed 13211 records to 9165 (keeping 200 days of data) [2025-10-03T19:15:46.061816] [DEBUG] [LOCAL ] GRC: Primary data saved (9165 records). [2025-10-03T19:15:46.061986] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-03T19:15:46.062115] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRC took 36.6s. Estimated remaining: 3h 16m 32s. Rate: 7.1 symbols/min [2025-10-03T19:15:46.254503] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:46.267375] [DEBUG] [LOCAL ] GROV: Loaded 8931 existing records from primary storage. [2025-10-03T19:15:46.267732] [INFO ] [MAIN ] GROV: Loaded 8931 existing records. [2025-10-03T19:15:46.395900] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-03T19:15:46.482599] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:46.483056] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-03T19:15:46.483138] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-03T19:15:46.483367] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-03T19:15:46.483427] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-03T19:15:47.077862] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:47.190742] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-03T19:15:47.276836] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:15:47.777514] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:15:47.990717] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-03T19:15:48.401919] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:15:48.790638] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-03T19:15:49.266145] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T19:15:49.590745] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-03T19:15:49.708386] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-03T19:15:50.390693] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-03T19:15:51.151202] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:15:51.190708] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-03T19:15:51.574860] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-03T19:15:51.702460] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-03T19:15:51.990713] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-03T19:15:52.727923] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-03T19:15:52.790736] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-03T19:15:53.573984] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:15:53.590623] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-03T19:15:54.342813] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T19:15:54.390709] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-03T19:15:55.190725] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-03T19:15:55.971004] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:15:55.990633] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-03T19:15:56.622210] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:15:56.790712] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-03T19:15:57.233835] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:15:57.240688] [INFO ] [REMOTE ] GRMN: Full fetch complete (60012 records). [2025-10-03T19:15:57.240870] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-03T19:15:57.592838] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-03T19:15:57.604727] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:15:57.685383] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-03T19:15:57.685515] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-03T19:15:57.686468] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-03T19:15:57.686540] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-03T19:15:57.690425] [DEBUG] [LOCAL ] GRMN: Trimmed 60012 records to 41621 (keeping 200 days of data) [2025-10-03T19:15:57.982889] [DEBUG] [LOCAL ] GRMN: Primary data saved (41621 records). [2025-10-03T19:15:57.983026] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-03T19:15:57.983156] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRMN took 30.8s. Estimated remaining: 3h 16m 28s. Rate: 7.1 symbols/min [2025-10-03T19:15:58.168566] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:15:58.177209] [DEBUG] [LOCAL ] GRX: Loaded 4740 existing records from primary storage. [2025-10-03T19:15:58.177445] [INFO ] [MAIN ] GRX: Loaded 4740 existing records. [2025-10-03T19:15:58.386383] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:15:58.386701] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-03T19:15:58.386761] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-03T19:15:58.386982] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-03T19:15:58.387040] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-03T19:15:58.399180] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-03T19:15:58.779426] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:15:59.190694] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-03T19:15:59.206110] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:15:59.337140] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:15:59.990711] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-03T19:16:00.483722] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-03T19:16:00.488147] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-03T19:16:00.790715] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-03T19:16:01.590726] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-03T19:16:02.390697] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-03T19:16:02.533380] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:16:02.795476] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:16:03.016454] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:16:03.190721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-03T19:16:03.975381] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:16:03.990627] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-03T19:16:04.790694] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-03T19:16:05.292364] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:16:05.379246] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:16:05.590683] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-03T19:16:06.148682] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:16:06.149815] [INFO ] [REMOTE ] GROV: Full fetch complete (14318 records). [2025-10-03T19:16:06.150133] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-03T19:16:06.395732] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-03T19:16:06.555458] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-03T19:16:06.555548] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-03T19:16:06.555973] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-03T19:16:06.556039] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-03T19:16:06.556676] [DEBUG] [LOCAL ] GROV: Trimmed 14318 records to 8965 (keeping 200 days of data) [2025-10-03T19:16:06.617448] [DEBUG] [LOCAL ] GROV: Primary data saved (8965 records). [2025-10-03T19:16:06.617600] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-03T19:16:06.617743] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 20.6s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-03T19:16:06.798686] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:06.860056] [DEBUG] [LOCAL ] GS: Loaded 52244 existing records from primary storage. [2025-10-03T19:16:06.860388] [INFO ] [MAIN ] GS: Loaded 52244 existing records. [2025-10-03T19:16:07.050913] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:07.051199] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-03T19:16:07.051261] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-03T19:16:07.051614] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-03T19:16:07.051714] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-03T19:16:07.195837] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-03T19:16:07.457216] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:07.481295] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:16:07.990694] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-03T19:16:08.790685] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-03T19:16:08.867144] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:16:09.389072] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:16:09.390626] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:16:09.590711] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-03T19:16:10.061555] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-03T19:16:10.390703] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-03T19:16:11.190738] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-03T19:16:11.733186] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T19:16:11.990690] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-03T19:16:12.070338] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:16:12.790723] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-03T19:16:13.344695] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:16:13.590727] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-03T19:16:14.390720] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-03T19:16:14.437572] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:16:14.461339] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T19:16:14.463453] [INFO ] [REMOTE ] GRNT: Full fetch complete (48503 records). [2025-10-03T19:16:14.463552] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-03T19:16:14.875211] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-03T19:16:14.875293] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-03T19:16:14.876079] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-03T19:16:14.876147] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-03T19:16:14.877265] [DEBUG] [LOCAL ] GRNT: Trimmed 48503 records to 34272 (keeping 200 days of data) [2025-10-03T19:16:15.090411] [DEBUG] [LOCAL ] GRNT: Primary data saved (34272 records). [2025-10-03T19:16:15.090557] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-03T19:16:15.091689] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRNT took 31.1s. Estimated remaining: 3h 16m 12s. Rate: 7.1 symbols/min [2025-10-03T19:16:15.198776] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-03T19:16:15.280224] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:15.330091] [DEBUG] [LOCAL ] GSBD: Loaded 39460 existing records from primary storage. [2025-10-03T19:16:15.330425] [INFO ] [MAIN ] GSBD: Loaded 39460 existing records. [2025-10-03T19:16:15.519280] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:15.519563] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-03T19:16:15.519617] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-03T19:16:15.519973] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-03T19:16:15.520034] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-03T19:16:15.906492] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:15.990704] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-03T19:16:16.595523] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T19:16:16.597499] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-10-03T19:16:16.669435] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T19:16:16.790710] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-03T19:16:17.345563] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-03T19:16:17.590689] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-03T19:16:18.390672] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-03T19:16:19.190738] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-03T19:16:19.331717] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:16:19.562322] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:16:19.568392] [INFO ] [REMOTE ] GRND: Full fetch complete (71022 records). [2025-10-03T19:16:19.568547] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-03T19:16:20.001572] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-03T19:16:20.005269] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-03T19:16:20.006148] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-03T19:16:20.007222] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-03T19:16:20.007426] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-03T19:16:20.014966] [DEBUG] [LOCAL ] GRND: Trimmed 71022 records to 50674 (keeping 200 days of data) [2025-10-03T19:16:20.343185] [DEBUG] [LOCAL ] GRND: Primary data saved (50674 records). [2025-10-03T19:16:20.343387] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-03T19:16:20.343547] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRND took 45.0s. Estimated remaining: 3h 15m 59s. Rate: 7.1 symbols/min [2025-10-03T19:16:20.530510] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:20.588073] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-10-03T19:16:20.588522] [INFO ] [MAIN ] GSK: Loaded 53882 existing records. [2025-10-03T19:16:20.670579] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:16:20.795041] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-03T19:16:20.799289] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:20.800034] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-03T19:16:20.801048] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-03T19:16:20.802211] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-03T19:16:20.802279] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-03T19:16:21.198331] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:21.334109] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T19:16:21.590687] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-03T19:16:22.246130] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:16:22.390730] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-03T19:16:23.190705] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-03T19:16:23.682415] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T19:16:23.990732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-03T19:16:24.215486] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-03T19:16:24.376942] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-03T19:16:24.600908] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-03T19:16:24.790719] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-03T19:16:25.590735] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-03T19:16:26.390727] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-03T19:16:27.080975] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-03T19:16:27.190717] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-03T19:16:27.320270] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:16:27.837869] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:16:27.990694] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-03T19:16:28.622192] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:16:28.790618] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-03T19:16:28.979836] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T19:16:29.590727] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-03T19:16:30.390700] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-03T19:16:30.458512] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:16:30.464105] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:16:31.190732] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-03T19:16:31.855484] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:16:31.898771] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:16:31.899838] [INFO ] [REMOTE ] GRX: Full fetch complete (6677 records). [2025-10-03T19:16:31.899937] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-03T19:16:31.995784] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-03T19:16:32.307074] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-03T19:16:32.307153] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-03T19:16:32.307352] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-03T19:16:32.307413] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-03T19:16:32.307899] [DEBUG] [LOCAL ] GRX: Trimmed 6677 records to 4787 (keeping 200 days of data) [2025-10-03T19:16:32.337623] [DEBUG] [LOCAL ] GRX: Primary data saved (4787 records). [2025-10-03T19:16:32.337808] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-03T19:16:32.337928] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRX took 34.4s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-10-03T19:16:32.555017] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:32.597919] [DEBUG] [LOCAL ] GSL: Loaded 33513 existing records from primary storage. [2025-10-03T19:16:32.598216] [INFO ] [MAIN ] GSL: Loaded 33513 existing records. [2025-10-03T19:16:32.787549] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:32.787825] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-03T19:16:32.788067] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-03T19:16:32.788334] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-03T19:16:32.788393] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-03T19:16:32.796339] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-03T19:16:33.180910] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:33.541057] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-03T19:16:33.590663] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-03T19:16:34.390725] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-03T19:16:34.536145] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:16:34.881890] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:16:35.190731] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-03T19:16:35.737563] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:16:35.990722] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-03T19:16:36.790732] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-03T19:16:37.227496] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:16:37.440966] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:16:37.590729] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-03T19:16:38.390717] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-03T19:16:38.694720] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:16:39.094888] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-03T19:16:39.154598] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:16:39.190696] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-03T19:16:39.990757] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-03T19:16:40.790627] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-03T19:16:41.053282] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:16:41.590693] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-03T19:16:41.752305] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:16:42.130669] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:16:42.390729] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-03T19:16:42.898455] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:16:43.190701] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-03T19:16:43.990728] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-03T19:16:44.683762] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-03T19:16:44.790733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-03T19:16:45.178851] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:16:45.229220] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:16:45.590678] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-03T19:16:46.390704] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-03T19:16:46.866246] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-03T19:16:46.983425] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:16:47.190708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-03T19:16:47.926701] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:16:47.990718] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-03T19:16:48.790687] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-03T19:16:49.081787] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:16:49.590690] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-03T19:16:49.939785] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-03T19:16:50.026585] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:16:50.029107] [INFO ] [REMOTE ] GSBD: Full fetch complete (58502 records). [2025-10-03T19:16:50.029235] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-03T19:16:50.399821] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-03T19:16:50.449259] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-03T19:16:50.449352] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-03T19:16:50.450338] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-03T19:16:50.450432] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-03T19:16:50.451812] [DEBUG] [LOCAL ] GSBD: Trimmed 58502 records to 39772 (keeping 200 days of data) [2025-10-03T19:16:50.732290] [DEBUG] [LOCAL ] GSBD: Primary data saved (39772 records). [2025-10-03T19:16:50.732482] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-03T19:16:50.733284] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GSBD took 35.6s. Estimated remaining: 3h 16m 2s. Rate: 7.1 symbols/min [2025-10-03T19:16:50.923109] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:50.975294] [DEBUG] [LOCAL ] GTES: Loaded 50882 existing records from primary storage. [2025-10-03T19:16:50.975637] [INFO ] [MAIN ] GTES: Loaded 50882 existing records. [2025-10-03T19:16:51.162273] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:51.162482] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-03T19:16:51.162530] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-03T19:16:51.162831] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-03T19:16:51.162891] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-03T19:16:51.195795] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-03T19:16:51.579100] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:51.615254] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:16:51.778875] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:16:51.781622] [INFO ] [REMOTE ] GS: Full fetch complete (75694 records). [2025-10-03T19:16:51.781783] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-03T19:16:51.996077] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-03T19:16:52.250534] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-03T19:16:52.250753] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-03T19:16:52.252050] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-03T19:16:52.252166] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-03T19:16:52.254351] [DEBUG] [LOCAL ] GS: Trimmed 75694 records to 52615 (keeping 200 days of data) [2025-10-03T19:16:52.276802] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-03T19:16:52.640636] [DEBUG] [LOCAL ] GS: Primary data saved (52615 records). [2025-10-03T19:16:52.640810] [INFO ] [MAIN ] GS: Full history saved. [2025-10-03T19:16:52.640910] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GS took 46.0s. Estimated remaining: 3h 15m 44s. Rate: 7.1 symbols/min [2025-10-03T19:16:52.797263] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-03T19:16:52.832152] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:52.832525] [DEBUG] [LOCAL ] GTLS: No existing data file found in primary storage. [2025-10-03T19:16:52.832639] [WARN ] [MAIN ] GTLS: No existing data found, performing full refresh instead. [2025-10-03T19:16:52.832866] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-03T19:16:52.832923] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-03T19:16:52.832971] [DEBUG] [LOCAL ] GTLS: No primary data file found to delete. [2025-10-03T19:16:52.833043] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-03T19:16:53.220665] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:53.438554] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:16:53.442017] [INFO ] [REMOTE ] GSK: Full fetch complete (77472 records). [2025-10-03T19:16:53.442203] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-03T19:16:53.605738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-03T19:16:53.899810] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-03T19:16:53.899910] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-03T19:16:53.901097] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-03T19:16:53.901169] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-03T19:16:53.902880] [DEBUG] [LOCAL ] GSK: Trimmed 77472 records to 54272 (keeping 200 days of data) [2025-10-03T19:16:54.262858] [DEBUG] [LOCAL ] GSK: Primary data saved (54272 records). [2025-10-03T19:16:54.263048] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-03T19:16:54.263171] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 33.9s. Estimated remaining: 3h 15m 26s. Rate: 7.1 symbols/min [2025-10-03T19:16:54.391983] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-03T19:16:54.464054] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:16:54.507911] [DEBUG] [LOCAL ] GTN: Loaded 45825 existing records from primary storage. [2025-10-03T19:16:54.508239] [INFO ] [MAIN ] GTN: Loaded 45825 existing records. [2025-10-03T19:16:54.707343] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:16:54.707579] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-03T19:16:54.707874] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-03T19:16:54.718361] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-03T19:16:54.737463] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-03T19:16:54.786939] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-03T19:16:55.161177] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:16:55.190689] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-03T19:16:55.352258] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-03T19:16:55.790266] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:16:55.990710] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-03T19:16:56.790673] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-03T19:16:56.857638] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:16:57.362670] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:16:57.590729] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-03T19:16:58.047018] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T19:16:58.390733] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-03T19:16:59.190681] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-03T19:16:59.231508] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:16:59.748572] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:16:59.990710] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-03T19:17:00.790699] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-03T19:17:01.074423] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:17:01.590684] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-03T19:17:01.742715] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-03T19:17:02.390680] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-03T19:17:02.465041] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:17:03.155250] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:17:03.190693] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-03T19:17:03.397982] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:17:03.990699] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-03T19:17:04.520663] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:17:04.790697] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-03T19:17:05.110466] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T19:17:05.112422] [INFO ] [REMOTE ] GSL: Full fetch complete (47895 records). [2025-10-03T19:17:05.112720] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-03T19:17:05.543251] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-03T19:17:05.543348] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-03T19:17:05.544233] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-03T19:17:05.544303] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-03T19:17:05.545519] [DEBUG] [LOCAL ] GSL: Trimmed 47895 records to 33701 (keeping 200 days of data) [2025-10-03T19:17:05.605179] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-03T19:17:05.795512] [DEBUG] [LOCAL ] GSL: Primary data saved (33701 records). [2025-10-03T19:17:05.795687] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-03T19:17:05.795834] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 33.5s. Estimated remaining: 3h 15m 22s. Rate: 7.1 symbols/min [2025-10-03T19:17:05.994169] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:06.026771] [DEBUG] [LOCAL ] GTY: Loaded 30501 existing records from primary storage. [2025-10-03T19:17:06.027081] [INFO ] [MAIN ] GTY: Loaded 30501 existing records. [2025-10-03T19:17:06.234861] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:06.235142] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-03T19:17:06.236238] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-03T19:17:06.236470] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-03T19:17:06.236529] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-03T19:17:06.397499] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-03T19:17:06.700685] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:06.704794] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:17:07.190694] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-03T19:17:07.316478] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:17:07.990630] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-03T19:17:08.078519] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:17:08.111385] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:17:08.790738] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-03T19:17:09.598635] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-03T19:17:09.621103] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-03T19:17:10.289461] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:17:10.390695] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-03T19:17:11.190680] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-03T19:17:11.419094] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-03T19:17:11.455630] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:17:11.990696] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-03T19:17:12.574755] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:17:12.790670] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-03T19:17:13.396890] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:17:13.590738] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-03T19:17:14.402283] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-03T19:17:14.405247] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:17:14.962204] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:17:15.190684] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-03T19:17:15.463616] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:17:15.990741] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-03T19:17:16.783336] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:17:16.796556] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-03T19:17:17.302092] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T19:17:17.590722] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-03T19:17:18.390851] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-03T19:17:18.446157] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:17:19.108294] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:17:19.190728] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-03T19:17:19.450476] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-03T19:17:19.990702] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-03T19:17:20.790467] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:17:20.801176] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-03T19:17:21.590632] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-03T19:17:21.707724] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:17:22.390701] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-03T19:17:22.498755] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:17:22.947082] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:17:23.190732] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-03T19:17:23.990678] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-03T19:17:24.088548] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:17:24.295397] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:17:24.790722] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-03T19:17:25.549574] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:17:25.590739] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-03T19:17:26.389326] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-03T19:17:26.398808] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-03T19:17:26.867430] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:17:26.870299] [INFO ] [REMOTE ] GTES: Full fetch complete (73873 records). [2025-10-03T19:17:26.870422] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-03T19:17:27.196001] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-03T19:17:27.316824] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-03T19:17:27.316925] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-03T19:17:27.317920] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-03T19:17:27.317987] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-03T19:17:27.319510] [DEBUG] [LOCAL ] GTES: Trimmed 73873 records to 51249 (keeping 200 days of data) [2025-10-03T19:17:27.640278] [DEBUG] [LOCAL ] GTES: Primary data saved (51249 records). [2025-10-03T19:17:27.640454] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-03T19:17:27.640578] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 36.9s. Estimated remaining: 3h 15m 32s. Rate: 7.1 symbols/min [2025-10-03T19:17:27.837769] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:27.859337] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-03T19:17:27.879373] [DEBUG] [LOCAL ] GUG: Loaded 12171 existing records from primary storage. [2025-10-03T19:17:27.879599] [INFO ] [MAIN ] GUG: Loaded 12171 existing records. [2025-10-03T19:17:27.994123] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-03T19:17:28.077887] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:28.078108] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-03T19:17:28.078157] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-03T19:17:28.078504] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-03T19:17:28.078564] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-03T19:17:28.487002] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:28.495968] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:17:28.499567] [INFO ] [REMOTE ] GTLS: Full fetch complete (61408 records). [2025-10-03T19:17:28.499809] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-03T19:17:28.797419] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-03T19:17:28.948060] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-03T19:17:28.948141] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-03T19:17:28.949076] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-03T19:17:28.949141] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-03T19:17:28.950371] [DEBUG] [LOCAL ] GTLS: Trimmed 61408 records to 43398 (keeping 200 days of data) [2025-10-03T19:17:29.219760] [DEBUG] [LOCAL ] GTLS: Primary data saved (43398 records). [2025-10-03T19:17:29.219899] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-03T19:17:29.219985] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTLS took 36.6s. Estimated remaining: 3h 15m 14s. Rate: 7.1 symbols/min [2025-10-03T19:17:29.400496] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:29.422239] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T19:17:29.441978] [DEBUG] [LOCAL ] GUT: Loaded 15401 existing records from primary storage. [2025-10-03T19:17:29.442227] [INFO ] [MAIN ] GUT: Loaded 15401 existing records. [2025-10-03T19:17:29.595910] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-03T19:17:29.643818] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:29.644051] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-03T19:17:29.644101] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-03T19:17:29.644367] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-03T19:17:29.644433] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-03T19:17:30.050175] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:30.231128] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:17:30.390685] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-03T19:17:30.883501] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T19:17:31.190731] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-03T19:17:31.720638] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:17:31.723030] [INFO ] [REMOTE ] GTN: Full fetch complete (66395 records). [2025-10-03T19:17:31.723141] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-03T19:17:32.009728] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-03T19:17:32.096865] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-03T19:17:32.233208] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-03T19:17:32.233290] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-03T19:17:32.234271] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-03T19:17:32.234339] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-03T19:17:32.235814] [DEBUG] [LOCAL ] GTN: Trimmed 66395 records to 46115 (keeping 200 days of data) [2025-10-03T19:17:32.521239] [DEBUG] [LOCAL ] GTN: Primary data saved (46115 records). [2025-10-03T19:17:32.521380] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-03T19:17:32.521469] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTN took 38.3s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-10-03T19:17:32.696408] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:32.730867] [DEBUG] [LOCAL ] GVA: Loaded 33350 existing records from primary storage. [2025-10-03T19:17:32.731152] [INFO ] [MAIN ] GVA: Loaded 33350 existing records. [2025-10-03T19:17:32.802803] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-03T19:17:32.932358] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:32.932590] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-03T19:17:32.932667] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-03T19:17:32.932939] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-03T19:17:32.933000] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-03T19:17:33.252777] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:17:33.284071] [INFO ] [REMOTE ] GTY: Full fetch complete (43601 records). [2025-10-03T19:17:33.301320] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-03T19:17:33.339899] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:33.595868] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-03T19:17:33.755823] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-03T19:17:33.756024] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-03T19:17:33.756918] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-03T19:17:33.757012] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-03T19:17:33.758404] [DEBUG] [LOCAL ] GTY: Trimmed 43601 records to 30751 (keeping 200 days of data) [2025-10-03T19:17:33.890834] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:17:33.982288] [DEBUG] [LOCAL ] GTY: Primary data saved (30751 records). [2025-10-03T19:17:33.982489] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-03T19:17:33.982606] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTY took 28.2s. Estimated remaining: 3h 14m 40s. Rate: 7.1 symbols/min [2025-10-03T19:17:34.170354] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:34.189407] [DEBUG] [LOCAL ] GWH: Loaded 16198 existing records from primary storage. [2025-10-03T19:17:34.189674] [INFO ] [MAIN ] GWH: Loaded 16198 existing records. [2025-10-03T19:17:34.389399] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:17:34.389622] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-03T19:17:34.389706] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-03T19:17:34.389931] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-03T19:17:34.389991] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-03T19:17:34.398720] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-03T19:17:34.797602] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:34.810377] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-03T19:17:35.190717] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-03T19:17:35.935007] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:17:35.977375] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-03T19:17:35.990608] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-03T19:17:36.785323] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:17:36.790614] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-03T19:17:37.590696] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-03T19:17:37.718755] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-03T19:17:38.390698] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-03T19:17:38.452239] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:17:38.919674] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-03T19:17:39.190733] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-03T19:17:39.990701] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-03T19:17:40.536887] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:17:40.756171] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:17:40.790617] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-03T19:17:41.590716] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-03T19:17:41.610731] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-03T19:17:42.390729] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-03T19:17:43.190682] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-03T19:17:43.344766] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:17:43.931412] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:17:43.990701] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-03T19:17:44.790688] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-03T19:17:44.949498] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:17:45.588349] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-03T19:17:45.590837] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-03T19:17:45.931618] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (4.34 seconds). [2025-10-03T19:17:46.390749] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-03T19:17:46.580633] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:17:47.190680] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-03T19:17:47.409032] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-03T19:17:47.990698] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-03T19:17:48.321069] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:17:48.790633] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-03T19:17:49.017735] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T19:17:49.590704] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-03T19:17:50.390743] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-03T19:17:50.452512] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:17:50.499744] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:17:51.190798] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-03T19:17:51.206770] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:17:51.990740] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-03T19:17:52.194323] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T19:17:52.771222] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T19:17:52.790691] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-03T19:17:53.503665] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:17:53.504897] [INFO ] [REMOTE ] GUG: Full fetch complete (19781 records). [2025-10-03T19:17:53.504974] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-03T19:17:53.595870] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-03T19:17:53.961905] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-03T19:17:53.961992] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-03T19:17:53.962505] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-03T19:17:53.962550] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-03T19:17:53.963272] [DEBUG] [LOCAL ] GUG: Trimmed 19781 records to 12272 (keeping 200 days of data) [2025-10-03T19:17:54.049131] [DEBUG] [LOCAL ] GUG: Primary data saved (12272 records). [2025-10-03T19:17:54.049303] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-03T19:17:54.049457] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 26.4s. Estimated remaining: 3h 14m 48s. Rate: 7.1 symbols/min [2025-10-03T19:17:54.243774] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:17:54.243944] [DEBUG] [LOCAL ] GWRE: No existing data file found in primary storage. [2025-10-03T19:17:54.243984] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-10-03T19:17:54.244109] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-03T19:17:54.244153] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-03T19:17:54.244197] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-03T19:17:54.244231] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-03T19:17:54.397379] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-03T19:17:54.643087] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:17:54.901298] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:17:55.040737] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-03T19:17:55.190692] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-03T19:17:55.990702] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-03T19:17:56.644232] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:17:56.667737] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:17:56.790703] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-03T19:17:57.590683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-03T19:17:57.855781] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T19:17:58.390698] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-03T19:17:58.921929] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T19:17:59.190707] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-03T19:17:59.480044] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-03T19:17:59.990694] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-03T19:18:00.707905] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:18:00.790697] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-03T19:18:00.947385] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:18:01.590701] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-03T19:18:02.270784] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:18:02.390680] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-03T19:18:02.625735] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:18:03.190708] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-03T19:18:03.703735] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:18:03.990692] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-03T19:18:04.314201] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:18:04.775315] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:18:04.777018] [INFO ] [REMOTE ] GUT: Full fetch complete (22679 records). [2025-10-03T19:18:04.777176] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-03T19:18:04.795754] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-03T19:18:05.201872] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-03T19:18:05.202007] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-03T19:18:05.202548] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-03T19:18:05.202597] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-03T19:18:05.203284] [DEBUG] [LOCAL ] GUT: Trimmed 22679 records to 15460 (keeping 200 days of data) [2025-10-03T19:18:05.296875] [DEBUG] [LOCAL ] GUT: Primary data saved (15460 records). [2025-10-03T19:18:05.297029] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-03T19:18:05.297154] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GUT took 36.1s. Estimated remaining: 3h 14m 44s. Rate: 7.1 symbols/min [2025-10-03T19:18:05.474540] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:05.474759] [DEBUG] [LOCAL ] GWW: No existing data file found in primary storage. [2025-10-03T19:18:05.474807] [WARN ] [MAIN ] GWW: No existing data found, performing full refresh instead. [2025-10-03T19:18:05.474923] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-03T19:18:05.474967] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-03T19:18:05.475009] [DEBUG] [LOCAL ] GWW: No primary data file found to delete. [2025-10-03T19:18:05.475044] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-03T19:18:05.595851] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-03T19:18:05.869936] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:06.390633] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-03T19:18:06.427465] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:18:06.729557] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:18:06.731088] [INFO ] [REMOTE ] GWH: Full fetch complete (21396 records). [2025-10-03T19:18:06.731162] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-03T19:18:07.143537] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-03T19:18:07.143618] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-03T19:18:07.144176] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-03T19:18:07.144242] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-03T19:18:07.144935] [DEBUG] [LOCAL ] GWH: Trimmed 21396 records to 16446 (keeping 200 days of data) [2025-10-03T19:18:07.192044] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-03T19:18:07.247294] [DEBUG] [LOCAL ] GWH: Primary data saved (16446 records). [2025-10-03T19:18:07.247459] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-03T19:18:07.247555] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GWH took 33.3s. Estimated remaining: 3h 14m 26s. Rate: 7.1 symbols/min [2025-10-03T19:18:07.443478] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:07.443974] [DEBUG] [LOCAL ] GXO: No existing data file found in primary storage. [2025-10-03T19:18:07.444207] [WARN ] [MAIN ] GXO: No existing data found, performing full refresh instead. [2025-10-03T19:18:07.444524] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-03T19:18:07.450461] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-03T19:18:07.458724] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-03T19:18:07.458805] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-03T19:18:07.496316] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:18:07.867963] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:07.990721] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-03T19:18:08.551253] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:18:08.790683] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-03T19:18:09.063787] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T19:18:09.590712] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-03T19:18:10.351328] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:18:10.390733] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-03T19:18:10.977929] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:18:11.190701] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-03T19:18:11.476487] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:18:11.990717] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-03T19:18:12.416443] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T19:18:12.790679] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-03T19:18:13.162677] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:18:13.590731] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-03T19:18:14.390700] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-03T19:18:14.446124] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:18:14.916374] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:18:15.190677] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-03T19:18:15.569915] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-03T19:18:15.990704] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-03T19:18:16.070489] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:18:16.072480] [INFO ] [REMOTE ] GVA: Full fetch complete (48554 records). [2025-10-03T19:18:16.072603] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-03T19:18:16.519916] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-03T19:18:16.520095] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-03T19:18:16.520931] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-03T19:18:16.521006] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-03T19:18:16.522304] [DEBUG] [LOCAL ] GVA: Trimmed 48554 records to 33604 (keeping 200 days of data) [2025-10-03T19:18:16.743540] [DEBUG] [LOCAL ] GVA: Primary data saved (33604 records). [2025-10-03T19:18:16.743738] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-03T19:18:16.743849] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GVA took 44.2s. Estimated remaining: 3h 14m 20s. Rate: 7.1 symbols/min [2025-10-03T19:18:16.795800] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-03T19:18:16.931759] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:16.932046] [DEBUG] [LOCAL ] GYLD: No existing data file found in primary storage. [2025-10-03T19:18:16.932090] [WARN ] [MAIN ] GYLD: No existing data found, performing full refresh instead. [2025-10-03T19:18:16.932165] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-03T19:18:16.932203] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-03T19:18:16.932243] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-03T19:18:16.932276] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-03T19:18:17.337594] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:17.367800] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:18:17.590738] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-03T19:18:18.056059] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-03T19:18:18.390733] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-03T19:18:19.053419] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-03T19:18:19.190711] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-03T19:18:19.990720] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-03T19:18:20.155562] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:18:20.179760] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:18:20.790736] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-03T19:18:21.071219] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-10-03T19:18:21.356314] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-03T19:18:21.590739] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-03T19:18:22.390718] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-03T19:18:22.997135] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-03T19:18:23.190670] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-03T19:18:23.424159] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:18:23.990693] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-03T19:18:24.587366] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:18:24.790683] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-03T19:18:25.161260] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:18:25.590692] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-03T19:18:26.390636] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-03T19:18:26.635213] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:18:26.713551] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:18:26.746722] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-03T19:18:27.190701] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-03T19:18:27.990700] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-03T19:18:28.677534] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:18:28.757167] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:18:28.790707] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-03T19:18:29.590769] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-03T19:18:30.368169] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:18:30.390705] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-03T19:18:30.752683] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-03T19:18:31.038586] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:18:31.040953] [INFO ] [REMOTE ] GWRE: Full fetch complete (60963 records). [2025-10-03T19:18:31.041135] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-03T19:18:31.199089] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-03T19:18:31.478000] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-03T19:18:31.478393] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-03T19:18:31.479670] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-03T19:18:31.479916] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-03T19:18:31.481500] [DEBUG] [LOCAL ] GWRE: Trimmed 60963 records to 41111 (keeping 200 days of data) [2025-10-03T19:18:31.763028] [DEBUG] [LOCAL ] GWRE: Primary data saved (41111 records). [2025-10-03T19:18:31.763163] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-03T19:18:31.763278] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 37.7s. Estimated remaining: 3h 14m 20s. Rate: 7.1 symbols/min [2025-10-03T19:18:31.947935] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:31.948134] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-03T19:18:31.948190] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-03T19:18:31.948408] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-03T19:18:31.948465] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-03T19:18:31.948536] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-03T19:18:31.948573] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-03T19:18:31.995768] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-03T19:18:32.251552] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-03T19:18:32.284743] [INFO ] [REMOTE ] GWW: Full fetch complete (29244 records). [2025-10-03T19:18:32.290086] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-03T19:18:32.481422] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:32.529014] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-03T19:18:32.783689] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-03T19:18:32.783808] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-03T19:18:32.784442] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-03T19:18:32.784487] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-03T19:18:32.785413] [DEBUG] [LOCAL ] GWW: Trimmed 29244 records to 19715 (keeping 200 days of data) [2025-10-03T19:18:32.790694] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-03T19:18:32.924386] [DEBUG] [LOCAL ] GWW: Primary data saved (19715 records). [2025-10-03T19:18:32.924578] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-03T19:18:32.924683] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 27.6s. Estimated remaining: 3h 14m 2s. Rate: 7.1 symbols/min [2025-10-03T19:18:33.109610] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:33.109853] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-03T19:18:33.109904] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-03T19:18:33.109993] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-03T19:18:33.110040] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-03T19:18:33.110092] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-03T19:18:33.110137] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-03T19:18:33.489958] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:33.590697] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-03T19:18:34.390632] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-03T19:18:34.425958] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:18:34.815855] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T19:18:34.956629] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:18:35.190691] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-03T19:18:35.553488] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-03T19:18:35.990716] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-03T19:18:36.790709] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-03T19:18:37.402151] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:18:37.590700] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-03T19:18:38.003181] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-03T19:18:38.391966] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-03T19:18:38.397384] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:18:39.190738] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-03T19:18:39.880938] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:18:39.990717] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-03T19:18:40.146777] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:18:40.790738] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-03T19:18:41.187771] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T19:18:41.590714] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-03T19:18:42.037570] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:18:42.105634] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:18:42.390725] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-03T19:18:43.190738] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-03T19:18:43.961751] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:18:43.990663] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-03T19:18:44.790723] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-03T19:18:44.967952] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:18:45.112756] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:18:45.228963] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:18:45.590692] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-03T19:18:46.390705] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-03T19:18:47.190734] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-03T19:18:47.261061] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:18:47.628783] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:18:47.631177] [INFO ] [REMOTE ] GXO: Full fetch complete (69912 records). [2025-10-03T19:18:47.631288] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-03T19:18:47.703844] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T19:18:47.995770] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-03T19:18:48.059541] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-03T19:18:48.059634] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-03T19:18:48.061269] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-03T19:18:48.061347] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-03T19:18:48.066157] [DEBUG] [LOCAL ] GXO: Trimmed 69912 records to 48019 (keeping 200 days of data) [2025-10-03T19:18:48.369315] [DEBUG] [LOCAL ] GXO: Primary data saved (48019 records). [2025-10-03T19:18:48.369473] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-03T19:18:48.369568] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GXO took 41.1s. Estimated remaining: 3h 14m 3s. Rate: 7.1 symbols/min [2025-10-03T19:18:48.559630] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:48.559839] [DEBUG] [LOCAL ] HAFN: No existing data file found in primary storage. [2025-10-03T19:18:48.559902] [WARN ] [MAIN ] HAFN: No existing data found, performing full refresh instead. [2025-10-03T19:18:48.560020] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-03T19:18:48.560063] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-03T19:18:48.560106] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-03T19:18:48.560139] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-03T19:18:48.797410] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-03T19:18:48.988206] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:49.590691] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-03T19:18:49.642306] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:18:49.999202] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-03T19:18:49.999978] [INFO ] [REMOTE ] GYLD: Full fetch complete (2073 records). [2025-10-03T19:18:50.000054] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-03T19:18:50.392001] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-03T19:18:50.391681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-03T19:18:50.392303] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-03T19:18:50.392750] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-03T19:18:50.393715] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-03T19:18:50.394543] [DEBUG] [LOCAL ] GYLD: Trimmed 2073 records to 1558 (keeping 200 days of data) [2025-10-03T19:18:50.405406] [DEBUG] [LOCAL ] GYLD: Primary data saved (1558 records). [2025-10-03T19:18:50.405482] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-03T19:18:50.405551] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. GYLD took 33.7s. Estimated remaining: 3h 13m 46s. Rate: 7.1 symbols/min [2025-10-03T19:18:50.597638] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:18:50.598169] [DEBUG] [LOCAL ] HAL: No existing data file found in primary storage. [2025-10-03T19:18:50.598226] [WARN ] [MAIN ] HAL: No existing data found, performing full refresh instead. [2025-10-03T19:18:50.607760] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-03T19:18:50.624073] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-03T19:18:50.625896] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-03T19:18:50.625807] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:18:50.626022] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-03T19:18:51.029223] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:18:51.190700] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-03T19:18:51.883792] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:18:51.990728] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-03T19:18:52.575676] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:18:52.790694] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-03T19:18:53.590700] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-03T19:18:53.731873] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:18:54.390710] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-03T19:18:54.690017] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:18:54.774899] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T19:18:55.190696] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-03T19:18:55.990695] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-03T19:18:56.182537] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T19:18:56.737606] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:18:56.790688] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-03T19:18:57.446785] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:18:57.590698] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-03T19:18:58.390681] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-03T19:18:58.493562] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:18:59.190631] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-03T19:18:59.366076] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:18:59.439258] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:18:59.990697] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-03T19:19:00.790684] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-03T19:19:00.946994] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:19:01.530950] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:19:01.590634] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-03T19:19:02.390671] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-03T19:19:02.509151] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:19:03.190683] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-03T19:19:03.570181] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-03T19:19:03.990638] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-03T19:19:04.167945] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-03T19:19:04.790673] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-03T19:19:04.829145] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:19:05.590639] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-03T19:19:05.709429] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:19:06.390634] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-03T19:19:06.422399] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:19:07.190693] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-03T19:19:07.761481] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-03T19:19:07.809611] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T19:19:07.812237] [INFO ] [REMOTE ] HAE: Full fetch complete (58368 records). [2025-10-03T19:19:07.812397] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-03T19:19:08.005060] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-03T19:19:08.239552] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-03T19:19:08.239635] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-03T19:19:08.240554] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-03T19:19:08.240619] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-03T19:19:08.242226] [DEBUG] [LOCAL ] HAE: Trimmed 58368 records to 40132 (keeping 200 days of data) [2025-10-03T19:19:08.486590] [DEBUG] [LOCAL ] HAE: Primary data saved (40132 records). [2025-10-03T19:19:08.486753] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-03T19:19:08.486838] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 35.6s. Estimated remaining: 3h 13m 51s. Rate: 7.1 symbols/min [2025-10-03T19:19:08.679275] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:08.679563] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-10-03T19:19:08.679671] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-10-03T19:19:08.679865] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-03T19:19:08.679912] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-03T19:19:08.679954] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-03T19:19:08.679987] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-03T19:19:08.791152] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-03T19:19:09.103607] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:09.106500] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T19:19:09.590729] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-03T19:19:09.846097] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:19:10.218290] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:19:10.221107] [INFO ] [REMOTE ] H: Full fetch complete (62289 records). [2025-10-03T19:19:10.221232] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-03T19:19:10.402002] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-03T19:19:10.637828] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-03T19:19:10.637955] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-03T19:19:10.638847] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-03T19:19:10.638911] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-03T19:19:10.640322] [DEBUG] [LOCAL ] H: Trimmed 62289 records to 45308 (keeping 200 days of data) [2025-10-03T19:19:10.938032] [DEBUG] [LOCAL ] H: Primary data saved (45308 records). [2025-10-03T19:19:10.938170] [INFO ] [MAIN ] H: Full history saved. [2025-10-03T19:19:10.938252] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. H took 39.2s. Estimated remaining: 3h 13m 34s. Rate: 7.1 symbols/min [2025-10-03T19:19:11.130468] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:11.130678] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-10-03T19:19:11.130844] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-10-03T19:19:11.131109] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-03T19:19:11.131169] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-03T19:19:11.131269] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-03T19:19:11.131430] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-03T19:19:11.210716] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-03T19:19:11.449296] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-03T19:19:11.581069] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:11.990677] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-03T19:19:12.145533] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:19:12.790756] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-03T19:19:13.220001] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:19:13.437945] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:19:13.590727] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-03T19:19:14.390707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-03T19:19:14.560245] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:19:15.190738] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-03T19:19:15.713766] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:19:15.757931] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:19:15.990688] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-03T19:19:16.738204] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-03T19:19:16.790697] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-03T19:19:17.520134] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:19:17.590727] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-03T19:19:18.390732] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-03T19:19:18.470424] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:19:19.101730] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:19:19.190688] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-03T19:19:19.656049] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:19:19.990726] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-03T19:19:20.790710] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-03T19:19:21.205306] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:19:21.600222] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-03T19:19:21.638047] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:19:22.135544] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:19:22.390730] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-03T19:19:23.190702] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-03T19:19:23.661892] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-03T19:19:23.990637] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-03T19:19:24.044734] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:19:24.538018] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T19:19:24.790714] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-03T19:19:25.590707] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-03T19:19:25.758068] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T19:19:25.763333] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-10-03T19:19:25.763459] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-03T19:19:26.218507] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-03T19:19:26.218763] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-03T19:19:26.219894] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-03T19:19:26.220009] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-03T19:19:26.232191] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54498 (keeping 200 days of data) [2025-10-03T19:19:26.255057] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:19:26.390782] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-03T19:19:26.627368] [DEBUG] [LOCAL ] HAL: Primary data saved (54498 records). [2025-10-03T19:19:26.627628] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-03T19:19:26.627794] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAL took 36.2s. Estimated remaining: 3h 13m 36s. Rate: 7.1 symbols/min [2025-10-03T19:19:26.811798] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:26.811982] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-03T19:19:26.812040] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-03T19:19:26.812169] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-03T19:19:26.812213] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-03T19:19:26.812257] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-03T19:19:26.812305] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-03T19:19:27.099242] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T19:19:27.133412] [INFO ] [REMOTE ] HAFN: Full fetch complete (65458 records). [2025-10-03T19:19:27.138774] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-03T19:19:27.207138] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-03T19:19:27.289101] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:27.636353] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-03T19:19:27.636437] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-03T19:19:27.637458] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-03T19:19:27.637529] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-03T19:19:27.639154] [DEBUG] [LOCAL ] HAFN: Trimmed 65458 records to 43932 (keeping 200 days of data) [2025-10-03T19:19:27.918883] [DEBUG] [LOCAL ] HAFN: Primary data saved (43932 records). [2025-10-03T19:19:27.919060] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-03T19:19:27.919215] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HAFN took 39.5s. Estimated remaining: 3h 13m 18s. Rate: 7.1 symbols/min [2025-10-03T19:19:27.991531] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-03T19:19:28.116270] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:28.116551] [DEBUG] [LOCAL ] HBI: No existing data file found in primary storage. [2025-10-03T19:19:28.116859] [WARN ] [MAIN ] HBI: No existing data found, performing full refresh instead. [2025-10-03T19:19:28.117032] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-03T19:19:28.131959] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-03T19:19:28.142787] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-03T19:19:28.142870] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-03T19:19:28.208016] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:19:28.559692] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:28.790670] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-03T19:19:28.824019] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-03T19:19:29.030812] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:19:29.590722] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-03T19:19:30.391374] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-03T19:19:30.391279] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:19:31.080624] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T19:19:31.190720] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-03T19:19:31.274542] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:19:31.990681] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-03T19:19:32.790703] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-03T19:19:32.852678] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T19:19:33.430105] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-03T19:19:33.590738] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-03T19:19:33.663386] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:19:34.275300] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T19:19:34.390669] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-03T19:19:35.190717] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-03T19:19:35.268917] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-03T19:19:35.990737] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-03T19:19:36.478816] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:19:36.790716] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-03T19:19:37.590696] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-03T19:19:37.641386] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:19:38.379994] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-03T19:19:38.390604] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-03T19:19:38.641668] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T19:19:38.986838] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T19:19:39.190722] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-03T19:19:39.990704] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-03T19:19:40.597371] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:19:40.790698] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-03T19:19:41.148030] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:19:41.590693] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-03T19:19:42.390722] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-03T19:19:42.513252] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:19:42.823386] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-03T19:19:43.190632] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-03T19:19:43.261693] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T19:19:43.990699] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-03T19:19:44.801549] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-03T19:19:44.809785] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:19:45.365835] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T19:19:45.590665] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-03T19:19:45.645865] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:19:46.390693] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-03T19:19:47.190630] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-03T19:19:47.310341] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-03T19:19:47.807532] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-03T19:19:47.810517] [INFO ] [REMOTE ] HASI: Full fetch complete (68123 records). [2025-10-03T19:19:47.810705] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-03T19:19:47.992952] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-03T19:19:48.249363] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-03T19:19:48.249457] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-03T19:19:48.250452] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-03T19:19:48.250527] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-03T19:19:48.252436] [DEBUG] [LOCAL ] HASI: Trimmed 68123 records to 47850 (keeping 200 days of data) [2025-10-03T19:19:48.568732] [DEBUG] [LOCAL ] HASI: Primary data saved (47850 records). [2025-10-03T19:19:48.568930] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-03T19:19:48.569104] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HASI took 40.1s. Estimated remaining: 3h 13m 26s. Rate: 7.1 symbols/min [2025-10-03T19:19:48.750697] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T19:19:48.810278] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-03T19:19:48.810212] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:48.811513] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-03T19:19:48.811574] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-03T19:19:48.811713] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-03T19:19:48.811766] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-03T19:19:48.811812] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-03T19:19:48.811847] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-03T19:19:49.237275] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:49.412155] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T19:19:49.413055] [INFO ] [REMOTE ] HBB: Full fetch complete (9516 records). [2025-10-03T19:19:49.413144] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-03T19:19:49.572379] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:19:49.607727] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-03T19:19:49.620232] [INFO ] [REMOTE ] HAYW: Full fetch complete (70874 records). [2025-10-03T19:19:49.667346] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-03T19:19:49.998900] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-03T19:19:50.008043] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-03T19:19:50.035744] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-03T19:19:50.093353] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-03T19:19:50.160453] [DEBUG] [LOCAL ] HBB: Trimmed 9516 records to 6659 (keeping 200 days of data) [2025-10-03T19:19:50.317876] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-03T19:19:50.318215] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-03T19:19:50.319430] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-03T19:19:50.319887] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-03T19:19:50.324792] [DEBUG] [LOCAL ] HAYW: Trimmed 70874 records to 49424 (keeping 200 days of data) [2025-10-03T19:19:50.331373] [DEBUG] [LOCAL ] HBB: Primary data saved (6659 records). [2025-10-03T19:19:50.331509] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-03T19:19:50.331600] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HBB took 23.7s. Estimated remaining: 3h 13m 8s. Rate: 7.1 symbols/min [2025-10-03T19:19:50.394783] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-03T19:19:50.632141] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:50.634704] [DEBUG] [LOCAL ] HCA: No existing data file found in primary storage. [2025-10-03T19:19:50.635110] [WARN ] [MAIN ] HCA: No existing data found, performing full refresh instead. [2025-10-03T19:19:50.636362] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-03T19:19:50.637066] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-03T19:19:50.637157] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-03T19:19:50.637474] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-03T19:19:51.057474] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:51.212103] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-03T19:19:51.252817] [DEBUG] [LOCAL ] HAYW: Primary data saved (49424 records). [2025-10-03T19:19:51.252996] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-03T19:19:51.253100] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HAYW took 40.3s. Estimated remaining: 3h 12m 50s. Rate: 7.1 symbols/min [2025-10-03T19:19:51.442167] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:19:51.442481] [DEBUG] [LOCAL ] HCC: No existing data file found in primary storage. [2025-10-03T19:19:51.442563] [WARN ] [MAIN ] HCC: No existing data found, performing full refresh instead. [2025-10-03T19:19:51.442755] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-03T19:19:51.442805] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-03T19:19:51.442852] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-03T19:19:51.442888] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-03T19:19:51.672959] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-03T19:19:51.878244] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:19:51.990633] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-03T19:19:52.157580] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T19:19:52.790634] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-03T19:19:53.045205] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:19:53.441425] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-03T19:19:53.590693] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-03T19:19:54.390631] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-03T19:19:54.635378] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:19:55.190706] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-03T19:19:55.429228] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:19:55.912580] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:19:55.990731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-03T19:19:56.751566] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:19:56.790669] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-03T19:19:57.590685] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-03T19:19:57.724121] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:19:58.390666] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-03T19:19:58.497584] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:19:59.190676] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-03T19:19:59.226817] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:19:59.932308] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:19:59.935077] [INFO ] [REMOTE ] HBI: Full fetch complete (76889 records). [2025-10-03T19:19:59.935463] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-03T19:19:59.995744] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-03T19:20:00.407179] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-03T19:20:00.407272] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-03T19:20:00.408317] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-03T19:20:00.408385] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-03T19:20:00.410016] [DEBUG] [LOCAL ] HBI: Trimmed 76889 records to 53763 (keeping 200 days of data) [2025-10-03T19:20:00.728009] [DEBUG] [LOCAL ] HBI: Primary data saved (53763 records). [2025-10-03T19:20:00.728168] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-03T19:20:00.728277] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HBI took 32.8s. Estimated remaining: 3h 12m 43s. Rate: 7.1 symbols/min [2025-10-03T19:20:00.790705] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-03T19:20:01.061320] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:20:01.590728] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-03T19:20:01.953305] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:20:02.039904] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T19:20:02.390713] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-03T19:20:03.189252] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T19:20:03.199869] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-03T19:20:03.768008] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:20:03.990729] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-03T19:20:04.790637] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-03T19:20:04.883055] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:20:05.590729] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-03T19:20:05.746875] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:20:06.390680] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-03T19:20:06.576307] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-03T19:20:07.190620] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-03T19:20:07.237323] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:20:07.990673] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-03T19:20:08.034081] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:20:08.798410] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-03T19:20:08.802757] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:20:09.590635] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-03T19:20:09.684550] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:20:10.390665] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-03T19:20:10.690379] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:20:11.035180] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:20:11.190709] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-03T19:20:11.706290] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-03T19:20:11.990726] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-03T19:20:12.790724] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-03T19:20:12.962035] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:20:13.595745] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-03T19:20:13.613884] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:20:14.390683] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-03T19:20:14.550798] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:20:15.190665] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-03T19:20:15.326099] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-03T19:20:15.329200] [INFO ] [REMOTE ] HBM: Full fetch complete (76234 records). [2025-10-03T19:20:15.329353] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-03T19:20:15.764858] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-03T19:20:15.764952] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-03T19:20:15.765908] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-03T19:20:15.765980] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-03T19:20:15.767608] [DEBUG] [LOCAL ] HBM: Trimmed 76234 records to 53680 (keeping 200 days of data) [2025-10-03T19:20:16.121701] [DEBUG] [LOCAL ] HBM: Primary data saved (53680 records). [2025-10-03T19:20:16.121971] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-03T19:20:16.122113] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HBM took 27.6s. Estimated remaining: 3h 12m 44s. Rate: 7.1 symbols/min [2025-10-03T19:20:16.156724] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:20:16.168690] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-03T19:20:16.887223] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:20:16.898094] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-03T19:20:17.633544] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:20:17.643538] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-03T19:20:19.161511] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:20:19.171673] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-03T19:20:19.950450] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-03T19:20:19.953022] [INFO ] [REMOTE ] HCA: Full fetch complete (68831 records). [2025-10-03T19:20:19.953152] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-03T19:20:20.400286] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-03T19:20:20.400384] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-03T19:20:20.401410] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-03T19:20:20.401485] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-03T19:20:20.405302] [DEBUG] [LOCAL ] HCA: Trimmed 68831 records to 47538 (keeping 200 days of data) [2025-10-03T19:20:20.615074] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:20:20.645705] [INFO ] [REMOTE ] HCC: Full fetch complete (64636 records). [2025-10-03T19:20:20.646099] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-03T19:20:21.134256] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-03T19:20:21.134743] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-03T19:20:21.137338] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-03T19:20:21.137428] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-03T19:20:21.141972] [DEBUG] [LOCAL ] HCC: Trimmed 64636 records to 46016 (keeping 200 days of data) [2025-10-03T19:20:21.323090] [DEBUG] [LOCAL ] HCA: Primary data saved (47538 records). [2025-10-03T19:20:21.323765] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-03T19:20:21.324380] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HCA took 31.0s. Estimated remaining: 3h 12m 31s. Rate: 7.1 symbols/min [2025-10-03T19:20:21.495917] [DEBUG] [LOCAL ] HCC: Primary data saved (46016 records). [2025-10-03T19:20:21.496059] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-03T19:20:21.496156] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HCC took 30.2s. Estimated remaining: 3h 12m 11s. Rate: 7.1 symbols/min [2025-10-03T19:20:22.103576] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.184450] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-03T19:20:22.194443] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.253291] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.255380] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.254489] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:22.255586] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-10-03T19:20:22.256150] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.255694] [DEBUG] [LOCAL ] HD: No existing data file found in primary storage. [2025-10-03T19:20:22.255934] [DEBUG] [LOCAL ] HDB: No existing data file found in primary storage. [2025-10-03T19:20:22.256382] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-03T19:20:22.256515] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.256840] [WARN ] [MAIN ] HDB: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.256964] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-03T19:20:22.256786] [WARN ] [MAIN ] HD: No existing data found, performing full refresh instead. [2025-10-03T19:20:22.257462] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-03T19:20:22.257231] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.269002] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-03T19:20:22.262758] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.274547] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-03T19:20:22.280264] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-03T19:20:22.280206] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-03T19:20:22.289971] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-03T19:20:22.352487] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-03T19:20:22.300449] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-03T19:20:22.368201] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-03T19:20:22.415336] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-03T19:20:22.459363] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-03T19:20:23.692247] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.698211] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-03T19:20:23.873253] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.944119] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-03T19:20:23.943802] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:23.950959] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-03T19:20:24.048881] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:24.049240] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-03T19:20:24.233523] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-03T19:20:24.234587] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-03T19:20:24.461266] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-03T19:20:24.462188] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-03T19:20:24.693974] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-03T19:20:24.694956] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-03T19:20:24.879117] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:20:24.882907] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-03T19:20:24.930281] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-03T19:20:25.406497] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:20:25.427881] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:20:25.600049] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-03T19:20:25.634056] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:20:26.390737] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-03T19:20:26.431135] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T19:20:27.190678] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-03T19:20:27.420168] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-03T19:20:27.990634] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-03T19:20:28.040864] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T19:20:28.790701] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-03T19:20:28.921840] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-03T19:20:29.590751] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-03T19:20:29.815613] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-03T19:20:30.390725] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-03T19:20:30.798997] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-03T19:20:31.190706] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-03T19:20:31.426391] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-03T19:20:31.990687] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-03T19:20:32.170743] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:20:32.790689] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-03T19:20:33.590721] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-03T19:20:33.756357] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:20:34.005831] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T19:20:34.390709] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-03T19:20:35.190735] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-03T19:20:35.427757] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-03T19:20:35.512994] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-03T19:20:35.990714] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-03T19:20:36.230436] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-03T19:20:36.609973] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-03T19:20:36.790724] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-03T19:20:37.040379] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-03T19:20:37.590684] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-03T19:20:37.912226] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-03T19:20:37.912922] [INFO ] [REMOTE ] HCXY: Full fetch complete (570 records). [2025-10-03T19:20:37.912994] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-03T19:20:38.098867] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-03T19:20:38.099073] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:20:38.099141] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:20:38.099214] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-03T19:20:38.099312] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-03T19:20:38.099368] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-03T19:20:38.099491] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-03T19:20:38.099587] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 16.6s. Estimated remaining: 3h 12m 14s. Rate: 7.1 symbols/min [2025-10-03T19:20:38.283541] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:38.283766] [DEBUG] [LOCAL ] HE: No existing data file found in primary storage. [2025-10-03T19:20:38.283814] [WARN ] [MAIN ] HE: No existing data found, performing full refresh instead. [2025-10-03T19:20:38.283932] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-03T19:20:38.283976] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-03T19:20:38.284020] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-03T19:20:38.284054] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-03T19:20:38.393993] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-03T19:20:38.679595] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:39.190692] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-03T19:20:39.990672] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-03T19:20:40.271801] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:20:40.790689] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-03T19:20:41.005011] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:20:41.590689] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-03T19:20:42.055049] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-03T19:20:42.390705] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-03T19:20:42.508527] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:20:43.190707] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-03T19:20:43.426235] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-03T19:20:43.990759] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-03T19:20:44.103297] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:20:44.139149] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-03T19:20:44.790728] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-03T19:20:45.590686] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-03T19:20:45.680292] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:20:46.348323] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:20:46.390754] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-03T19:20:47.025824] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-10-03T19:20:47.190680] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-03T19:20:47.990691] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-03T19:20:48.138301] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:20:48.790677] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-03T19:20:48.983263] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T19:20:49.047224] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-03T19:20:49.590688] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-03T19:20:50.390722] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-03T19:20:50.511737] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:20:50.558121] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-03T19:20:51.190742] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-03T19:20:51.990690] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-03T19:20:52.146053] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:20:52.169250] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:20:52.790699] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-03T19:20:53.590697] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-03T19:20:54.186848] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-03T19:20:54.261578] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-03T19:20:54.367122] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:20:54.368388] [INFO ] [REMOTE ] HCI: Full fetch complete (19458 records). [2025-10-03T19:20:54.368470] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-03T19:20:54.395835] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-03T19:20:54.808399] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-03T19:20:54.808490] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-03T19:20:54.808993] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-03T19:20:54.809092] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-03T19:20:54.810034] [DEBUG] [LOCAL ] HCI: Trimmed 19458 records to 14103 (keeping 200 days of data) [2025-10-03T19:20:54.915680] [DEBUG] [LOCAL ] HCI: Primary data saved (14103 records). [2025-10-03T19:20:54.915880] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-03T19:20:54.915979] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HCI took 33.4s. Estimated remaining: 3h 12m 17s. Rate: 7.1 symbols/min [2025-10-03T19:20:55.115853] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:20:55.116021] [DEBUG] [LOCAL ] HEI: No existing data file found in primary storage. [2025-10-03T19:20:55.116059] [WARN ] [MAIN ] HEI: No existing data found, performing full refresh instead. [2025-10-03T19:20:55.116176] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-03T19:20:55.116219] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-03T19:20:55.116262] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-03T19:20:55.116297] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-03T19:20:55.199028] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-03T19:20:55.510869] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:20:55.990681] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-03T19:20:56.140712] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:20:56.790686] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-03T19:20:57.135511] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:20:57.590704] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-03T19:20:57.647976] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:20:58.334182] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:20:58.390681] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-03T19:20:59.049380] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:20:59.190715] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-03T19:20:59.982389] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:20:59.985048] [INFO ] [REMOTE ] HDB: Full fetch complete (75309 records). [2025-10-03T19:20:59.985200] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-03T19:20:59.998454] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-03T19:21:00.437172] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-03T19:21:00.437289] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-03T19:21:00.438354] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-03T19:21:00.438514] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-03T19:21:00.440399] [DEBUG] [LOCAL ] HDB: Trimmed 75309 records to 52716 (keeping 200 days of data) [2025-10-03T19:21:00.573695] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:21:00.795636] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-03T19:21:00.824197] [DEBUG] [LOCAL ] HDB: Primary data saved (52716 records). [2025-10-03T19:21:00.824360] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-03T19:21:00.824458] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HDB took 39.3s. Estimated remaining: 3h 12m 5s. Rate: 7.1 symbols/min [2025-10-03T19:21:01.010947] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:01.011116] [DEBUG] [LOCAL ] HEQ: No existing data file found in primary storage. [2025-10-03T19:21:01.011155] [WARN ] [MAIN ] HEQ: No existing data found, performing full refresh instead. [2025-10-03T19:21:01.011394] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-03T19:21:01.011448] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-03T19:21:01.011493] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-03T19:21:01.011528] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-03T19:21:01.421200] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:01.590736] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-03T19:21:01.879061] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:21:01.952028] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T19:21:02.390724] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-03T19:21:03.190743] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-03T19:21:03.866422] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-03T19:21:03.934030] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-03T19:21:03.939740] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T19:21:03.990685] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-03T19:21:04.790683] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-03T19:21:05.454541] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:21:05.590728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-03T19:21:06.390639] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-03T19:21:06.691287] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:21:06.695322] [INFO ] [REMOTE ] HD: Full fetch complete (77442 records). [2025-10-03T19:21:06.695550] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-03T19:21:07.059739] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:21:07.117870] [INFO ] [REMOTE ] HE: Full fetch complete (72314 records). [2025-10-03T19:21:07.109068] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-03T19:21:07.140040] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-03T19:21:07.163218] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-03T19:21:07.163390] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-03T19:21:07.164425] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-03T19:21:07.164549] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-03T19:21:07.201753] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-03T19:21:07.281754] [DEBUG] [LOCAL ] HD: Trimmed 77442 records to 54268 (keeping 200 days of data) [2025-10-03T19:21:07.731060] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-03T19:21:07.731517] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-03T19:21:07.733022] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-03T19:21:07.733669] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-03T19:21:07.742237] [DEBUG] [LOCAL ] HE: Trimmed 72314 records to 49729 (keeping 200 days of data) [2025-10-03T19:21:07.992389] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-03T19:21:08.296621] [DEBUG] [LOCAL ] HD: Primary data saved (54268 records). [2025-10-03T19:21:08.297607] [INFO ] [MAIN ] HD: Full history saved. [2025-10-03T19:21:08.298107] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 46.8s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-03T19:21:08.470134] [DEBUG] [LOCAL ] HE: Primary data saved (49729 records). [2025-10-03T19:21:08.481534] [INFO ] [MAIN ] HE: Full history saved. [2025-10-03T19:21:08.504047] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:08.504457] [DEBUG] [LOCAL ] HESM: No existing data file found in primary storage. [2025-10-03T19:21:08.504321] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 30.4s. Estimated remaining: 3h 11m 36s. Rate: 7.1 symbols/min [2025-10-03T19:21:08.504610] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-10-03T19:21:08.527377] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-03T19:21:08.554257] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-03T19:21:08.590496] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-03T19:21:08.601291] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-03T19:21:08.658635] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T19:21:08.798722] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:08.795132] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-03T19:21:08.815275] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-03T19:21:08.829127] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-03T19:21:08.829681] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-03T19:21:08.829833] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-03T19:21:08.840479] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-03T19:21:08.845801] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-03T19:21:09.365287] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:09.470230] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-03T19:21:09.471926] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-03T19:21:09.567920] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:09.590618] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-03T19:21:09.916138] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-03T19:21:10.390695] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-03T19:21:11.190689] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-03T19:21:11.536468] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-03T19:21:11.938522] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T19:21:11.990728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-03T19:21:12.790721] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-03T19:21:13.590691] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-03T19:21:13.630754] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:21:13.631224] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T19:21:13.928663] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-03T19:21:14.390682] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-03T19:21:15.190682] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-03T19:21:15.465473] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-03T19:21:15.951042] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:21:15.990619] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-03T19:21:16.790741] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-03T19:21:17.595787] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-03T19:21:17.620752] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:21:18.268606] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-03T19:21:18.295267] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:21:18.390712] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-03T19:21:19.190691] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-03T19:21:19.506440] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-03T19:21:19.922428] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:21:19.990634] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-03T19:21:20.790715] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-03T19:21:21.025478] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-03T19:21:21.396634] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:21:21.590705] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-03T19:21:21.836005] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-03T19:21:22.390720] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-03T19:21:23.190699] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-03T19:21:23.993195] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-03T19:21:23.996699] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:21:24.232053] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-03T19:21:24.586821] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:21:24.790732] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-03T19:21:25.015102] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-03T19:21:25.590737] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-03T19:21:26.153482] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:21:26.390682] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-03T19:21:26.646963] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-03T19:21:27.190736] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-03T19:21:27.990705] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-03T19:21:28.701115] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T19:21:28.702721] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:21:28.790726] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-03T19:21:29.590701] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-03T19:21:30.188895] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:21:30.399202] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-03T19:21:30.405048] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:21:30.750876] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-03T19:21:30.751543] [INFO ] [REMOTE ] HF: Full fetch complete (474 records). [2025-10-03T19:21:30.751617] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-03T19:21:30.939905] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-10-03T19:21:30.940076] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:21:30.940148] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:21:30.940248] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-03T19:21:30.940339] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-03T19:21:30.940399] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-03T19:21:30.940464] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-03T19:21:30.940568] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HF took 22.4s. Estimated remaining: 3h 11m 46s. Rate: 7.1 symbols/min [2025-10-03T19:21:31.128778] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:31.129008] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-03T19:21:31.129062] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-03T19:21:31.129213] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-03T19:21:31.129263] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-03T19:21:31.129316] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-03T19:21:31.129356] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-03T19:21:31.200805] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-03T19:21:31.509866] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:31.990723] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-03T19:21:32.790741] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-03T19:21:33.060217] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-10-03T19:21:33.064756] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-03T19:21:33.366282] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:21:33.590724] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-03T19:21:34.390725] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-03T19:21:35.190722] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-03T19:21:35.286313] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:21:35.312333] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-03T19:21:35.990728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-03T19:21:36.436454] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-03T19:21:36.790698] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-03T19:21:37.590684] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-03T19:21:37.761735] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:21:37.823113] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:21:37.825509] [INFO ] [REMOTE ] HEI: Full fetch complete (48689 records). [2025-10-03T19:21:37.825731] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-03T19:21:38.359387] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-03T19:21:38.354883] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T19:21:38.359628] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-03T19:21:38.361173] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-03T19:21:38.363064] [INFO ] [REMOTE ] HEQ: Full fetch complete (9332 records). [2025-10-03T19:21:38.363195] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-03T19:21:38.362976] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-03T19:21:38.394913] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-03T19:21:38.471112] [DEBUG] [LOCAL ] HEI: Trimmed 48689 records to 32420 (keeping 200 days of data) [2025-10-03T19:21:38.835511] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:21:38.981232] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-03T19:21:38.984479] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-03T19:21:38.985862] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-03T19:21:38.985944] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-03T19:21:38.987691] [DEBUG] [LOCAL ] HEQ: Trimmed 9332 records to 6450 (keeping 200 days of data) [2025-10-03T19:21:39.095025] [DEBUG] [LOCAL ] HEQ: Primary data saved (6450 records). [2025-10-03T19:21:39.095772] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-03T19:21:39.096429] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEQ took 38.3s. Estimated remaining: 3h 11m 38s. Rate: 7.1 symbols/min [2025-10-03T19:21:39.195763] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-03T19:21:39.298115] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:39.299220] [DEBUG] [LOCAL ] HFRO: No existing data file found in primary storage. [2025-10-03T19:21:39.299910] [WARN ] [MAIN ] HFRO: No existing data found, performing full refresh instead. [2025-10-03T19:21:39.300319] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-03T19:21:39.300762] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-03T19:21:39.301116] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-03T19:21:39.301502] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-03T19:21:39.375296] [DEBUG] [LOCAL ] HEI: Primary data saved (32420 records). [2025-10-03T19:21:39.388946] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-03T19:21:39.389056] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HEI took 44.5s. Estimated remaining: 3h 11m 18s. Rate: 7.1 symbols/min [2025-10-03T19:21:39.781604] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:39.810983] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-03T19:21:39.814164] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-03T19:21:39.814306] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-03T19:21:39.814367] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-03T19:21:39.814453] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-03T19:21:39.814523] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-03T19:21:40.012910] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-03T19:21:40.008620] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:40.290699] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:40.470815] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:21:40.624155] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:21:40.629345] [INFO ] [REMOTE ] HESM: Full fetch complete (69356 records). [2025-10-03T19:21:40.629576] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-03T19:21:40.798205] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-03T19:21:41.070771] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-03T19:21:41.070855] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-03T19:21:41.071794] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-03T19:21:41.071884] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-03T19:21:41.073347] [DEBUG] [LOCAL ] HESM: Trimmed 69356 records to 48942 (keeping 200 days of data) [2025-10-03T19:21:41.276868] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T19:21:41.400822] [DEBUG] [LOCAL ] HESM: Primary data saved (48942 records). [2025-10-03T19:21:41.400979] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-03T19:21:41.401102] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 33.1s. Estimated remaining: 3h 11m 1s. Rate: 7.1 symbols/min [2025-10-03T19:21:41.591492] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:21:41.591571] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-03T19:21:41.592825] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-10-03T19:21:41.592901] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-10-03T19:21:41.593066] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-03T19:21:41.593121] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-03T19:21:41.593230] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-03T19:21:41.593279] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-03T19:21:41.995893] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:21:42.134941] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-03T19:21:42.390731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-03T19:21:43.190679] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-03T19:21:43.475960] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:21:43.515935] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-03T19:21:43.990730] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-03T19:21:44.306559] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:21:44.790713] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-03T19:21:45.216883] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-03T19:21:45.590729] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-03T19:21:46.368166] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:21:46.390739] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-03T19:21:47.170392] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:21:47.190675] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-03T19:21:47.948640] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:21:47.990704] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-03T19:21:48.790685] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-03T19:21:49.122331] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:21:49.375470] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-03T19:21:49.590712] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-03T19:21:50.331075] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:21:50.390686] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-03T19:21:51.190699] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-03T19:21:51.206054] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:21:51.935935] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:21:51.990687] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-03T19:21:52.757921] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:21:52.790722] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-03T19:21:53.590685] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-03T19:21:53.854041] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:21:54.366216] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:21:54.390610] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-03T19:21:55.190626] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-03T19:21:55.284213] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T19:21:55.598528] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-03T19:21:55.990727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-03T19:21:56.790269] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:21:56.791486] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-03T19:21:57.237048] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T19:21:57.590703] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-03T19:21:58.390696] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-03T19:21:58.529807] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:21:59.190751] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-03T19:21:59.280293] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:21:59.990664] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-03T19:22:00.292488] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:22:00.790626] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-03T19:22:00.864135] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:22:01.267087] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-03T19:22:01.267803] [INFO ] [REMOTE ] HFND: Full fetch complete (1782 records). [2025-10-03T19:22:01.267879] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-03T19:22:01.461438] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-03T19:22:01.461682] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:22:01.461782] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:22:01.461860] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-03T19:22:01.461931] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-03T19:22:01.461970] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-03T19:22:01.462013] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-03T19:22:01.462103] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 30.5s. Estimated remaining: 3h 11m 8s. Rate: 7.1 symbols/min [2025-10-03T19:22:01.595844] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-03T19:22:01.669871] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:01.670299] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-10-03T19:22:01.670359] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-10-03T19:22:01.670508] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-03T19:22:01.670615] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-03T19:22:01.670741] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-03T19:22:01.670786] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-03T19:22:02.092804] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:02.390695] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-03T19:22:02.591887] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-03T19:22:03.190731] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-03T19:22:03.481905] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:22:03.967356] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:22:03.990698] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-03T19:22:04.705422] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-03T19:22:04.790731] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-03T19:22:05.590639] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-03T19:22:05.659128] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:22:06.390676] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-03T19:22:06.542121] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:22:07.156194] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:22:07.190633] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-03T19:22:07.990729] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-03T19:22:08.006803] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T19:22:08.790719] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-03T19:22:08.960181] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:22:09.510471] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T19:22:09.590727] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-03T19:22:10.389154] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T19:22:10.391684] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-03T19:22:11.163869] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-03T19:22:11.190677] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-03T19:22:11.946635] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:22:11.990660] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-03T19:22:12.725274] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-03T19:22:12.726786] [INFO ] [REMOTE ] HGLB: Full fetch complete (14818 records). [2025-10-03T19:22:12.726869] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-03T19:22:12.795783] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-03T19:22:13.134368] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-03T19:22:13.134450] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-03T19:22:13.134867] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-03T19:22:13.134930] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-03T19:22:13.135511] [DEBUG] [LOCAL ] HGLB: Trimmed 14818 records to 9821 (keeping 200 days of data) [2025-10-03T19:22:13.197221] [DEBUG] [LOCAL ] HGLB: Primary data saved (9821 records). [2025-10-03T19:22:13.197369] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-03T19:22:13.197447] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HGLB took 31.8s. Estimated remaining: 3h 11m 4s. Rate: 7.1 symbols/min [2025-10-03T19:22:13.384507] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:13.384746] [DEBUG] [LOCAL ] HGV: No existing data file found in primary storage. [2025-10-03T19:22:13.384804] [WARN ] [MAIN ] HGV: No existing data found, performing full refresh instead. [2025-10-03T19:22:13.384915] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-03T19:22:13.384958] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-03T19:22:13.385000] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-03T19:22:13.385032] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-03T19:22:13.593465] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-03T19:22:13.626994] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:22:13.792561] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:14.390734] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-03T19:22:14.633048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:22:15.153171] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:22:15.190619] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-03T19:22:15.990664] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-03T19:22:16.043421] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:22:16.790704] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-03T19:22:16.975919] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-03T19:22:17.590744] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-03T19:22:17.751965] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:22:17.753726] [INFO ] [REMOTE ] HGER: Full fetch complete (17187 records). [2025-10-03T19:22:17.753810] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-03T19:22:18.170667] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-03T19:22:18.170789] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-03T19:22:18.171226] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-03T19:22:18.171269] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-03T19:22:18.172018] [DEBUG] [LOCAL ] HGER: Trimmed 17187 records to 13988 (keeping 200 days of data) [2025-10-03T19:22:18.261201] [DEBUG] [LOCAL ] HGER: Primary data saved (13988 records). [2025-10-03T19:22:18.261382] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-03T19:22:18.261475] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGER took 38.9s. Estimated remaining: 3h 10m 51s. Rate: 7.1 symbols/min [2025-10-03T19:22:18.395822] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-03T19:22:18.458507] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:18.458714] [DEBUG] [LOCAL ] HHH: No existing data file found in primary storage. [2025-10-03T19:22:18.458765] [WARN ] [MAIN ] HHH: No existing data found, performing full refresh instead. [2025-10-03T19:22:18.458879] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-03T19:22:18.458923] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-03T19:22:18.458966] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-03T19:22:18.459000] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-03T19:22:18.860423] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:19.001176] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:22:19.190623] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-03T19:22:19.558458] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:22:19.990689] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-03T19:22:20.721911] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-03T19:22:20.790700] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-03T19:22:21.063051] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:22:21.507004] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-03T19:22:21.590693] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-03T19:22:22.390701] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-03T19:22:22.959631] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:22:23.190668] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-03T19:22:23.468026] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:22:23.990722] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-03T19:22:24.095691] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T19:22:24.096860] [INFO ] [REMOTE ] HGTY: Full fetch complete (17270 records). [2025-10-03T19:22:24.096941] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-03T19:22:24.493217] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-03T19:22:24.493305] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-03T19:22:24.493740] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-03T19:22:24.493809] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-03T19:22:24.494437] [DEBUG] [LOCAL ] HGTY: Trimmed 17270 records to 13362 (keeping 200 days of data) [2025-10-03T19:22:24.574183] [DEBUG] [LOCAL ] HGTY: Primary data saved (13362 records). [2025-10-03T19:22:24.574329] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-03T19:22:24.574417] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGTY took 23.1s. Estimated remaining: 3h 10m 40s. Rate: 7.1 symbols/min [2025-10-03T19:22:24.750184] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:24.750374] [DEBUG] [LOCAL ] HI: No existing data file found in primary storage. [2025-10-03T19:22:24.750416] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-10-03T19:22:24.750530] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-03T19:22:24.750573] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-03T19:22:24.750615] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-03T19:22:24.750677] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-03T19:22:24.795809] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-03T19:22:25.148988] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:25.343061] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:22:25.590693] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-03T19:22:25.821865] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:22:26.390699] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-03T19:22:26.896606] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:22:27.190984] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-03T19:22:27.774232] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:22:27.990629] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-03T19:22:28.418786] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-03T19:22:28.790733] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-03T19:22:29.305507] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-03T19:22:29.442115] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:22:29.443805] [INFO ] [REMOTE ] HFRO: Full fetch complete (28962 records). [2025-10-03T19:22:29.443896] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-03T19:22:29.595733] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-03T19:22:29.842835] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-03T19:22:29.842938] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-03T19:22:29.843616] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-03T19:22:29.843722] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-03T19:22:29.844593] [DEBUG] [LOCAL ] HFRO: Trimmed 28962 records to 17887 (keeping 200 days of data) [2025-10-03T19:22:29.956822] [DEBUG] [LOCAL ] HFRO: Primary data saved (17887 records). [2025-10-03T19:22:29.956993] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-03T19:22:29.957111] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HFRO took 50.9s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-03T19:22:30.211839] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:30.212129] [DEBUG] [LOCAL ] HIG: No existing data file found in primary storage. [2025-10-03T19:22:30.212384] [WARN ] [MAIN ] HIG: No existing data found, performing full refresh instead. [2025-10-03T19:22:30.212550] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-03T19:22:30.212610] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-03T19:22:30.212725] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-03T19:22:30.212795] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-03T19:22:30.404543] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-03T19:22:30.724472] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:31.190716] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-03T19:22:31.259338] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:22:31.852827] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:22:31.990702] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-03T19:22:32.392818] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-03T19:22:32.790707] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-03T19:22:33.590709] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-03T19:22:33.630308] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:22:34.379241] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:22:34.390603] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-03T19:22:34.950024] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:22:35.190695] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-03T19:22:35.935131] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:22:35.990639] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-03T19:22:36.730099] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:22:36.790741] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-03T19:22:37.341938] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T19:22:37.590746] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-03T19:22:38.318919] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:22:38.390732] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-03T19:22:39.157058] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:22:39.190631] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-03T19:22:39.995501] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-03T19:22:40.001352] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:22:40.134554] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:22:40.790743] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-03T19:22:41.580014] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:22:41.590605] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-03T19:22:42.390686] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-03T19:22:42.526219] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:22:43.066158] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:22:43.190694] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-03T19:22:43.515778] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:22:43.517978] [INFO ] [REMOTE ] HHH: Full fetch complete (45664 records). [2025-10-03T19:22:43.518076] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-03T19:22:43.916979] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-03T19:22:43.917073] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-03T19:22:43.917780] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-03T19:22:43.917844] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-03T19:22:43.918861] [DEBUG] [LOCAL ] HHH: Trimmed 45664 records to 33147 (keeping 200 days of data) [2025-10-03T19:22:44.004023] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-03T19:22:44.128113] [DEBUG] [LOCAL ] HHH: Primary data saved (33147 records). [2025-10-03T19:22:44.128293] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-03T19:22:44.128403] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HHH took 25.9s. Estimated remaining: 3h 10m 27s. Rate: 7.1 symbols/min [2025-10-03T19:22:44.311851] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:44.312212] [DEBUG] [LOCAL ] HII: No existing data file found in primary storage. [2025-10-03T19:22:44.312310] [WARN ] [MAIN ] HII: No existing data found, performing full refresh instead. [2025-10-03T19:22:44.312547] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-03T19:22:44.312763] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-03T19:22:44.312839] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-03T19:22:44.312878] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-03T19:22:44.752503] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:44.754521] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-03T19:22:44.790634] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-03T19:22:45.308879] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:22:45.590691] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-03T19:22:46.215545] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T19:22:46.390683] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-03T19:22:47.159992] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:22:47.190625] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-03T19:22:47.835021] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:22:47.990699] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-03T19:22:48.677118] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:22:48.790707] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-03T19:22:49.548032] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:22:49.590624] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-03T19:22:50.149946] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:22:50.390694] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-03T19:22:51.065421] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:22:51.067830] [INFO ] [REMOTE ] HGV: Full fetch complete (65949 records). [2025-10-03T19:22:51.067957] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-03T19:22:51.193460] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-03T19:22:51.513618] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-03T19:22:51.513737] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-03T19:22:51.514753] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-03T19:22:51.514821] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-03T19:22:51.516286] [DEBUG] [LOCAL ] HGV: Trimmed 65949 records to 47226 (keeping 200 days of data) [2025-10-03T19:22:51.728043] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T19:22:51.737068] [INFO ] [REMOTE ] HI: Full fetch complete (50054 records). [2025-10-03T19:22:51.738224] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-03T19:22:52.002216] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-03T19:22:52.257844] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-03T19:22:52.258951] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-03T19:22:52.260430] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-03T19:22:52.260896] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-03T19:22:52.264234] [DEBUG] [LOCAL ] HI: Trimmed 50054 records to 35823 (keeping 200 days of data) [2025-10-03T19:22:52.429401] [DEBUG] [LOCAL ] HGV: Primary data saved (47226 records). [2025-10-03T19:22:52.430698] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-03T19:22:52.430813] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HGV took 39.2s. Estimated remaining: 3h 10m 18s. Rate: 7.1 symbols/min [2025-10-03T19:22:52.646757] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:52.648009] [DEBUG] [LOCAL ] HIMS: No existing data file found in primary storage. [2025-10-03T19:22:52.648664] [WARN ] [MAIN ] HIMS: No existing data found, performing full refresh instead. [2025-10-03T19:22:52.649556] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-03T19:22:52.650198] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-03T19:22:52.650589] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-03T19:22:52.650915] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-03T19:22:53.132903] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:53.135831] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-03T19:22:53.159821] [DEBUG] [LOCAL ] HI: Primary data saved (35823 records). [2025-10-03T19:22:53.159988] [INFO ] [MAIN ] HI: Full history saved. [2025-10-03T19:22:53.160072] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 28.6s. Estimated remaining: 3h 9m 60s. Rate: 7.1 symbols/min [2025-10-03T19:22:53.344543] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:22:53.344740] [DEBUG] [LOCAL ] HIO: No existing data file found in primary storage. [2025-10-03T19:22:53.344789] [WARN ] [MAIN ] HIO: No existing data found, performing full refresh instead. [2025-10-03T19:22:53.344905] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-03T19:22:53.344949] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-03T19:22:53.344993] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-03T19:22:53.345028] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-03T19:22:53.730726] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:22:53.731348] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-03T19:23:06.387339] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (15.19 seconds). [2025-10-03T19:23:06.397859] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-03T19:23:07.322990] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (14.19 seconds). [2025-10-03T19:23:07.334902] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-03T19:23:08.692354] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (14.96 seconds). [2025-10-03T19:23:08.702345] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-03T19:23:09.010709] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-10-03T19:23:09.023268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-03T19:23:09.160056] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (17.16 seconds). [2025-10-03T19:23:09.168680] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-03T19:23:09.301287] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-03T19:23:09.315164] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-03T19:23:09.860794] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:23:09.870471] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-03T19:23:10.479106] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:23:10.494188] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-03T19:23:11.007525] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-03T19:23:11.022106] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-03T19:23:11.056321] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:23:11.066229] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-03T19:23:12.067575] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-10-03T19:23:12.080239] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-03T19:23:12.144361] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-03T19:23:12.156083] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-03T19:23:12.181328] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-03T19:23:12.189946] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-03T19:23:12.440627] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T19:23:12.453447] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-03T19:23:13.322568] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:23:13.329376] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-03T19:23:13.593292] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:23:13.604014] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-03T19:23:13.981277] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-03T19:23:13.986833] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-03T19:23:14.164661] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:23:14.177057] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-03T19:23:14.756978] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-03T19:23:14.788692] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:23:14.794994] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-03T19:23:14.795578] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-03T19:23:14.824092] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T19:23:14.832207] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-03T19:23:15.901806] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-03T19:23:15.907962] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-03T19:23:16.204254] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:23:16.217018] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-03T19:23:16.295268] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:23:16.304077] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-03T19:23:17.299629] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:23:17.306159] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-03T19:23:17.741282] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-10-03T19:23:17.780703] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-03T19:23:17.782849] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:23:17.793306] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-03T19:23:17.835444] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:23:17.848033] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-03T19:23:18.173799] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-03T19:23:18.182167] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-03T19:23:18.949944] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:23:18.958363] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-03T19:23:19.351489] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:23:19.354156] [INFO ] [REMOTE ] HIO: Full fetch complete (37649 records). [2025-10-03T19:23:19.354262] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-03T19:23:19.840057] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:23:19.868855] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-03T19:23:19.869145] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-03T19:23:19.870023] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-03T19:23:19.870109] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-03T19:23:19.870767] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-03T19:23:19.874711] [DEBUG] [LOCAL ] HIO: Trimmed 37649 records to 24380 (keeping 200 days of data) [2025-10-03T19:23:20.045207] [DEBUG] [LOCAL ] HIO: Primary data saved (24380 records). [2025-10-03T19:23:20.045400] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-03T19:23:20.045752] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIO took 26.9s. Estimated remaining: 3h 10m 16s. Rate: 7.1 symbols/min [2025-10-03T19:23:20.269019] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:20.269822] [DEBUG] [LOCAL ] HIPO: No existing data file found in primary storage. [2025-10-03T19:23:20.269997] [WARN ] [MAIN ] HIPO: No existing data found, performing full refresh instead. [2025-10-03T19:23:20.270350] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-03T19:23:20.271069] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-03T19:23:20.280754] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-03T19:23:20.295880] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-03T19:23:20.350609] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:23:20.433117] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-03T19:23:20.751477] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:20.751880] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-03T19:23:20.793431] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-10-03T19:23:20.807290] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-03T19:23:21.536912] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:23:21.539677] [INFO ] [REMOTE ] HIG: Full fetch complete (73205 records). [2025-10-03T19:23:21.539821] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-03T19:23:21.751929] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:23:21.820951] [INFO ] [REMOTE ] HII: Full fetch complete (52950 records). [2025-10-03T19:23:21.848135] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-03T19:23:22.137211] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-03T19:23:22.160961] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-03T19:23:22.162267] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-03T19:23:22.162378] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-03T19:23:22.198300] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-03T19:23:22.245749] [DEBUG] [LOCAL ] HIG: Trimmed 73205 records to 51948 (keeping 200 days of data) [2025-10-03T19:23:22.251729] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-03T19:23:22.617861] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-03T19:23:22.618451] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-03T19:23:22.622512] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-03T19:23:22.623139] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-03T19:23:22.629907] [DEBUG] [LOCAL ] HII: Trimmed 52950 records to 35064 (keeping 200 days of data) [2025-10-03T19:23:23.263696] [DEBUG] [LOCAL ] HII: Primary data saved (35064 records). [2025-10-03T19:23:23.264940] [INFO ] [MAIN ] HII: Full history saved. [2025-10-03T19:23:23.265537] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HII took 39.1s. Estimated remaining: 3h 10m 0s. Rate: 7.1 symbols/min [2025-10-03T19:23:23.419716] [DEBUG] [LOCAL ] HIG: Primary data saved (51948 records). [2025-10-03T19:23:23.425813] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-03T19:23:23.501726] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:23.477304] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HIG took 53.5s. Estimated remaining: 3h 9m 41s. Rate: 7.1 symbols/min [2025-10-03T19:23:23.507594] [DEBUG] [LOCAL ] HIW: No existing data file found in primary storage. [2025-10-03T19:23:23.600913] [WARN ] [MAIN ] HIW: No existing data found, performing full refresh instead. [2025-10-03T19:23:23.659573] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-03T19:23:23.659450] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-03T19:23:23.677332] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-03T19:23:23.677562] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-03T19:23:23.677244] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:23:23.694991] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-03T19:23:23.749413] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-03T19:23:23.810498] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-03T19:23:23.873209] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:23.884183] [DEBUG] [LOCAL ] HIX: No existing data file found in primary storage. [2025-10-03T19:23:23.894574] [WARN ] [MAIN ] HIX: No existing data found, performing full refresh instead. [2025-10-03T19:23:23.903555] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-03T19:23:23.903720] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-03T19:23:23.911962] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-03T19:23:23.916195] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-03T19:23:24.521582] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:24.535031] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-03T19:23:24.627170] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:24.790751] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-03T19:23:24.822104] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:23:25.590730] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-03T19:23:25.972874] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:23:26.064005] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:23:26.296440] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-03T19:23:26.390680] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-03T19:23:26.689515] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:23:27.190718] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-03T19:23:27.792466] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T19:23:27.990703] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-03T19:23:28.306373] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:23:28.790745] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-03T19:23:29.119461] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-03T19:23:29.590727] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-03T19:23:30.036820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-03T19:23:30.390735] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-03T19:23:31.190637] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-03T19:23:31.507926] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T19:23:31.990672] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-03T19:23:32.299965] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-03T19:23:32.790708] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-03T19:23:32.880507] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:23:33.077864] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-03T19:23:33.524363] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T19:23:33.590714] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-03T19:23:34.390695] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-03T19:23:35.190736] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-03T19:23:35.255345] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-03T19:23:35.705820] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-03T19:23:35.990723] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-03T19:23:36.333344] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:23:36.790733] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-03T19:23:37.044575] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:23:37.590717] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-03T19:23:38.384094] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:23:38.393891] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-03T19:23:38.592415] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:23:39.190728] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-03T19:23:39.589291] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:23:39.990692] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-03T19:23:40.768374] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:23:40.790615] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-03T19:23:41.056718] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:23:41.590695] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-03T19:23:42.393790] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-03T19:23:42.400159] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:23:42.565588] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:23:43.190698] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-03T19:23:43.990706] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-03T19:23:44.671810] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:23:44.673498] [INFO ] [REMOTE ] HIPO: Full fetch complete (31538 records). [2025-10-03T19:23:44.673605] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-03T19:23:44.792498] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-03T19:23:44.915071] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:23:45.191396] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-03T19:23:45.191681] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-03T19:23:45.192444] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-03T19:23:45.192675] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-03T19:23:45.194162] [DEBUG] [LOCAL ] HIPO: Trimmed 31538 records to 22331 (keeping 200 days of data) [2025-10-03T19:23:45.352527] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-03T19:23:45.412001] [DEBUG] [LOCAL ] HIPO: Primary data saved (22331 records). [2025-10-03T19:23:45.412166] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-03T19:23:45.412288] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIPO took 25.4s. Estimated remaining: 3h 9m 50s. Rate: 7.1 symbols/min [2025-10-03T19:23:45.592919] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-03T19:23:45.618213] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:45.620100] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-10-03T19:23:45.620213] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-10-03T19:23:45.620331] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-03T19:23:45.620384] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-03T19:23:45.620444] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-03T19:23:45.620493] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-03T19:23:46.062006] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:46.077638] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:23:46.390694] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-03T19:23:47.028420] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:23:47.190689] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-03T19:23:47.626424] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T19:23:47.990716] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-03T19:23:48.790664] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-03T19:23:48.986856] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:23:49.339380] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-03T19:23:49.342353] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-10-03T19:23:49.342493] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-03T19:23:49.600478] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-03T19:23:49.783387] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-03T19:23:49.783545] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-03T19:23:49.784767] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-03T19:23:49.784922] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-03T19:23:49.792373] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T19:23:49.796027] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54597 (keeping 200 days of data) [2025-10-03T19:23:49.796877] [INFO ] [REMOTE ] HIW: Full fetch complete (64807 records). [2025-10-03T19:23:49.797383] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-03T19:23:50.364304] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-03T19:23:50.365298] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-03T19:23:50.366605] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-03T19:23:50.367276] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-03T19:23:50.375012] [DEBUG] [LOCAL ] HIW: Trimmed 64807 records to 45164 (keeping 200 days of data) [2025-10-03T19:23:50.432589] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-03T19:23:50.930222] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-03T19:23:50.945323] [DEBUG] [LOCAL ] HIW: Primary data saved (45164 records). [2025-10-03T19:23:50.946315] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-03T19:23:50.946507] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIW took 27.7s. Estimated remaining: 3h 9m 38s. Rate: 7.1 symbols/min [2025-10-03T19:23:51.126000] [DEBUG] [LOCAL ] HIMS: Primary data saved (54597 records). [2025-10-03T19:23:51.134984] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-03T19:23:51.153542] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIMS took 58.7s. Estimated remaining: 3h 9m 19s. Rate: 7.1 symbols/min [2025-10-03T19:23:51.155427] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:51.206431] [DEBUG] [LOCAL ] HL: No existing data file found in primary storage. [2025-10-03T19:23:51.198595] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-03T19:23:51.206605] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-10-03T19:23:51.230746] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-03T19:23:51.230988] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-03T19:23:51.249804] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-03T19:23:51.272608] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-03T19:23:51.470171] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:51.470432] [DEBUG] [LOCAL ] HLF: No existing data file found in primary storage. [2025-10-03T19:23:51.470509] [WARN ] [MAIN ] HLF: No existing data found, performing full refresh instead. [2025-10-03T19:23:51.481700] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-03T19:23:51.492090] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-03T19:23:51.492221] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-03T19:23:51.497427] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-03T19:23:52.127907] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:52.196225] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:23:52.189028] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-03T19:23:52.246561] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:52.306841] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:23:52.790702] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-03T19:23:53.590705] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-03T19:23:53.739696] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:23:53.896063] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:23:54.390732] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-03T19:23:54.669606] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-03T19:23:55.190626] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-03T19:23:55.409229] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-03T19:23:55.411744] [INFO ] [REMOTE ] HIX: Full fetch complete (30771 records). [2025-10-03T19:23:55.411847] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-03T19:23:55.876814] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-03T19:23:55.876908] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-03T19:23:55.877549] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-03T19:23:55.877710] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-03T19:23:55.878614] [DEBUG] [LOCAL ] HIX: Trimmed 30771 records to 20931 (keeping 200 days of data) [2025-10-03T19:23:55.991519] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-03T19:23:56.006150] [DEBUG] [LOCAL ] HIX: Primary data saved (20931 records). [2025-10-03T19:23:56.006288] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-03T19:23:56.006374] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HIX took 32.5s. Estimated remaining: 3h 9m 6s. Rate: 7.1 symbols/min [2025-10-03T19:23:56.199062] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:23:56.199481] [DEBUG] [LOCAL ] HLI: No existing data file found in primary storage. [2025-10-03T19:23:56.199548] [WARN ] [MAIN ] HLI: No existing data found, performing full refresh instead. [2025-10-03T19:23:56.199810] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-03T19:23:56.199896] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-03T19:23:56.199967] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-03T19:23:56.200012] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-03T19:23:56.601718] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:23:56.635108] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-03T19:23:56.790679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-03T19:23:57.485985] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-03T19:23:57.590716] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-03T19:23:58.370040] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:23:58.390616] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-03T19:23:58.779527] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:23:59.190750] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-03T19:23:59.990635] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-03T19:24:00.107073] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-03T19:24:00.488409] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:24:00.790714] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-03T19:24:01.352392] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:24:01.565022] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:24:01.590624] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-03T19:24:02.390689] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-03T19:24:03.190724] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-03T19:24:03.492569] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-03T19:24:03.835692] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:24:03.990718] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-03T19:24:04.790689] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-03T19:24:04.908469] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:24:05.590678] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-03T19:24:06.054891] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-03T19:24:06.225285] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:24:06.390679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-03T19:24:06.620816] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T19:24:07.190735] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-03T19:24:07.990720] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-03T19:24:08.078186] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:24:08.528431] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:24:08.790694] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-03T19:24:09.590723] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-03T19:24:09.780064] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:24:09.782826] [INFO ] [REMOTE ] HKD: Full fetch complete (28415 records). [2025-10-03T19:24:09.783025] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-03T19:24:09.996859] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:24:10.248121] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-03T19:24:10.248203] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-03T19:24:10.248843] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-03T19:24:10.248909] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-03T19:24:10.249619] [DEBUG] [LOCAL ] HKD: Trimmed 28415 records to 18629 (keeping 200 days of data) [2025-10-03T19:24:10.373846] [DEBUG] [LOCAL ] HKD: Primary data saved (18629 records). [2025-10-03T19:24:10.373993] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-03T19:24:10.374084] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HKD took 25.0s. Estimated remaining: 3h 9m 5s. Rate: 7.1 symbols/min [2025-10-03T19:24:10.390855] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-03T19:24:10.563043] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:10.563216] [DEBUG] [LOCAL ] HLIO: No existing data file found in primary storage. [2025-10-03T19:24:10.563255] [WARN ] [MAIN ] HLIO: No existing data found, performing full refresh instead. [2025-10-03T19:24:10.563406] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-03T19:24:10.563450] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-03T19:24:10.563492] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-03T19:24:10.563568] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-03T19:24:10.958896] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:11.190632] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-03T19:24:11.231824] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:24:11.990718] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-03T19:24:12.653413] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-03T19:24:12.696621] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:24:12.790708] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-03T19:24:13.590719] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-03T19:24:13.639028] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:24:13.804582] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T19:24:14.390743] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-03T19:24:15.190699] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-03T19:24:15.405042] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T19:24:15.577753] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-03T19:24:15.990676] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-03T19:24:16.310286] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:24:16.622544] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:24:16.790696] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-03T19:24:17.590715] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-03T19:24:18.180472] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T19:24:18.390692] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-03T19:24:19.195835] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-03T19:24:19.216153] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-03T19:24:19.533610] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:24:19.990719] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-03T19:24:20.790679] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-03T19:24:21.215117] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:24:21.334955] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T19:24:21.590717] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-03T19:24:22.390713] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-03T19:24:22.476830] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:24:23.174082] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:24:23.190614] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-03T19:24:23.664716] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T19:24:23.990694] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-03T19:24:24.790686] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-03T19:24:25.495072] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-03T19:24:25.509323] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:24:25.590676] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-03T19:24:26.390739] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-03T19:24:26.446808] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:24:27.190734] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-03T19:24:27.571265] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-03T19:24:27.574770] [INFO ] [REMOTE ] HL: Full fetch complete (77661 records). [2025-10-03T19:24:27.574949] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-03T19:24:27.901621] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:24:27.993535] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-03T19:24:28.046490] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-03T19:24:28.046637] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-03T19:24:28.047743] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-03T19:24:28.047812] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-03T19:24:28.049554] [DEBUG] [LOCAL ] HL: Trimmed 77661 records to 54451 (keeping 200 days of data) [2025-10-03T19:24:28.401120] [DEBUG] [LOCAL ] HL: Primary data saved (54451 records). [2025-10-03T19:24:28.401308] [INFO ] [MAIN ] HL: Full history saved. [2025-10-03T19:24:28.401440] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HL took 37.5s. Estimated remaining: 3h 9m 9s. Rate: 7.1 symbols/min [2025-10-03T19:24:28.620274] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:28.620713] [DEBUG] [LOCAL ] HLLY: No existing data file found in primary storage. [2025-10-03T19:24:28.620804] [WARN ] [MAIN ] HLLY: No existing data found, performing full refresh instead. [2025-10-03T19:24:28.621493] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-03T19:24:28.622814] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-03T19:24:28.622723] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:24:28.623012] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-03T19:24:28.623216] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-03T19:24:28.793690] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-03T19:24:29.026227] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:29.482027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-03T19:24:29.485146] [INFO ] [REMOTE ] HLF: Full fetch complete (71161 records). [2025-10-03T19:24:29.485265] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-03T19:24:29.594394] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-03T19:24:29.952305] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-03T19:24:29.952410] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-03T19:24:29.953436] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-03T19:24:29.953509] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-03T19:24:29.955061] [DEBUG] [LOCAL ] HLF: Trimmed 71161 records to 49195 (keeping 200 days of data) [2025-10-03T19:24:30.189044] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:24:30.285233] [DEBUG] [LOCAL ] HLF: Primary data saved (49195 records). [2025-10-03T19:24:30.285398] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-03T19:24:30.285517] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLF took 39.1s. Estimated remaining: 3h 8m 52s. Rate: 7.1 symbols/min [2025-10-03T19:24:30.398379] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-03T19:24:30.481936] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:30.482133] [DEBUG] [LOCAL ] HLN: No existing data file found in primary storage. [2025-10-03T19:24:30.482190] [WARN ] [MAIN ] HLN: No existing data found, performing full refresh instead. [2025-10-03T19:24:30.482306] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-03T19:24:30.482350] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-03T19:24:30.482393] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-03T19:24:30.482427] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-03T19:24:30.918292] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:30.974021] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-03T19:24:31.190698] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-03T19:24:31.443805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T19:24:31.990631] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-03T19:24:32.069424] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-03T19:24:32.790737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-03T19:24:33.247937] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:24:33.590742] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-03T19:24:34.390707] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-03T19:24:34.560232] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-03T19:24:34.828238] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-03T19:24:35.190716] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-03T19:24:35.393439] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:24:35.990696] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-03T19:24:36.285805] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T19:24:36.790698] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-03T19:24:37.115106] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-03T19:24:37.116787] [INFO ] [REMOTE ] HLI: Full fetch complete (45302 records). [2025-10-03T19:24:37.116877] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-03T19:24:37.535052] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-03T19:24:37.535145] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-03T19:24:37.535980] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-03T19:24:37.536046] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-03T19:24:37.537036] [DEBUG] [LOCAL ] HLI: Trimmed 45302 records to 31274 (keeping 200 days of data) [2025-10-03T19:24:37.598109] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-03T19:24:37.752784] [DEBUG] [LOCAL ] HLI: Primary data saved (31274 records). [2025-10-03T19:24:37.752936] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-03T19:24:37.753017] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HLI took 41.7s. Estimated remaining: 3h 8m 42s. Rate: 7.1 symbols/min [2025-10-03T19:24:37.935512] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:37.935708] [DEBUG] [LOCAL ] HLT: No existing data file found in primary storage. [2025-10-03T19:24:37.935761] [WARN ] [MAIN ] HLT: No existing data found, performing full refresh instead. [2025-10-03T19:24:37.935875] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-03T19:24:37.935919] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-03T19:24:37.935963] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-03T19:24:37.935997] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-03T19:24:38.339555] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:38.390691] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-03T19:24:38.590639] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:24:38.610813] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:24:38.612374] [INFO ] [REMOTE ] HLIO: Full fetch complete (36242 records). [2025-10-03T19:24:38.612459] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-03T19:24:39.020760] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-03T19:24:39.020856] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-03T19:24:39.021555] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-03T19:24:39.021621] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-03T19:24:39.022616] [DEBUG] [LOCAL ] HLIO: Trimmed 36242 records to 28237 (keeping 200 days of data) [2025-10-03T19:24:39.190924] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-03T19:24:39.210094] [DEBUG] [LOCAL ] HLIO: Primary data saved (28237 records). [2025-10-03T19:24:39.210243] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-03T19:24:39.210409] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLIO took 28.8s. Estimated remaining: 3h 8m 25s. Rate: 7.1 symbols/min [2025-10-03T19:24:39.405353] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:39.405667] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-03T19:24:39.405784] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-03T19:24:39.406001] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-03T19:24:39.413162] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-03T19:24:39.425287] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-03T19:24:39.425384] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-03T19:24:39.472548] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:24:39.822210] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:39.990681] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-03T19:24:40.782200] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:24:40.792310] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-03T19:24:40.981173] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-03T19:24:41.590680] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-03T19:24:42.382742] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:24:42.392456] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-03T19:24:43.182569] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:24:43.190630] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-03T19:24:43.990610] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-03T19:24:44.192170] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:24:44.450345] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:24:44.790696] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-03T19:24:45.580697] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-03T19:24:45.594935] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-03T19:24:46.346015] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:24:46.390704] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-03T19:24:46.679343] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:24:47.190713] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-03T19:24:47.990670] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-03T19:24:48.186030] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:24:48.751532] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:24:48.790671] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-03T19:24:49.305833] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:24:49.590692] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-03T19:24:50.390633] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-03T19:24:50.657223] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-03T19:24:51.190723] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-03T19:24:51.226806] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:24:51.791816] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-03T19:24:51.990685] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-03T19:24:52.790674] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-03T19:24:53.114507] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-03T19:24:53.590698] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-03T19:24:53.687757] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:24:54.390737] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-03T19:24:54.461563] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:24:55.093450] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:24:55.190730] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-03T19:24:55.990680] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-03T19:24:56.060412] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:24:56.655723] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:24:56.790723] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-03T19:24:57.590718] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-03T19:24:57.664823] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-03T19:24:57.979019] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:24:57.981196] [INFO ] [REMOTE ] HLLY: Full fetch complete (46270 records). [2025-10-03T19:24:57.981305] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-03T19:24:58.390772] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-03T19:24:58.404440] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-03T19:24:58.404530] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-03T19:24:58.405281] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-03T19:24:58.405346] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-03T19:24:58.406595] [DEBUG] [LOCAL ] HLLY: Trimmed 46270 records to 33661 (keeping 200 days of data) [2025-10-03T19:24:58.605164] [DEBUG] [LOCAL ] HLLY: Primary data saved (33661 records). [2025-10-03T19:24:58.605318] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-03T19:24:58.605415] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLLY took 30.2s. Estimated remaining: 3h 8m 31s. Rate: 7.1 symbols/min [2025-10-03T19:24:58.784142] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:24:58.784312] [DEBUG] [LOCAL ] HMC: No existing data file found in primary storage. [2025-10-03T19:24:58.784351] [WARN ] [MAIN ] HMC: No existing data found, performing full refresh instead. [2025-10-03T19:24:58.784469] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-03T19:24:58.784513] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-03T19:24:58.784556] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-03T19:24:58.784621] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-03T19:24:59.189426] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:24:59.190617] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-03T19:24:59.556828] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T19:24:59.990719] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-03T19:25:00.160378] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:25:00.790774] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-03T19:25:01.304727] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-03T19:25:01.590729] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-03T19:25:01.874503] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:25:02.328114] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:25:02.390716] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-03T19:25:03.153661] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:25:03.159738] [INFO ] [REMOTE ] HLN: Full fetch complete (76799 records). [2025-10-03T19:25:03.159883] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-03T19:25:03.195857] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-03T19:25:03.628560] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-03T19:25:03.628683] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-03T19:25:03.629613] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-03T19:25:03.629700] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-03T19:25:03.631309] [DEBUG] [LOCAL ] HLN: Trimmed 76799 records to 53863 (keeping 200 days of data) [2025-10-03T19:25:03.965380] [DEBUG] [LOCAL ] HLN: Primary data saved (53863 records). [2025-10-03T19:25:03.965531] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-03T19:25:03.965608] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLN took 33.7s. Estimated remaining: 3h 8m 18s. Rate: 7.1 symbols/min [2025-10-03T19:25:03.998069] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-03T19:25:04.160222] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:04.160690] [DEBUG] [LOCAL ] HMN: No existing data file found in primary storage. [2025-10-03T19:25:04.160755] [WARN ] [MAIN ] HMN: No existing data found, performing full refresh instead. [2025-10-03T19:25:04.160880] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-03T19:25:04.160929] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-03T19:25:04.160977] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-03T19:25:04.161011] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-03T19:25:04.549686] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-03T19:25:04.605779] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:04.790733] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-03T19:25:04.881239] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:25:05.590705] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-03T19:25:06.050147] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T19:25:06.390739] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-03T19:25:06.591911] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-03T19:25:06.615022] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:25:07.190713] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-03T19:25:07.990720] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-03T19:25:08.319679] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-03T19:25:08.790629] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-03T19:25:08.827911] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:25:08.876501] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T19:25:09.590731] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-03T19:25:10.390732] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-03T19:25:10.933216] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-03T19:25:11.190721] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-03T19:25:11.245845] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:25:11.626567] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-03T19:25:11.990705] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-03T19:25:12.790680] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-03T19:25:12.895370] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:25:13.458090] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:25:13.461005] [INFO ] [REMOTE ] HLX: Full fetch complete (69238 records). [2025-10-03T19:25:13.461117] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-03T19:25:13.595762] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-03T19:25:13.887055] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-03T19:25:13.887153] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-03T19:25:13.888125] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-03T19:25:13.888201] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-03T19:25:13.891949] [DEBUG] [LOCAL ] HLX: Trimmed 69238 records to 48451 (keeping 200 days of data) [2025-10-03T19:25:14.168436] [DEBUG] [LOCAL ] HLX: Primary data saved (48451 records). [2025-10-03T19:25:14.168581] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-03T19:25:14.168700] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLX took 35.0s. Estimated remaining: 3h 8m 12s. Rate: 7.1 symbols/min [2025-10-03T19:25:14.371168] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:14.371349] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-03T19:25:14.371574] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-03T19:25:14.371946] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-03T19:25:14.371997] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-03T19:25:14.372043] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-03T19:25:14.372078] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-03T19:25:14.396000] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-03T19:25:14.790047] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:14.823757] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:25:15.190743] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-03T19:25:15.429457] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:25:15.540887] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:25:15.990690] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-03T19:25:16.790671] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-03T19:25:17.105132] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T19:25:17.132991] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:25:17.590730] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-03T19:25:18.314622] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:25:18.390690] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-03T19:25:18.424158] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:25:19.190710] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-03T19:25:19.925790] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:25:19.928691] [INFO ] [REMOTE ] HLT: Full fetch complete (73441 records). [2025-10-03T19:25:19.928821] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-03T19:25:20.002914] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-03T19:25:20.379591] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-03T19:25:20.379742] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-03T19:25:20.380746] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-03T19:25:20.380812] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-03T19:25:20.382351] [DEBUG] [LOCAL ] HLT: Trimmed 73441 records to 51359 (keeping 200 days of data) [2025-10-03T19:25:20.736725] [DEBUG] [LOCAL ] HLT: Primary data saved (51359 records). [2025-10-03T19:25:20.736864] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-03T19:25:20.736990] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HLT took 43.0s. Estimated remaining: 3h 8m 1s. Rate: 7.1 symbols/min [2025-10-03T19:25:20.800571] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-03T19:25:20.960964] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:20.963029] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:25:20.963259] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-03T19:25:20.963462] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-03T19:25:20.974633] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-03T19:25:20.974928] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-03T19:25:20.975026] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-03T19:25:20.975112] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-03T19:25:21.409752] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:21.590714] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-03T19:25:21.797463] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:25:21.797935] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-03T19:25:21.798023] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:25:21.798086] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-03T19:25:21.798123] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:25:21.798192] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-03T19:25:21.798300] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-03T19:25:21.798370] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-03T19:25:21.798435] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-03T19:25:21.798508] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 7m 43s. Rate: 7.1 symbols/min [2025-10-03T19:25:22.000053] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:22.000797] [DEBUG] [LOCAL ] HNI: No existing data file found in primary storage. [2025-10-03T19:25:22.000883] [WARN ] [MAIN ] HNI: No existing data found, performing full refresh instead. [2025-10-03T19:25:22.001204] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-03T19:25:22.001350] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-03T19:25:22.001451] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-03T19:25:22.001598] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-03T19:25:22.095214] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:25:22.179101] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-03T19:25:22.395815] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-03T19:25:22.465495] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:23.190696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-03T19:25:23.990687] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-03T19:25:24.081846] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T19:25:24.313039] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-03T19:25:24.790689] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-03T19:25:25.153774] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T19:25:25.590718] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-03T19:25:25.726187] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:25:26.390746] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-03T19:25:26.912431] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:25:27.190695] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-03T19:25:27.990696] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-03T19:25:28.228796] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:25:28.339097] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:25:28.790687] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-03T19:25:29.042191] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:25:29.590731] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-03T19:25:30.390705] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-03T19:25:30.801850] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:25:31.190694] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-03T19:25:31.462790] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-03T19:25:31.990712] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-03T19:25:32.388478] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:25:32.417937] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:25:32.790715] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-03T19:25:32.876301] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T19:25:32.877780] [INFO ] [REMOTE ] HMN: Full fetch complete (31542 records). [2025-10-03T19:25:32.877881] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-03T19:25:33.280544] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-03T19:25:33.280631] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-03T19:25:33.281242] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-03T19:25:33.281292] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-03T19:25:33.282130] [DEBUG] [LOCAL ] HMN: Trimmed 31542 records to 23661 (keeping 200 days of data) [2025-10-03T19:25:33.431128] [DEBUG] [LOCAL ] HMN: Primary data saved (23661 records). [2025-10-03T19:25:33.431288] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-03T19:25:33.431376] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMN took 29.5s. Estimated remaining: 3h 7m 39s. Rate: 7.1 symbols/min [2025-10-03T19:25:33.594187] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-03T19:25:33.615587] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:33.616520] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-03T19:25:33.616577] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-03T19:25:33.616746] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-03T19:25:33.616803] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-03T19:25:33.616850] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-03T19:25:33.616883] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-03T19:25:34.015825] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:34.384986] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:25:34.395442] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-03T19:25:35.190636] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-03T19:25:35.428325] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:25:35.990663] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-03T19:25:36.153586] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-03T19:25:36.790711] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-03T19:25:36.845467] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-03T19:25:37.105410] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-03T19:25:37.590725] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-03T19:25:38.216127] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:25:38.390685] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-03T19:25:38.657860] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T19:25:39.190706] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-03T19:25:39.990638] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-03T19:25:40.044332] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:25:40.646090] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:25:40.790673] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-03T19:25:41.590703] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-03T19:25:41.646354] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:25:42.227191] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:25:42.390608] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-03T19:25:42.894918] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:25:42.897471] [INFO ] [REMOTE ] HMC: Full fetch complete (69381 records). [2025-10-03T19:25:42.897599] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-03T19:25:43.195894] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-03T19:25:43.342103] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-03T19:25:43.342193] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-03T19:25:43.343120] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-03T19:25:43.343243] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-03T19:25:43.344793] [DEBUG] [LOCAL ] HMC: Trimmed 69381 records to 47350 (keeping 200 days of data) [2025-10-03T19:25:43.646112] [DEBUG] [LOCAL ] HMC: Primary data saved (47350 records). [2025-10-03T19:25:43.646265] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-03T19:25:43.646396] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMC took 45.0s. Estimated remaining: 3h 7m 33s. Rate: 7.1 symbols/min [2025-10-03T19:25:43.832025] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:25:43.832199] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-03T19:25:43.832236] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-03T19:25:43.832351] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-03T19:25:43.832392] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-03T19:25:43.832463] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-03T19:25:43.832509] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-03T19:25:43.962207] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-03T19:25:43.991190] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-03T19:25:43.985918] [INFO ] [REMOTE ] HNI: Full fetch complete (42013 records). [2025-10-03T19:25:44.023111] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-03T19:25:44.442084] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:25:44.689720] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-03T19:25:44.689814] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-03T19:25:44.690475] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-03T19:25:44.690516] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-03T19:25:44.691513] [DEBUG] [LOCAL ] HNI: Trimmed 42013 records to 29796 (keeping 200 days of data) [2025-10-03T19:25:44.790975] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-03T19:25:44.879981] [DEBUG] [LOCAL ] HNI: Primary data saved (29796 records). [2025-10-03T19:25:44.880117] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-03T19:25:44.880197] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNI took 23.1s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-03T19:25:45.140084] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:25:45.590722] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-03T19:25:46.072014] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-03T19:25:46.336146] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-03T19:25:46.390681] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-03T19:25:47.190738] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-03T19:25:47.367773] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:25:47.990711] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-03T19:25:48.428460] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-03T19:25:48.790737] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-03T19:25:48.821908] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-03T19:25:49.590751] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-03T19:25:49.749579] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:25:50.390747] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-03T19:25:50.914943] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:25:51.018534] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:25:51.190711] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-03T19:25:51.997465] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-03T19:25:52.017154] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:25:52.790754] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-03T19:25:53.177132] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-03T19:25:53.590665] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-03T19:25:53.659515] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:25:54.124920] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-03T19:25:54.390688] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-03T19:25:55.190676] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-03T19:25:55.762453] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-03T19:25:55.809981] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T19:25:55.990713] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-03T19:25:56.796671] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-03T19:25:56.817524] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:25:57.590683] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-03T19:25:57.658892] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-03T19:25:58.390738] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-03T19:25:58.754585] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:25:58.801734] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T19:25:58.804787] [INFO ] [REMOTE ] HMY: Full fetch complete (76735 records). [2025-10-03T19:25:58.804911] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-03T19:25:59.195385] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-03T19:25:59.252844] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-03T19:25:59.252935] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-03T19:25:59.254022] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-03T19:25:59.254095] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-03T19:25:59.256554] [DEBUG] [LOCAL ] HMY: Trimmed 76735 records to 53914 (keeping 200 days of data) [2025-10-03T19:25:59.594087] [DEBUG] [LOCAL ] HMY: Primary data saved (53914 records). [2025-10-03T19:25:59.594230] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-03T19:25:59.594326] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HMY took 45.4s. Estimated remaining: 3h 7m 15s. Rate: 7.1 symbols/min [2025-10-03T19:25:59.948277] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:25:59.952013] [INFO ] [REMOTE ] HOG: Full fetch complete (74170 records). [2025-10-03T19:25:59.952148] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-03T19:26:00.411911] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-03T19:26:00.412015] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-03T19:26:00.412952] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-03T19:26:00.413016] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-03T19:26:00.414468] [DEBUG] [LOCAL ] HOG: Trimmed 74170 records to 51853 (keeping 200 days of data) [2025-10-03T19:26:00.754216] [DEBUG] [LOCAL ] HOG: Primary data saved (51853 records). [2025-10-03T19:26:00.754392] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-03T19:26:00.754510] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 27.3s. Estimated remaining: 3h 6m 57s. Rate: 7.1 symbols/min [2025-10-03T19:26:01.033058] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:26:01.042410] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-03T19:26:02.697113] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:26:02.707996] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-03T19:26:04.491486] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:26:04.504036] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-03T19:26:06.091382] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:26:06.102320] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-03T19:26:07.475363] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:26:07.477801] [INFO ] [REMOTE ] HOMB: Full fetch complete (64004 records). [2025-10-03T19:26:07.477921] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-03T19:26:07.907365] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-03T19:26:07.907467] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-03T19:26:07.908410] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-03T19:26:07.908477] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-03T19:26:07.910069] [DEBUG] [LOCAL ] HOMB: Trimmed 64004 records to 44129 (keeping 200 days of data) [2025-10-03T19:26:08.202599] [DEBUG] [LOCAL ] HOMB: Primary data saved (44129 records). [2025-10-03T19:26:08.202780] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-03T19:26:08.202868] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 24.6s. Estimated remaining: 3h 6m 47s. Rate: 7.1 symbols/min [2025-10-03T19:26:08.921592] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.894259] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.977098] [DEBUG] [LOCAL ] HPE: No existing data file found in primary storage. [2025-10-03T19:26:08.976767] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:08.976959] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-03T19:26:09.012920] [DEBUG] [LOCAL ] HP: No existing data file found in primary storage. [2025-10-03T19:26:09.003388] [WARN ] [MAIN ] HPE: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.035492] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:09.035618] [WARN ] [MAIN ] HP: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.010240] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.036483] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.036372] [DEBUG] [LOCAL ] HOV: No existing data file found in primary storage. [2025-10-03T19:26:09.036730] [WARN ] [MAIN ] HOV: No existing data found, performing full refresh instead. [2025-10-03T19:26:09.036971] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.037174] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.036622] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-03T19:26:09.037379] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-03T19:26:09.037456] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-03T19:26:09.037315] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-03T19:26:09.037864] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-03T19:26:09.038091] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-03T19:26:09.037742] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-03T19:26:09.038214] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-03T19:26:09.038443] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-03T19:26:09.038523] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-03T19:26:09.043962] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-03T19:26:09.119335] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-03T19:26:09.218375] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-03T19:26:10.444308] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.501066] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-03T19:26:10.490341] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.529342] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-03T19:26:10.639330] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.661574] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:10.660872] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-03T19:26:10.661986] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-03T19:26:11.589285] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:26:11.593347] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-03T19:26:11.950128] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:26:11.961041] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-03T19:26:12.167561] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:26:12.178588] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-03T19:26:12.399112] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-03T19:26:12.403725] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-03T19:26:12.648614] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T19:26:12.660501] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-03T19:26:13.052024] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-03T19:26:13.055049] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-03T19:26:13.568479] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:26:13.578859] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-03T19:26:13.624493] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:26:13.634715] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-03T19:26:14.073181] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:26:14.076775] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-03T19:26:14.535944] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:26:14.547561] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-03T19:26:14.679116] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-03T19:26:14.688026] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-03T19:26:14.737270] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T19:26:15.191487] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-03T19:26:15.197960] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:26:15.990743] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-03T19:26:16.026634] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:26:16.355664] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:26:16.607180] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:26:16.790736] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-03T19:26:17.590678] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-03T19:26:17.655492] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:26:18.395895] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-03T19:26:18.419479] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:26:18.762794] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:26:19.190740] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-03T19:26:19.990715] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-03T19:26:20.188703] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-03T19:26:20.207478] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-03T19:26:20.790686] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-03T19:26:21.590721] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-03T19:26:21.774869] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:26:22.044939] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-03T19:26:22.390712] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-03T19:26:23.190772] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-03T19:26:23.416128] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-03T19:26:23.990709] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-03T19:26:24.116789] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:26:24.555373] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T19:26:24.790694] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-03T19:26:25.598455] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-03T19:26:25.620336] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:26:26.390744] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-03T19:26:26.764444] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T19:26:27.064366] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:26:27.190707] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-03T19:26:27.898799] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:26:27.900013] [INFO ] [REMOTE ] HOV: Full fetch complete (19209 records). [2025-10-03T19:26:27.900088] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-03T19:26:27.996218] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-03T19:26:28.347165] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-03T19:26:28.347338] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-03T19:26:28.347965] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-03T19:26:28.348128] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-03T19:26:28.349286] [DEBUG] [LOCAL ] HOV: Trimmed 19209 records to 13893 (keeping 200 days of data) [2025-10-03T19:26:28.445824] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-03T19:26:28.483813] [DEBUG] [LOCAL ] HOV: Primary data saved (13893 records). [2025-10-03T19:26:28.483961] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-03T19:26:28.484041] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 20.3s. Estimated remaining: 3h 6m 54s. Rate: 7.1 symbols/min [2025-10-03T19:26:28.666627] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:28.666830] [DEBUG] [LOCAL ] HPF: No existing data file found in primary storage. [2025-10-03T19:26:28.666873] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-10-03T19:26:28.667084] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-03T19:26:28.667164] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-03T19:26:28.667268] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-03T19:26:28.667347] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-03T19:26:28.795775] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-03T19:26:29.063502] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:29.543790] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-03T19:26:29.590741] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-03T19:26:30.390630] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-03T19:26:30.805125] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:26:31.156330] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-03T19:26:31.161924] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-03T19:26:31.190622] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-03T19:26:31.990686] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-03T19:26:32.790677] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-03T19:26:33.222147] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-03T19:26:33.264471] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:26:33.590697] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-03T19:26:34.390681] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-03T19:26:34.526701] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-03T19:26:35.155568] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:26:35.190665] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-03T19:26:35.531826] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:26:35.776158] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T19:26:35.990689] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-03T19:26:36.602452] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T19:26:36.790682] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-03T19:26:37.511699] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T19:26:37.590694] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-03T19:26:38.285429] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-03T19:26:38.390685] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-03T19:26:39.190699] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-03T19:26:39.672883] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T19:26:39.898516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-03T19:26:39.990746] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-03T19:26:40.790696] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-03T19:26:40.811609] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-03T19:26:41.590695] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-03T19:26:42.289326] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-03T19:26:42.390666] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-03T19:26:42.443552] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:26:43.190717] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-03T19:26:43.940113] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:26:43.990674] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-03T19:26:44.477951] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-03T19:26:44.790711] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-03T19:26:45.254751] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:26:45.257428] [INFO ] [REMOTE ] HOUS: Full fetch complete (63694 records). [2025-10-03T19:26:45.257593] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-03T19:26:45.420516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:26:45.437238] [INFO ] [REMOTE ] HPF: Full fetch complete (10818 records). [2025-10-03T19:26:45.461774] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-03T19:26:45.605190] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-03T19:26:45.977426] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-03T19:26:45.990996] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-03T19:26:46.010305] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-03T19:26:46.022741] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-03T19:26:46.078939] [DEBUG] [LOCAL ] HOUS: Trimmed 63694 records to 45288 (keeping 200 days of data) [2025-10-03T19:26:46.113922] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-03T19:26:46.114016] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-03T19:26:46.114174] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-03T19:26:46.114251] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-03T19:26:46.115373] [DEBUG] [LOCAL ] HPF: Trimmed 10818 records to 7503 (keeping 200 days of data) [2025-10-03T19:26:46.266775] [DEBUG] [LOCAL ] HPF: Primary data saved (7503 records). [2025-10-03T19:26:46.268061] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-03T19:26:46.268567] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HPF took 17.8s. Estimated remaining: 3h 6m 58s. Rate: 7.1 symbols/min [2025-10-03T19:26:46.390959] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-03T19:26:46.474163] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:46.475683] [DEBUG] [LOCAL ] HPI: No existing data file found in primary storage. [2025-10-03T19:26:46.476166] [WARN ] [MAIN ] HPI: No existing data found, performing full refresh instead. [2025-10-03T19:26:46.476827] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-03T19:26:46.476970] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-03T19:26:46.477411] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-03T19:26:46.477968] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-03T19:26:46.993768] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:47.053388] [DEBUG] [LOCAL ] HOUS: Primary data saved (45288 records). [2025-10-03T19:26:47.053533] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-03T19:26:47.053626] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HOUS took 38.8s. Estimated remaining: 3h 6m 39s. Rate: 7.1 symbols/min [2025-10-03T19:26:47.203094] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-03T19:26:47.238897] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:47.239130] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-10-03T19:26:47.239180] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-10-03T19:26:47.239295] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-03T19:26:47.239378] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-03T19:26:47.239435] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-03T19:26:47.239470] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-03T19:26:47.630749] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:47.715190] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-03T19:26:47.718103] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-10-03T19:26:47.718290] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-03T19:26:47.995725] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-03T19:26:48.051121] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T19:26:48.052701] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-03T19:26:48.097249] [INFO ] [REMOTE ] HP: Full fetch complete (74025 records). [2025-10-03T19:26:48.112923] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-03T19:26:48.359744] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-03T19:26:48.363334] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-03T19:26:48.364502] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-03T19:26:48.370356] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-03T19:26:48.435092] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54477 (keeping 200 days of data) [2025-10-03T19:26:48.786212] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-03T19:26:48.786903] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-03T19:26:48.787949] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-03T19:26:48.788631] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-03T19:26:48.791246] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-03T19:26:48.795280] [DEBUG] [LOCAL ] HP: Trimmed 74025 records to 52346 (keeping 200 days of data) [2025-10-03T19:26:49.376938] [DEBUG] [LOCAL ] HPE: Primary data saved (54477 records). [2025-10-03T19:26:49.378410] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-03T19:26:49.379066] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 41.2s. Estimated remaining: 3h 6m 23s. Rate: 7.1 symbols/min [2025-10-03T19:26:49.453383] [DEBUG] [LOCAL ] HP: Primary data saved (52346 records). [2025-10-03T19:26:49.490605] [INFO ] [MAIN ] HP: Full history saved. [2025-10-03T19:26:49.494770] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HP took 41.3s. Estimated remaining: 3h 6m 4s. Rate: 7.1 symbols/min [2025-10-03T19:26:49.594560] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:26:49.658120] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:49.660754] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-03T19:26:49.676966] [DEBUG] [LOCAL ] HPQ: No existing data file found in primary storage. [2025-10-03T19:26:49.677951] [WARN ] [MAIN ] HPQ: No existing data found, performing full refresh instead. [2025-10-03T19:26:49.678427] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-03T19:26:49.683935] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-03T19:26:49.708421] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-03T19:26:49.708968] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-03T19:26:49.832501] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:26:49.843122] [DEBUG] [LOCAL ] HPS: No existing data file found in primary storage. [2025-10-03T19:26:49.858180] [WARN ] [MAIN ] HPS: No existing data found, performing full refresh instead. [2025-10-03T19:26:49.886717] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-03T19:26:49.892033] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-03T19:26:49.914891] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-03T19:26:49.935460] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-03T19:26:50.178608] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-10-03T19:26:50.396024] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-03T19:26:50.573725] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-03T19:26:50.765758] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:50.789079] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:26:51.190736] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-03T19:26:51.995809] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-03T19:26:52.017739] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-03T19:26:52.646225] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:26:52.736143] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:26:52.790722] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-03T19:26:53.590823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-03T19:26:54.352516] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:26:54.390700] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-03T19:26:54.738587] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:26:55.190759] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-03T19:26:55.992816] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-03T19:26:55.996008] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:26:56.046010] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-03T19:26:56.600603] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-03T19:26:56.790735] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-03T19:26:57.590713] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-03T19:26:57.614250] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:26:58.390705] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-03T19:26:59.194715] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-03T19:26:59.217630] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:26:59.228331] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-03T19:26:59.990692] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-03T19:27:00.790736] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-03T19:27:00.806708] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T19:27:00.904884] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:27:01.590756] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-03T19:27:02.221524] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:27:02.380533] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:27:02.390626] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-03T19:27:03.190688] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-03T19:27:03.209297] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:27:03.990727] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-03T19:27:04.792639] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-03T19:27:04.792498] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:27:05.590685] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-03T19:27:05.614707] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:27:06.022723] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:27:06.390691] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-03T19:27:06.983968] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:27:06.985133] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:27:07.190723] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-03T19:27:07.990731] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-03T19:27:08.790747] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-03T19:27:08.936798] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:27:08.970537] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-03T19:27:09.590702] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-03T19:27:10.390737] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-03T19:27:10.426862] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:27:10.800024] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:27:11.190724] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-03T19:27:11.990697] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-03T19:27:12.113302] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:27:12.767345] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:27:12.790686] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-03T19:27:13.123615] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-03T19:27:13.590746] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-03T19:27:14.390619] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-03T19:27:14.459162] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-03T19:27:14.497286] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:27:15.190695] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-03T19:27:15.990718] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-03T19:27:16.176963] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-03T19:27:16.231687] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:27:16.790723] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-03T19:27:17.346608] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:27:17.353340] [INFO ] [REMOTE ] HPP: Full fetch complete (73344 records). [2025-10-03T19:27:17.353519] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-03T19:27:17.595736] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-03T19:27:17.789421] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-03T19:27:17.789544] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-03T19:27:17.790522] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-03T19:27:17.790588] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-03T19:27:17.792144] [DEBUG] [LOCAL ] HPP: Trimmed 73344 records to 51658 (keeping 200 days of data) [2025-10-03T19:27:18.095040] [DEBUG] [LOCAL ] HPP: Primary data saved (51658 records). [2025-10-03T19:27:18.095187] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-03T19:27:18.095278] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPP took 31.0s. Estimated remaining: 3h 6m 21s. Rate: 7.1 symbols/min [2025-10-03T19:27:18.276545] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:18.276751] [DEBUG] [LOCAL ] HQH: No existing data file found in primary storage. [2025-10-03T19:27:18.276824] [WARN ] [MAIN ] HQH: No existing data found, performing full refresh instead. [2025-10-03T19:27:18.276988] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-03T19:27:18.277159] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-03T19:27:18.277309] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-03T19:27:18.277404] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-03T19:27:18.397599] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-03T19:27:18.680969] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:18.682088] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:27:18.724129] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:27:19.190714] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-03T19:27:19.281633] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:27:19.282862] [INFO ] [REMOTE ] HPI: Full fetch complete (13905 records). [2025-10-03T19:27:19.282939] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-03T19:27:19.692933] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-03T19:27:19.693060] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-03T19:27:19.693449] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-03T19:27:19.693514] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-03T19:27:19.694156] [DEBUG] [LOCAL ] HPI: Trimmed 13905 records to 10537 (keeping 200 days of data) [2025-10-03T19:27:19.765527] [DEBUG] [LOCAL ] HPI: Primary data saved (10537 records). [2025-10-03T19:27:19.765726] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-03T19:27:19.765833] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPI took 33.5s. Estimated remaining: 3h 6m 4s. Rate: 7.1 symbols/min [2025-10-03T19:27:19.897730] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:27:19.915066] [INFO ] [REMOTE ] HPS: Full fetch complete (15267 records). [2025-10-03T19:27:19.946392] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-03T19:27:19.967689] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:20.009138] [DEBUG] [LOCAL ] HQL: No existing data file found in primary storage. [2025-10-03T19:27:19.995784] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-03T19:27:20.032529] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-10-03T19:27:20.067456] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-03T19:27:20.088688] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-03T19:27:20.094674] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-03T19:27:20.105090] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-03T19:27:20.684222] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-03T19:27:20.695846] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-03T19:27:20.704695] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-03T19:27:20.707314] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-03T19:27:20.723949] [DEBUG] [LOCAL ] HPS: Trimmed 15267 records to 10340 (keeping 200 days of data) [2025-10-03T19:27:20.792865] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-03T19:27:20.846987] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:20.869744] [DEBUG] [LOCAL ] HPS: Primary data saved (10340 records). [2025-10-03T19:27:20.869863] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-03T19:27:20.869960] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HPS took 31.4s. Estimated remaining: 3h 5m 47s. Rate: 7.1 symbols/min [2025-10-03T19:27:21.052285] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:21.052479] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-10-03T19:27:21.052540] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-10-03T19:27:21.052692] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-03T19:27:21.052749] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-03T19:27:21.052802] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-03T19:27:21.052841] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-03T19:27:21.433394] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:21.590638] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-03T19:27:21.972389] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-03T19:27:22.117405] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-03T19:27:22.305886] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:27:22.390688] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-03T19:27:23.190696] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-03T19:27:23.552688] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:27:23.990637] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-03T19:27:24.290471] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T19:27:24.790700] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-03T19:27:25.160526] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:27:25.590719] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-03T19:27:25.786339] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:27:26.390685] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-03T19:27:27.195834] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-03T19:27:27.214424] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-03T19:27:27.267849] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T19:27:27.990683] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-03T19:27:28.790617] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-03T19:27:29.108739] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-03T19:27:29.417677] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-03T19:27:29.590689] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-03T19:27:29.660460] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:27:30.390727] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-03T19:27:30.511454] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T19:27:31.190707] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-03T19:27:31.981546] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:27:31.991709] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-03T19:27:32.048108] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T19:27:32.790709] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-03T19:27:32.957592] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:27:33.590718] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-03T19:27:33.889115] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-03T19:27:34.390683] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-03T19:27:35.190702] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-03T19:27:35.506621] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-03T19:27:35.509412] [INFO ] [REMOTE ] HPQ: Full fetch complete (77669 records). [2025-10-03T19:27:35.509532] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-03T19:27:35.998146] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-03T19:27:35.997860] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-03T19:27:35.998491] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-03T19:27:36.001006] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-03T19:27:36.014171] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:27:36.012590] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-03T19:27:36.022914] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:27:36.030616] [DEBUG] [LOCAL ] HPQ: Trimmed 77669 records to 54447 (keeping 200 days of data) [2025-10-03T19:27:36.384812] [DEBUG] [LOCAL ] HPQ: Primary data saved (54447 records). [2025-10-03T19:27:36.385008] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-03T19:27:36.385146] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HPQ took 47.0s. Estimated remaining: 3h 5m 47s. Rate: 7.1 symbols/min [2025-10-03T19:27:36.570153] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:36.570334] [DEBUG] [LOCAL ] HRB: No existing data file found in primary storage. [2025-10-03T19:27:36.570396] [WARN ] [MAIN ] HRB: No existing data found, performing full refresh instead. [2025-10-03T19:27:36.570522] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-03T19:27:36.570598] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-03T19:27:36.570742] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-03T19:27:36.570806] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-03T19:27:36.797953] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-03T19:27:36.992336] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:37.590768] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-03T19:27:37.706116] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:27:38.213457] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-03T19:27:38.230867] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-03T19:27:38.390757] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-03T19:27:39.190699] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-03T19:27:39.990673] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-03T19:27:40.138044] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:27:40.173470] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:27:40.706409] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-03T19:27:40.790690] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-03T19:27:41.590686] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-03T19:27:41.889142] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:27:41.890861] [INFO ] [REMOTE ] HQH: Full fetch complete (37479 records). [2025-10-03T19:27:41.890969] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-03T19:27:42.295489] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-03T19:27:42.295567] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-03T19:27:42.296229] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-03T19:27:42.296293] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-03T19:27:42.297280] [DEBUG] [LOCAL ] HQH: Trimmed 37479 records to 25615 (keeping 200 days of data) [2025-10-03T19:27:42.392937] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-03T19:27:42.467821] [DEBUG] [LOCAL ] HQH: Primary data saved (25615 records). [2025-10-03T19:27:42.467988] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-03T19:27:42.468137] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQH took 24.4s. Estimated remaining: 3h 5m 36s. Rate: 7.1 symbols/min [2025-10-03T19:27:42.654091] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:42.654257] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-10-03T19:27:42.654296] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-10-03T19:27:42.654442] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-03T19:27:42.654498] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-03T19:27:42.654542] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-03T19:27:42.654575] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-03T19:27:43.038183] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:43.099184] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:27:43.190698] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-03T19:27:43.373017] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:27:43.990627] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-03T19:27:44.159154] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:27:44.790693] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-03T19:27:45.590634] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-03T19:27:45.954446] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-03T19:27:46.390681] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-03T19:27:46.590263] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:27:46.660040] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:27:47.190684] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-03T19:27:47.981755] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-03T19:27:47.991181] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-03T19:27:48.061054] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-03T19:27:48.790672] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-03T19:27:48.889564] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:27:48.891514] [INFO ] [REMOTE ] HQL: Full fetch complete (24974 records). [2025-10-03T19:27:48.891595] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-03T19:27:49.305498] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-03T19:27:49.305592] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-03T19:27:49.306260] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-03T19:27:49.306371] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-03T19:27:49.308101] [DEBUG] [LOCAL ] HQL: Trimmed 24974 records to 16628 (keeping 200 days of data) [2025-10-03T19:27:49.419975] [DEBUG] [LOCAL ] HQL: Primary data saved (16628 records). [2025-10-03T19:27:49.420123] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-03T19:27:49.420228] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HQL took 29.7s. Estimated remaining: 3h 5m 25s. Rate: 7.1 symbols/min [2025-10-03T19:27:49.608104] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:27:49.604477] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-03T19:27:49.608352] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-10-03T19:27:49.608419] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-10-03T19:27:49.608783] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-03T19:27:49.609426] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-03T19:27:49.609497] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-03T19:27:49.609535] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-03T19:27:50.013579] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:27:50.399102] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-03T19:27:50.422696] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:27:50.667518] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-03T19:27:51.190698] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-03T19:27:51.990702] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-03T19:27:52.341565] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-10-03T19:27:52.790731] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-03T19:27:52.995492] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:27:53.590632] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-03T19:27:53.702884] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-03T19:27:54.390706] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-03T19:27:54.465963] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:27:55.190669] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-03T19:27:55.241355] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:27:55.990728] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-03T19:27:56.107535] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:27:56.703016] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:27:56.790692] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-03T19:27:57.429398] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T19:27:57.590726] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-03T19:27:57.940339] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:27:58.390737] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-03T19:27:59.190670] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-03T19:27:59.271539] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-03T19:27:59.858971] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:27:59.990689] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-03T19:28:00.790688] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-03T19:28:01.064810] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:28:01.590634] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-03T19:28:01.938480] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:28:02.261793] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:28:02.390733] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-03T19:28:03.055033] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:28:03.057684] [INFO ] [REMOTE ] HR: Full fetch complete (74837 records). [2025-10-03T19:28:03.057796] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-03T19:28:03.205716] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-03T19:28:03.481573] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-03T19:28:03.481701] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-03T19:28:03.482677] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-03T19:28:03.482745] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-03T19:28:03.484322] [DEBUG] [LOCAL ] HR: Trimmed 74837 records to 52706 (keeping 200 days of data) [2025-10-03T19:28:03.821056] [DEBUG] [LOCAL ] HR: Primary data saved (52706 records). [2025-10-03T19:28:03.821237] [INFO ] [MAIN ] HR: Full history saved. [2025-10-03T19:28:03.821340] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HR took 43.0s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-10-03T19:28:03.998225] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-03T19:28:04.002030] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:04.003736] [DEBUG] [LOCAL ] HRTG: No existing data file found in primary storage. [2025-10-03T19:28:04.003794] [WARN ] [MAIN ] HRTG: No existing data found, performing full refresh instead. [2025-10-03T19:28:04.003949] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-03T19:28:04.004003] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-03T19:28:04.004069] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-03T19:28:04.004140] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-03T19:28:04.438014] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:04.442706] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-03T19:28:04.790618] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-03T19:28:04.824978] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:28:04.959814] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:28:05.590735] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-03T19:28:06.390633] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-03T19:28:06.590334] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:28:06.757586] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:28:07.190717] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-03T19:28:07.822585] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:28:07.990671] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-03T19:28:08.286354] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-03T19:28:08.790745] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-03T19:28:09.590684] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-03T19:28:09.770634] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-03T19:28:10.390704] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-03T19:28:10.600666] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:28:10.966220] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:28:11.190690] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-03T19:28:11.444827] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:28:11.990630] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-03T19:28:12.790667] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-03T19:28:12.952532] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:28:13.086539] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T19:28:13.590707] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-03T19:28:13.898966] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:28:14.390730] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-03T19:28:15.190700] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-03T19:28:15.282126] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:28:15.990721] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-03T19:28:16.348044] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-03T19:28:16.436190] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-03T19:28:16.790699] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-03T19:28:17.087868] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:28:17.089807] [INFO ] [REMOTE ] HRI: Full fetch complete (46353 records). [2025-10-03T19:28:17.089896] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-03T19:28:17.520401] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-03T19:28:17.520550] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-03T19:28:17.521419] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-03T19:28:17.521487] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-03T19:28:17.522794] [DEBUG] [LOCAL ] HRI: Trimmed 46353 records to 33230 (keeping 200 days of data) [2025-10-03T19:28:17.597097] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-03T19:28:17.756893] [DEBUG] [LOCAL ] HRI: Primary data saved (33230 records). [2025-10-03T19:28:17.757057] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-03T19:28:17.757162] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRI took 35.3s. Estimated remaining: 3h 5m 23s. Rate: 7.1 symbols/min [2025-10-03T19:28:17.941571] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:17.941787] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-03T19:28:17.941833] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-03T19:28:17.941953] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-03T19:28:17.941997] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-03T19:28:17.942040] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-03T19:28:17.942074] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-03T19:28:18.367179] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:18.390617] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-03T19:28:18.561285] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-03T19:28:18.565271] [INFO ] [REMOTE ] HRL: Full fetch complete (76681 records). [2025-10-03T19:28:18.565432] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-03T19:28:19.012314] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-03T19:28:19.048850] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-03T19:28:19.049348] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-03T19:28:19.050515] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-03T19:28:19.050609] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-03T19:28:19.053791] [DEBUG] [LOCAL ] HRL: Trimmed 76681 records to 53847 (keeping 200 days of data) [2025-10-03T19:28:19.190732] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-03T19:28:19.421688] [DEBUG] [LOCAL ] HRL: Primary data saved (53847 records). [2025-10-03T19:28:19.421856] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-03T19:28:19.421976] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HRL took 30.0s. Estimated remaining: 3h 5m 6s. Rate: 7.1 symbols/min [2025-10-03T19:28:19.608232] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:19.608516] [DEBUG] [LOCAL ] HSHP: No existing data file found in primary storage. [2025-10-03T19:28:19.608561] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-10-03T19:28:19.608714] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-03T19:28:19.608771] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-03T19:28:19.608818] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-03T19:28:19.608855] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-03T19:28:19.997551] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-03T19:28:20.056736] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:20.100259] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:28:20.739763] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:28:20.746813] [INFO ] [REMOTE ] HRB: Full fetch complete (69891 records). [2025-10-03T19:28:20.747049] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-03T19:28:20.804077] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-03T19:28:21.276408] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-03T19:28:21.276526] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-03T19:28:21.277691] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-03T19:28:21.277847] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-03T19:28:21.279873] [DEBUG] [LOCAL ] HRB: Trimmed 69891 records to 49183 (keeping 200 days of data) [2025-10-03T19:28:21.539393] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:28:21.611599] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-03T19:28:21.647985] [DEBUG] [LOCAL ] HRB: Primary data saved (49183 records). [2025-10-03T19:28:21.648131] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-03T19:28:21.648210] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRB took 45.3s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-03T19:28:21.829319] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:21.829557] [DEBUG] [LOCAL ] HSY: No existing data file found in primary storage. [2025-10-03T19:28:21.829619] [WARN ] [MAIN ] HSY: No existing data found, performing full refresh instead. [2025-10-03T19:28:21.829760] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-03T19:28:21.829805] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-03T19:28:21.829849] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-03T19:28:21.829883] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-03T19:28:22.233540] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:22.390717] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-03T19:28:22.687758] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-03T19:28:22.703894] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:28:23.190699] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-03T19:28:23.498431] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:28:23.990634] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-03T19:28:24.138946] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:28:24.790696] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-03T19:28:25.590631] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-03T19:28:25.903455] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T19:28:26.390696] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-03T19:28:26.577484] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:28:26.644258] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:28:27.190708] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-03T19:28:27.528020] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:28:27.990683] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-03T19:28:28.790631] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-03T19:28:28.954427] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:28:29.044372] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:28:29.590694] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-03T19:28:29.822205] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-03T19:28:30.390639] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-03T19:28:30.684714] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:28:31.190697] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-03T19:28:31.990684] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-03T19:28:32.705846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-03T19:28:32.755315] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:28:32.790623] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-03T19:28:32.849946] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:28:33.590684] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-03T19:28:33.758816] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:28:34.390683] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-03T19:28:35.190710] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-03T19:28:35.559296] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-03T19:28:35.898964] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-03T19:28:35.990698] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-03T19:28:36.319682] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T19:28:36.790733] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-03T19:28:37.478680] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:28:37.572168] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:28:37.590673] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-03T19:28:38.390705] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-03T19:28:38.641035] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:28:39.190711] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-03T19:28:39.596515] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:28:39.598809] [INFO ] [REMOTE ] HRTG: Full fetch complete (43109 records). [2025-10-03T19:28:39.598930] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-03T19:28:40.003095] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-03T19:28:40.022747] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-03T19:28:40.022824] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-03T19:28:40.023544] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-03T19:28:40.023609] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-03T19:28:40.025529] [DEBUG] [LOCAL ] HRTG: Trimmed 43109 records to 33921 (keeping 200 days of data) [2025-10-03T19:28:40.230878] [DEBUG] [LOCAL ] HRTG: Primary data saved (33921 records). [2025-10-03T19:28:40.231017] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-03T19:28:40.231095] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 36.4s. Estimated remaining: 3h 4m 54s. Rate: 7.1 symbols/min [2025-10-03T19:28:40.423033] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:40.423262] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-03T19:28:40.423318] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-03T19:28:40.423477] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-03T19:28:40.423527] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-03T19:28:40.423574] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-03T19:28:40.423607] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-03T19:28:40.793451] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-03T19:28:40.819782] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:40.939406] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:28:41.590683] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-03T19:28:41.650836] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:28:41.651983] [INFO ] [REMOTE ] HSHP: Full fetch complete (23354 records). [2025-10-03T19:28:41.652056] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-03T19:28:41.785276] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:28:41.853923] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-03T19:28:41.859373] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:28:41.890236] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-03T19:28:41.904300] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:28:41.909701] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-03T19:28:41.945559] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-03T19:28:41.950897] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-03T19:28:41.970940] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-03T19:28:41.981465] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HTB took 1.8s. Estimated remaining: 3h 4m 37s. Rate: 7.1 symbols/min [2025-10-03T19:28:42.180163] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-03T19:28:42.185931] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-03T19:28:42.207260] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-03T19:28:42.222179] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-03T19:28:42.236210] [DEBUG] [LOCAL ] HSHP: Trimmed 23354 records to 15437 (keeping 200 days of data) [2025-10-03T19:28:42.317377] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:42.358906] [DEBUG] [LOCAL ] HTD: No existing data file found in primary storage. [2025-10-03T19:28:42.360633] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-10-03T19:28:42.361539] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-03T19:28:42.362692] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-03T19:28:42.374135] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-03T19:28:42.376158] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-03T19:28:42.376816] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-03T19:28:42.396167] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-03T19:28:42.808228] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:42.812906] [DEBUG] [LOCAL ] HSHP: Primary data saved (15437 records). [2025-10-03T19:28:42.813053] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-03T19:28:42.813162] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HSHP took 23.4s. Estimated remaining: 3h 4m 19s. Rate: 7.1 symbols/min [2025-10-03T19:28:43.008870] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:28:43.009053] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-03T19:28:43.009110] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-03T19:28:43.009222] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-03T19:28:43.009265] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-03T19:28:43.009309] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-03T19:28:43.009344] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-03T19:28:43.195842] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-03T19:28:43.396697] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:28:43.990629] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-03T19:28:44.202676] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:28:44.240281] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-10-03T19:28:44.790733] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-03T19:28:45.324996] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T19:28:45.590701] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-03T19:28:45.927333] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-03T19:28:46.390679] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-03T19:28:46.673094] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T19:28:47.190684] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-03T19:28:47.993374] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-03T19:28:47.996495] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T19:28:48.179954] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:28:48.790708] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-03T19:28:49.115709] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-03T19:28:49.590637] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-03T19:28:49.913284] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-03T19:28:49.926967] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-03T19:28:50.390726] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-03T19:28:50.816615] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-03T19:28:51.190728] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-03T19:28:51.990731] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-03T19:28:52.315388] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-03T19:28:52.790632] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-03T19:28:53.172105] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-03T19:28:53.175096] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-03T19:28:53.590708] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-03T19:28:54.390728] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-03T19:28:55.190638] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-03T19:28:55.335868] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:28:55.370354] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:28:55.455519] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-03T19:28:55.990686] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-03T19:28:56.790700] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-03T19:28:57.590702] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-03T19:28:57.675709] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:28:58.045924] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:28:58.390694] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-03T19:28:58.649808] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-03T19:28:58.654007] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:28:59.190736] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-03T19:28:59.990711] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-03T19:29:00.254136] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T19:29:00.790722] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-03T19:29:01.135105] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-03T19:29:01.574863] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:29:01.577617] [INFO ] [REMOTE ] HSY: Full fetch complete (73605 records). [2025-10-03T19:29:01.577818] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-03T19:29:01.601480] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-03T19:29:02.002177] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-03T19:29:02.002270] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-03T19:29:02.003258] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-03T19:29:02.003326] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-03T19:29:02.004991] [DEBUG] [LOCAL ] HSY: Trimmed 73605 records to 51044 (keeping 200 days of data) [2025-10-03T19:29:02.192451] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:29:02.202616] [INFO ] [REMOTE ] HTFC: Full fetch complete (845 records). [2025-10-03T19:29:02.227992] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-03T19:29:02.395880] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-03T19:29:02.431486] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-10-03T19:29:02.432007] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:29:02.432341] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:29:02.432975] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-03T19:29:02.433878] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-03T19:29:02.434103] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-03T19:29:02.435050] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-03T19:29:02.435430] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HTFC took 19.6s. Estimated remaining: 3h 4m 25s. Rate: 7.1 symbols/min [2025-10-03T19:29:02.629346] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:02.630288] [DEBUG] [LOCAL ] HTGC: No existing data file found in primary storage. [2025-10-03T19:29:02.630681] [WARN ] [MAIN ] HTGC: No existing data found, performing full refresh instead. [2025-10-03T19:29:02.632407] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-03T19:29:02.633266] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-03T19:29:02.633919] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-03T19:29:02.634245] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-03T19:29:03.102523] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:03.138164] [DEBUG] [LOCAL ] HSY: Primary data saved (51044 records). [2025-10-03T19:29:03.138335] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-03T19:29:03.138420] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HSY took 41.5s. Estimated remaining: 3h 4m 7s. Rate: 7.1 symbols/min [2025-10-03T19:29:03.196946] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-03T19:29:03.321097] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:03.321265] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-03T19:29:03.321303] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-03T19:29:03.321442] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-03T19:29:03.321518] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-03T19:29:03.321579] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-03T19:29:03.321612] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-03T19:29:03.701476] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:03.990625] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-03T19:29:04.063913] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:29:04.066619] [INFO ] [REMOTE ] HSBC: Full fetch complete (73753 records). [2025-10-03T19:29:04.066780] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-03T19:29:04.491146] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-03T19:29:04.491230] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-03T19:29:04.492209] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-03T19:29:04.492276] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-03T19:29:04.493755] [DEBUG] [LOCAL ] HSBC: Trimmed 73753 records to 51774 (keeping 200 days of data) [2025-10-03T19:29:04.803529] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-03T19:29:04.828270] [DEBUG] [LOCAL ] HSBC: Primary data saved (51774 records). [2025-10-03T19:29:04.828442] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-03T19:29:04.828525] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HSBC took 47.1s. Estimated remaining: 3h 3m 50s. Rate: 7.1 symbols/min [2025-10-03T19:29:05.010807] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:05.011364] [DEBUG] [LOCAL ] HUBB: No existing data file found in primary storage. [2025-10-03T19:29:05.011708] [WARN ] [MAIN ] HUBB: No existing data found, performing full refresh instead. [2025-10-03T19:29:05.026895] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-03T19:29:05.027372] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-03T19:29:05.028441] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:29:05.034988] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-03T19:29:05.035056] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-03T19:29:05.195282] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-03T19:29:05.475332] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:05.590714] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-03T19:29:05.776126] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-03T19:29:06.390705] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-03T19:29:06.991072] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:29:07.190679] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-03T19:29:07.191542] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T19:29:07.990704] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-03T19:29:08.790723] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-03T19:29:08.879236] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:29:08.941544] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-03T19:29:09.585990] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:29:09.590605] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-03T19:29:10.390703] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-03T19:29:10.538509] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:29:11.190733] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-03T19:29:11.704380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:29:11.990689] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-03T19:29:12.790745] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-03T19:29:12.899990] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:29:13.232169] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:29:13.590726] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-03T19:29:14.390715] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-03T19:29:14.476925] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:29:15.130997] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T19:29:15.190630] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-03T19:29:15.914572] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:29:15.990678] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-03T19:29:16.789100] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-03T19:29:16.792727] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-03T19:29:17.134639] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:29:17.590691] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-03T19:29:18.242281] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:29:18.390743] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-03T19:29:19.190738] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-03T19:29:19.319401] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:29:19.990735] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-03T19:29:20.060617] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-03T19:29:20.136778] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:29:20.576795] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:29:20.790726] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-03T19:29:21.590694] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-03T19:29:22.399791] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-03T19:29:22.403102] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:29:23.007738] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-03T19:29:23.190691] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-03T19:29:23.990692] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-03T19:29:24.117752] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:29:24.206442] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-03T19:29:24.790688] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-03T19:29:24.795901] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:29:24.797383] [INFO ] [REMOTE ] HTD: Full fetch complete (19089 records). [2025-10-03T19:29:24.797460] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-03T19:29:25.206020] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-03T19:29:25.206101] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-03T19:29:25.206553] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-03T19:29:25.206623] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-03T19:29:25.207296] [DEBUG] [LOCAL ] HTD: Trimmed 19089 records to 14020 (keeping 200 days of data) [2025-10-03T19:29:25.303078] [DEBUG] [LOCAL ] HTD: Primary data saved (14020 records). [2025-10-03T19:29:25.303338] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-03T19:29:25.303451] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTD took 43.3s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-10-03T19:29:25.482783] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:25.482959] [DEBUG] [LOCAL ] HUBS: No existing data file found in primary storage. [2025-10-03T19:29:25.483009] [WARN ] [MAIN ] HUBS: No existing data found, performing full refresh instead. [2025-10-03T19:29:25.483217] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-03T19:29:25.483263] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-03T19:29:25.483307] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-03T19:29:25.483340] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-03T19:29:25.594870] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-03T19:29:25.867128] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:26.390637] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-03T19:29:26.426626] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-03T19:29:26.952114] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:29:27.190713] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-03T19:29:27.796094] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:29:27.990677] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-03T19:29:28.456373] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-03T19:29:28.790691] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-03T19:29:29.569346] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:29:29.590606] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-03T19:29:29.797109] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-03T19:29:29.798847] [INFO ] [REMOTE ] HTH: Full fetch complete (46752 records). [2025-10-03T19:29:29.799002] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-03T19:29:30.202098] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-03T19:29:30.202182] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-03T19:29:30.202917] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-03T19:29:30.202983] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-03T19:29:30.204069] [DEBUG] [LOCAL ] HTH: Trimmed 46752 records to 32613 (keeping 200 days of data) [2025-10-03T19:29:30.390761] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-03T19:29:30.410675] [DEBUG] [LOCAL ] HTH: Primary data saved (32613 records). [2025-10-03T19:29:30.410861] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-03T19:29:30.410957] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTH took 27.3s. Estimated remaining: 3h 3m 44s. Rate: 7.1 symbols/min [2025-10-03T19:29:30.612848] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:30.613078] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-03T19:29:30.613137] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-03T19:29:30.613256] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-03T19:29:30.613301] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-03T19:29:30.613344] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-03T19:29:30.613378] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-03T19:29:30.983760] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:31.190692] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-03T19:29:31.445350] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:29:31.507998] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:29:31.990691] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-03T19:29:32.790722] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-03T19:29:32.895197] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T19:29:33.593850] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-03T19:29:33.650137] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-03T19:29:34.222592] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:29:34.390733] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-03T19:29:35.190693] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-03T19:29:35.393689] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:29:35.718764] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:29:35.990717] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-03T19:29:36.620617] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:29:36.624110] [INFO ] [REMOTE ] HTGC: Full fetch complete (68238 records). [2025-10-03T19:29:36.624283] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-03T19:29:36.795895] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-03T19:29:37.059890] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-03T19:29:37.059984] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-03T19:29:37.061061] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-03T19:29:37.061135] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-03T19:29:37.062972] [DEBUG] [LOCAL ] HTGC: Trimmed 68238 records to 48078 (keeping 200 days of data) [2025-10-03T19:29:37.377765] [DEBUG] [LOCAL ] HTGC: Primary data saved (48078 records). [2025-10-03T19:29:37.377934] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-03T19:29:37.378062] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HTGC took 34.9s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-03T19:29:37.598589] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-03T19:29:37.601352] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:37.602878] [DEBUG] [LOCAL ] HUN: No existing data file found in primary storage. [2025-10-03T19:29:37.603062] [WARN ] [MAIN ] HUN: No existing data found, performing full refresh instead. [2025-10-03T19:29:37.603256] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-03T19:29:37.603325] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-03T19:29:37.603522] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-03T19:29:37.603787] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-03T19:29:37.701917] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:29:38.036325] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:38.390742] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-03T19:29:38.945947] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-03T19:29:39.030196] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:29:39.190715] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-03T19:29:40.000352] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-03T19:29:40.021844] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:29:40.790695] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-03T19:29:40.893154] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:29:41.399842] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-03T19:29:41.590716] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-03T19:29:41.988353] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:29:42.390722] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-03T19:29:43.190632] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-03T19:29:43.544613] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:29:43.914387] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-03T19:29:43.990731] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-03T19:29:44.663478] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-03T19:29:44.790742] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-03T19:29:45.590736] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-03T19:29:45.653958] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:29:46.390706] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-03T19:29:46.465260] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:29:47.190713] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-03T19:29:47.571844] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-03T19:29:47.990618] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-03T19:29:48.109284] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:29:48.261979] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-03T19:29:48.790706] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-03T19:29:49.430842] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-03T19:29:49.590702] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-03T19:29:50.307138] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-03T19:29:50.390630] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-03T19:29:51.190680] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-03T19:29:51.432795] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-03T19:29:51.777758] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:29:51.990685] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-03T19:29:52.344841] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-03T19:29:52.348575] [INFO ] [REMOTE ] HUBB: Full fetch complete (53784 records). [2025-10-03T19:29:52.348892] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-03T19:29:52.777063] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-03T19:29:52.777165] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-03T19:29:52.778069] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-03T19:29:52.778191] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-03T19:29:52.779550] [DEBUG] [LOCAL ] HUBB: Trimmed 53784 records to 37114 (keeping 200 days of data) [2025-10-03T19:29:52.841671] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-03T19:29:53.031373] [DEBUG] [LOCAL ] HUBB: Primary data saved (37114 records). [2025-10-03T19:29:53.031542] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-03T19:29:53.031627] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBB took 48.2s. Estimated remaining: 3h 3m 34s. Rate: 7.1 symbols/min [2025-10-03T19:29:53.215509] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:29:53.215709] [DEBUG] [LOCAL ] HUYA: No existing data file found in primary storage. [2025-10-03T19:29:53.215763] [WARN ] [MAIN ] HUYA: No existing data found, performing full refresh instead. [2025-10-03T19:29:53.215882] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-03T19:29:53.215928] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-03T19:29:53.215974] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-03T19:29:53.216010] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-03T19:29:53.603154] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-03T19:29:53.608934] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:29:53.643524] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:29:54.390739] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-03T19:29:54.591141] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:29:55.190676] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-03T19:29:55.231880] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:29:55.689035] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:29:55.990760] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-03T19:29:56.790714] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-03T19:29:56.954217] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T19:29:57.570568] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:29:57.590664] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-03T19:29:58.390712] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-03T19:29:58.430343] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:29:59.094317] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:29:59.190638] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-03T19:29:59.990707] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-03T19:30:00.357946] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-03T19:30:00.654485] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:30:00.790637] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-03T19:30:01.590743] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-03T19:30:02.209511] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-03T19:30:02.390712] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-03T19:30:02.522484] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:30:03.190695] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-03T19:30:03.460071] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:30:03.634943] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:30:03.638394] [INFO ] [REMOTE ] HUBS: Full fetch complete (55736 records). [2025-10-03T19:30:03.638489] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-03T19:30:03.995910] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-03T19:30:04.088944] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-03T19:30:04.089040] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-03T19:30:04.089951] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-03T19:30:04.090024] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-03T19:30:04.091720] [DEBUG] [LOCAL ] HUBS: Trimmed 55736 records to 39955 (keeping 200 days of data) [2025-10-03T19:30:04.365346] [DEBUG] [LOCAL ] HUBS: Primary data saved (39955 records). [2025-10-03T19:30:04.365526] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-03T19:30:04.365627] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HUBS took 39.1s. Estimated remaining: 3h 3m 29s. Rate: 7.1 symbols/min [2025-10-03T19:30:04.556003] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:04.556170] [DEBUG] [LOCAL ] HVT: No existing data file found in primary storage. [2025-10-03T19:30:04.556209] [WARN ] [MAIN ] HVT: No existing data found, performing full refresh instead. [2025-10-03T19:30:04.556325] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-03T19:30:04.556369] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-03T19:30:04.556413] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-03T19:30:04.556446] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-03T19:30:04.798085] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-03T19:30:04.820760] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-03T19:30:04.858912] [INFO ] [REMOTE ] HUN: Full fetch complete (76715 records). [2025-10-03T19:30:04.880889] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-03T19:30:05.115138] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:05.576366] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-03T19:30:05.576545] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-03T19:30:05.578918] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-03T19:30:05.579030] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-03T19:30:05.581102] [DEBUG] [LOCAL ] HUN: Trimmed 76715 records to 53977 (keeping 200 days of data) [2025-10-03T19:30:05.654706] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-03T19:30:05.760444] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:30:06.150815] [DEBUG] [LOCAL ] HUN: Primary data saved (53977 records). [2025-10-03T19:30:06.151003] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-03T19:30:06.151119] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUN took 28.8s. Estimated remaining: 3h 3m 13s. Rate: 7.1 symbols/min [2025-10-03T19:30:06.362499] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:06.362809] [DEBUG] [LOCAL ] HWM: No existing data file found in primary storage. [2025-10-03T19:30:06.362910] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-10-03T19:30:06.363043] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-03T19:30:06.363118] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-03T19:30:06.363204] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-03T19:30:06.363271] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-03T19:30:06.397890] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-03T19:30:06.681099] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-03T19:30:06.726298] [INFO ] [REMOTE ] HUM: Full fetch complete (71037 records). [2025-10-03T19:30:06.736850] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-03T19:30:06.824979] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:06.911525] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-03T19:30:07.195745] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-03T19:30:07.281634] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-03T19:30:07.281755] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-03T19:30:07.282809] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-03T19:30:07.282882] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-03T19:30:07.284667] [DEBUG] [LOCAL ] HUM: Trimmed 71037 records to 49601 (keeping 200 days of data) [2025-10-03T19:30:07.644967] [DEBUG] [LOCAL ] HUM: Primary data saved (49601 records). [2025-10-03T19:30:07.645114] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-03T19:30:07.645217] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUM took 37.2s. Estimated remaining: 3h 2m 56s. Rate: 7.1 symbols/min [2025-10-03T19:30:07.831632] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:07.831867] [DEBUG] [LOCAL ] HXL: No existing data file found in primary storage. [2025-10-03T19:30:07.831956] [WARN ] [MAIN ] HXL: No existing data found, performing full refresh instead. [2025-10-03T19:30:07.832076] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-03T19:30:07.832118] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-03T19:30:07.832160] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-03T19:30:07.832193] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-03T19:30:07.995405] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-03T19:30:08.223719] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:08.251003] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:30:08.412743] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:30:08.790693] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-03T19:30:09.590727] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-03T19:30:10.030200] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-03T19:30:10.053219] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:30:10.390717] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-03T19:30:11.076120] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-03T19:30:11.190702] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-03T19:30:11.990668] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-03T19:30:12.028917] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:30:12.790718] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-03T19:30:13.136414] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-03T19:30:13.590691] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-03T19:30:13.740202] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-03T19:30:13.872396] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:30:14.390701] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-03T19:30:15.190732] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-03T19:30:15.507320] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-03T19:30:15.990685] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-03T19:30:16.050274] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:30:16.790701] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-03T19:30:16.941214] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:30:17.590742] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-03T19:30:17.934372] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-03T19:30:17.964478] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-03T19:30:18.390724] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-03T19:30:19.122095] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:30:19.190689] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-03T19:30:19.440982] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:30:19.990716] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-03T19:30:20.790634] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-03T19:30:20.978726] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-03T19:30:21.520020] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:30:21.590734] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-03T19:30:22.390695] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-03T19:30:22.746634] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-03T19:30:23.190700] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-03T19:30:23.234124] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T19:30:23.236732] [INFO ] [REMOTE ] HUYA: Full fetch complete (63630 records). [2025-10-03T19:30:23.236874] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-03T19:30:23.374813] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-03T19:30:23.679726] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-03T19:30:23.679852] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-03T19:30:23.680831] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-03T19:30:23.680898] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-03T19:30:23.682896] [DEBUG] [LOCAL ] HUYA: Trimmed 63630 records to 44793 (keeping 200 days of data) [2025-10-03T19:30:23.951619] [DEBUG] [LOCAL ] HUYA: Primary data saved (44793 records). [2025-10-03T19:30:23.951824] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-03T19:30:23.951912] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HUYA took 30.9s. Estimated remaining: 3h 2m 57s. Rate: 7.1 symbols/min [2025-10-03T19:30:23.998208] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-03T19:30:24.144523] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:24.144718] [DEBUG] [LOCAL ] HY: No existing data file found in primary storage. [2025-10-03T19:30:24.144770] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-10-03T19:30:24.144886] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-03T19:30:24.144931] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-03T19:30:24.144975] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-03T19:30:24.145010] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-03T19:30:24.540093] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:24.790630] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-03T19:30:24.905929] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-03T19:30:25.006765] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:30:25.590683] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-03T19:30:26.390640] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-03T19:30:26.795910] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:30:27.187750] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:30:27.197742] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-03T19:30:27.288589] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:30:27.990699] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-03T19:30:28.790633] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-03T19:30:29.060862] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:30:29.561527] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:30:29.590680] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-03T19:30:29.606225] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:30:30.390693] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-03T19:30:31.190620] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-03T19:30:31.294365] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:30:31.580105] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:30:31.581458] [INFO ] [REMOTE ] HVT: Full fetch complete (23368 records). [2025-10-03T19:30:31.581593] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-03T19:30:31.984195] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-03T19:30:31.984275] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-03T19:30:31.984777] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-03T19:30:31.984880] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-03T19:30:31.985554] [DEBUG] [LOCAL ] HVT: Trimmed 23368 records to 15649 (keeping 200 days of data) [2025-10-03T19:30:32.026095] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-03T19:30:32.085406] [DEBUG] [LOCAL ] HVT: Primary data saved (15649 records). [2025-10-03T19:30:32.085559] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-03T19:30:32.085636] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HVT took 27.7s. Estimated remaining: 3h 2m 48s. Rate: 7.1 symbols/min [2025-10-03T19:30:32.258321] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:32.258518] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-03T19:30:32.258557] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-03T19:30:32.258696] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-03T19:30:32.258751] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-03T19:30:32.258797] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-03T19:30:32.258831] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-03T19:30:32.637331] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:32.790699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-03T19:30:33.140878] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-03T19:30:33.290962] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-03T19:30:33.562637] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:30:33.590711] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-03T19:30:34.390718] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-03T19:30:35.190744] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-03T19:30:35.243310] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:30:35.254197] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:30:35.515756] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-03T19:30:35.990706] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-03T19:30:36.790690] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-03T19:30:37.590874] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-03T19:30:37.592628] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:30:37.900460] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-03T19:30:38.041937] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-03T19:30:38.044608] [INFO ] [REMOTE ] HXL: Full fetch complete (66246 records). [2025-10-03T19:30:38.044818] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-03T19:30:38.395822] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-03T19:30:38.469167] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-03T19:30:38.469332] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-03T19:30:38.470336] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-03T19:30:38.470404] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-03T19:30:38.472120] [DEBUG] [LOCAL ] HXL: Trimmed 66246 records to 46561 (keeping 200 days of data) [2025-10-03T19:30:38.747605] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-03T19:30:38.816575] [DEBUG] [LOCAL ] HXL: Primary data saved (46561 records). [2025-10-03T19:30:38.816880] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-03T19:30:38.817043] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HXL took 31.2s. Estimated remaining: 3h 2m 38s. Rate: 7.1 symbols/min [2025-10-03T19:30:38.997246] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:38.997461] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-03T19:30:38.997511] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-03T19:30:38.997622] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-03T19:30:38.997696] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-03T19:30:38.997753] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-03T19:30:38.997800] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-03T19:30:39.192239] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-03T19:30:39.414993] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:39.574138] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-03T19:30:39.990699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-03T19:30:40.345673] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-03T19:30:40.790724] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-03T19:30:41.207915] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-03T19:30:41.590725] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-03T19:30:41.911777] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-03T19:30:42.390682] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-03T19:30:43.190706] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-03T19:30:43.508453] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:30:43.990673] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-03T19:30:44.292606] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-03T19:30:44.427283] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:30:44.790721] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-03T19:30:45.024194] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-03T19:30:45.590673] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-03T19:30:45.836201] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-10-03T19:30:46.390760] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-03T19:30:46.620808] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-03T19:30:47.190708] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-03T19:30:47.440369] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-03T19:30:47.990696] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-03T19:30:48.790726] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-03T19:30:49.136356] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-03T19:30:49.590722] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-03T19:30:50.390679] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-03T19:30:50.538107] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-10-03T19:30:50.538894] [INFO ] [REMOTE ] HYAC: Full fetch complete (899 records). [2025-10-03T19:30:50.538989] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-03T19:30:50.737078] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-10-03T19:30:50.737377] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:30:50.737456] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:30:50.737533] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-03T19:30:50.737609] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-03T19:30:50.737679] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-03T19:30:50.737780] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-03T19:30:50.737877] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HYAC took 18.7s. Estimated remaining: 3h 2m 33s. Rate: 7.1 symbols/min [2025-10-03T19:30:50.924572] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:50.924802] [DEBUG] [LOCAL ] HYI: No existing data file found in primary storage. [2025-10-03T19:30:50.924866] [WARN ] [MAIN ] HYI: No existing data found, performing full refresh instead. [2025-10-03T19:30:50.925007] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-03T19:30:50.925062] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-03T19:30:50.925109] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-03T19:30:50.925143] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-03T19:30:51.192476] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-03T19:30:51.246472] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T19:30:51.334823] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:51.373862] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:30:51.477171] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-03T19:30:51.990711] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-03T19:30:52.790717] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-03T19:30:53.114031] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-03T19:30:53.590678] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-03T19:30:54.323113] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:30:54.390726] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-03T19:30:54.589684] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-03T19:30:54.592469] [INFO ] [REMOTE ] HWM: Full fetch complete (76602 records). [2025-10-03T19:30:54.592639] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-03T19:30:54.688811] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-03T19:30:55.021247] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-03T19:30:55.021368] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-03T19:30:55.022363] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-03T19:30:55.022430] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-03T19:30:55.024119] [DEBUG] [LOCAL ] HWM: Trimmed 76602 records to 53700 (keeping 200 days of data) [2025-10-03T19:30:55.211863] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-03T19:30:55.379227] [DEBUG] [LOCAL ] HWM: Primary data saved (53700 records). [2025-10-03T19:30:55.379378] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-03T19:30:55.379481] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HWM took 49.2s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-03T19:30:55.573736] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:30:55.573971] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-03T19:30:55.574062] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-03T19:30:55.574150] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-03T19:30:55.574199] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-03T19:30:55.574287] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-03T19:30:55.574337] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-03T19:30:55.968066] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:30:55.990619] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-03T19:30:56.072629] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-03T19:30:56.790725] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-03T19:30:57.282871] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:30:57.379099] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T19:30:57.590713] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-03T19:30:58.382412] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:30:58.390702] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-03T19:30:59.191177] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-03T19:30:59.197167] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:30:59.521593] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-03T19:30:59.990707] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-03T19:31:00.790694] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-03T19:31:00.831488] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:31:01.272922] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:31:01.590717] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-03T19:31:02.390727] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-03T19:31:02.897171] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:31:02.898011] [INFO ] [REMOTE ] HYBX: Full fetch complete (737 records). [2025-10-03T19:31:02.898084] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-03T19:31:03.025716] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:31:03.139121] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-10-03T19:31:03.139345] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:31:03.139433] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:31:03.139521] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-03T19:31:03.139605] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-03T19:31:03.139690] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-03T19:31:03.139786] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-03T19:31:03.139954] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HYBX took 24.3s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-03T19:31:03.197627] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-03T19:31:03.332103] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:03.332271] [DEBUG] [LOCAL ] HYTR: No existing data file found in primary storage. [2025-10-03T19:31:03.332359] [WARN ] [MAIN ] HYTR: No existing data found, performing full refresh instead. [2025-10-03T19:31:03.332480] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-03T19:31:03.332538] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-03T19:31:03.332619] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-03T19:31:03.332707] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-03T19:31:03.762861] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:03.990692] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-03T19:31:04.605060] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-03T19:31:04.623853] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:31:04.790639] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-03T19:31:05.590703] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-03T19:31:06.236893] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-03T19:31:06.260226] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:31:06.390721] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-03T19:31:07.129854] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:31:07.190664] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-03T19:31:07.952460] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T19:31:07.990617] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-03T19:31:08.758966] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-03T19:31:08.790690] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-03T19:31:09.523557] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:31:09.590712] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-03T19:31:10.390730] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-03T19:31:10.526888] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T19:31:11.188985] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-03T19:31:11.191993] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-03T19:31:11.765000] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-03T19:31:11.990706] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-03T19:31:12.794264] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-03T19:31:12.797629] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-03T19:31:13.538729] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:31:13.590714] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-03T19:31:14.166468] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-03T19:31:14.390695] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-03T19:31:15.190707] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-03T19:31:15.783463] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:31:15.931335] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:31:15.990716] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-03T19:31:16.712890] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:31:16.790699] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-03T19:31:17.590722] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-03T19:31:18.082181] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T19:31:18.083166] [INFO ] [REMOTE ] HY: Full fetch complete (15135 records). [2025-10-03T19:31:18.083239] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-03T19:31:18.395844] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-03T19:31:18.476857] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-03T19:31:18.476949] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-03T19:31:18.477286] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-03T19:31:18.477328] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-03T19:31:18.477948] [DEBUG] [LOCAL ] HY: Trimmed 15135 records to 10055 (keeping 200 days of data) [2025-10-03T19:31:18.544720] [DEBUG] [LOCAL ] HY: Primary data saved (10055 records). [2025-10-03T19:31:18.544910] [INFO ] [MAIN ] HY: Full history saved. [2025-10-03T19:31:18.545010] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HY took 54.6s. Estimated remaining: 3h 2m 11s. Rate: 7.1 symbols/min [2025-10-03T19:31:18.742263] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:18.742605] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-03T19:31:18.742752] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-03T19:31:18.742913] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-03T19:31:18.742962] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-03T19:31:18.743009] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-03T19:31:18.743044] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-03T19:31:19.046144] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-03T19:31:19.154140] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:31:19.210256] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:19.196376] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-03T19:31:19.678622] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-03T19:31:19.990691] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-03T19:31:20.790669] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-03T19:31:21.067838] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:31:21.317169] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T19:31:21.590692] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-03T19:31:22.390637] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-03T19:31:22.703791] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-03T19:31:23.190686] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-03T19:31:23.781162] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:31:23.954533] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-03T19:31:23.990678] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-03T19:31:24.790694] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-03T19:31:25.349816] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T19:31:25.590631] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-03T19:31:25.897447] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:31:26.090757] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-03T19:31:26.390711] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-03T19:31:26.951465] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-03T19:31:27.190723] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-03T19:31:27.930944] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T19:31:27.990684] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-03T19:31:28.790683] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-03T19:31:28.834073] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:31:28.835601] [INFO ] [REMOTE ] HYI: Full fetch complete (13863 records). [2025-10-03T19:31:28.835701] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-03T19:31:29.254499] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-03T19:31:29.254579] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-03T19:31:29.254944] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-03T19:31:29.255008] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-03T19:31:29.255593] [DEBUG] [LOCAL ] HYI: Trimmed 13863 records to 9955 (keeping 200 days of data) [2025-10-03T19:31:29.334824] [DEBUG] [LOCAL ] HYI: Primary data saved (9955 records). [2025-10-03T19:31:29.335105] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-03T19:31:29.335287] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYI took 38.6s. Estimated remaining: 3h 2m 5s. Rate: 7.1 symbols/min [2025-10-03T19:31:29.526577] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:29.526822] [DEBUG] [LOCAL ] IAE: No existing data file found in primary storage. [2025-10-03T19:31:29.526881] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-10-03T19:31:29.526995] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-03T19:31:29.527065] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-03T19:31:29.527126] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-03T19:31:29.527162] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-03T19:31:29.603826] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:31:29.603663] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-03T19:31:29.614845] [INFO ] [REMOTE ] HYTR: Full fetch complete (4556 records). [2025-10-03T19:31:29.620315] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-03T19:31:30.279370] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:30.348377] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-03T19:31:30.348455] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-03T19:31:30.348622] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-03T19:31:30.348730] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-03T19:31:30.349171] [DEBUG] [LOCAL ] HYTR: Trimmed 4556 records to 3216 (keeping 200 days of data) [2025-10-03T19:31:30.370770] [DEBUG] [LOCAL ] HYTR: Primary data saved (3216 records). [2025-10-03T19:31:30.370853] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-03T19:31:30.370936] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYTR took 27.2s. Estimated remaining: 3h 1m 48s. Rate: 7.1 symbols/min [2025-10-03T19:31:30.390679] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-03T19:31:30.983144] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:31:31.190725] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-03T19:31:31.952540] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:31:31.990707] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-03T19:31:32.579305] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:31:32.683341] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:31:32.790741] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-03T19:31:33.590705] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-03T19:31:34.130131] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:31:34.154864] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:31:34.390713] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-03T19:31:35.190726] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-03T19:31:35.800598] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:31:35.803488] [INFO ] [REMOTE ] HYT: Full fetch complete (47669 records). [2025-10-03T19:31:35.803629] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-03T19:31:35.937718] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-03T19:31:35.993516] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-03T19:31:36.242140] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-03T19:31:36.242225] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-03T19:31:36.243009] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-03T19:31:36.243098] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-03T19:31:36.244182] [DEBUG] [LOCAL ] HYT: Trimmed 47669 records to 34152 (keeping 200 days of data) [2025-10-03T19:31:36.460619] [DEBUG] [LOCAL ] HYT: Primary data saved (34152 records). [2025-10-03T19:31:36.460809] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-03T19:31:36.460900] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 41.1s. Estimated remaining: 3h 1m 37s. Rate: 7.1 symbols/min [2025-10-03T19:31:36.779792] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-03T19:31:36.790626] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-03T19:31:37.392119] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-03T19:31:37.590716] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-03T19:31:38.390673] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-03T19:31:38.421503] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-03T19:31:39.053703] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T19:31:39.190719] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-03T19:31:39.856387] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:31:39.990715] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-03T19:31:40.639116] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-03T19:31:40.790714] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-03T19:31:41.590744] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-03T19:31:42.066382] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:31:42.167985] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-03T19:31:42.390749] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-03T19:31:43.126549] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-03T19:31:43.190724] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-03T19:31:43.990737] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-03T19:31:45.244944] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T19:31:45.255797] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-03T19:31:46.410896] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-03T19:31:46.417185] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-03T19:31:46.639754] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-03T19:31:46.640775] [INFO ] [REMOTE ] IAE: Full fetch complete (8653 records). [2025-10-03T19:31:46.640851] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-03T19:31:47.048988] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-03T19:31:47.049118] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-03T19:31:47.049419] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-03T19:31:47.049505] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-03T19:31:47.050100] [DEBUG] [LOCAL ] IAE: Trimmed 8653 records to 6116 (keeping 200 days of data) [2025-10-03T19:31:47.102586] [DEBUG] [LOCAL ] IAE: Primary data saved (6116 records). [2025-10-03T19:31:47.102785] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-03T19:31:47.102927] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. IAE took 17.8s. Estimated remaining: 3h 1m 31s. Rate: 7.1 symbols/min [2025-10-03T19:31:47.400042] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-03T19:31:47.407418] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-03T19:31:50.961705] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (3.55 seconds). [2025-10-03T19:31:50.964019] [INFO ] [REMOTE ] HZO: Full fetch complete (41069 records). [2025-10-03T19:31:50.964139] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-03T19:31:51.376695] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-03T19:31:51.376862] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-03T19:31:51.377701] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-03T19:31:51.377777] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-03T19:31:51.378993] [DEBUG] [LOCAL ] HZO: Trimmed 41069 records to 29526 (keeping 200 days of data) [2025-10-03T19:31:51.561199] [DEBUG] [LOCAL ] HZO: Primary data saved (29526 records). [2025-10-03T19:31:51.561360] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-03T19:31:51.561497] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. HZO took 33.0s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-03T19:31:52.297713] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.350496] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.364399] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.384778] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:31:52.423721] [DEBUG] [LOCAL ] IBP: Loaded 29050 existing records from primary storage. [2025-10-03T19:31:52.424493] [INFO ] [MAIN ] IBP: Loaded 29050 existing records. [2025-10-03T19:31:52.643870] [DEBUG] [LOCAL ] IAG: Loaded 53844 existing records from primary storage. [2025-10-03T19:31:52.660969] [DEBUG] [LOCAL ] IBM: Loaded 54023 existing records from primary storage. [2025-10-03T19:31:52.661576] [INFO ] [MAIN ] IAG: Loaded 53844 existing records. [2025-10-03T19:31:52.662194] [INFO ] [MAIN ] IBM: Loaded 54023 existing records. [2025-10-03T19:31:52.902703] [DEBUG] [LOCAL ] IBN: Loaded 53259 existing records from primary storage. [2025-10-03T19:31:52.984453] [INFO ] [MAIN ] IBN: Loaded 53259 existing records. [2025-10-03T19:31:52.984180] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.109871] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.164404] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-03T19:31:53.275664] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.305499] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.315100] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-03T19:31:53.291261] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-03T19:31:53.317516] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-03T19:31:53.334717] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-03T19:31:53.362382] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-03T19:31:53.379258] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.468535] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.476638] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-03T19:31:53.553013] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:31:53.562889] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-03T19:31:53.609268] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-03T19:31:53.642469] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-03T19:31:53.677677] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-03T19:31:53.726315] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-03T19:31:53.778589] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-03T19:31:54.845878] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:54.900718] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-03T19:31:54.955133] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.002194] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.053399] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-03T19:31:55.053134] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-03T19:31:55.080580] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:31:55.081933] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-03T19:31:56.302043] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:31:56.311137] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-03T19:31:56.743497] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:31:56.755434] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-03T19:31:56.939397] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-03T19:31:56.951258] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-03T19:31:57.421058] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-10-03T19:31:57.433493] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-03T19:31:57.449498] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-03T19:31:57.455435] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-03T19:31:58.220070] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T19:31:58.232005] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-03T19:31:58.621301] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:31:58.628064] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-03T19:31:58.676304] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:31:58.692630] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-03T19:31:59.644426] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-03T19:31:59.657124] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-03T19:31:59.879482] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:31:59.886726] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-03T19:31:59.960667] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T19:31:59.972673] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-03T19:32:00.086253] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:32:00.097610] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-03T19:32:01.275772] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:32:01.283815] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-03T19:32:01.385280] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-03T19:32:01.396464] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-03T19:32:01.711455] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:32:01.723389] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-03T19:32:01.986428] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-03T19:32:02.166774] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-03T19:32:02.390696] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-03T19:32:03.190720] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-03T19:32:03.605248] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:32:03.651449] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-03T19:32:03.990691] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-03T19:32:04.143414] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-03T19:32:04.432085] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-03T19:32:04.790738] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-03T19:32:05.590743] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-03T19:32:06.241379] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T19:32:06.390639] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-03T19:32:06.668069] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-03T19:32:07.190741] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-03T19:32:07.437704] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:32:07.990745] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-03T19:32:08.381431] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-03T19:32:08.790720] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-03T19:32:08.950616] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:32:09.440827] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:32:09.590718] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-03T19:32:10.390693] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-03T19:32:10.961240] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-03T19:32:11.190638] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-03T19:32:11.481704] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:32:11.635719] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-03T19:32:11.990722] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-03T19:32:12.790704] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-03T19:32:13.590738] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-03T19:32:13.673104] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-03T19:32:13.807552] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-03T19:32:14.154015] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:32:14.390761] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-03T19:32:15.190701] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-03T19:32:15.439412] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:32:15.990689] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-03T19:32:16.146283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:32:16.790708] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-03T19:32:17.548050] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-03T19:32:17.590757] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-03T19:32:17.823453] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:32:18.390679] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-03T19:32:18.622664] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:32:18.801789] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:32:19.190691] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-03T19:32:19.990696] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-03T19:32:20.566752] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-03T19:32:20.569417] [INFO ] [REMOTE ] IAG: Full fetch complete (77261 records). [2025-10-03T19:32:20.569569] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-03T19:32:20.798610] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-03T19:32:20.932940] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-03T19:32:20.957492] [INFO ] [REMOTE ] IBN: Full fetch complete (76321 records). [2025-10-03T19:32:20.983043] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-03T19:32:21.116745] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-03T19:32:21.135341] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-03T19:32:21.143563] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-03T19:32:21.143682] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-03T19:32:21.199745] [DEBUG] [LOCAL ] IAG: Trimmed 77261 records to 54232 (keeping 200 days of data) [2025-10-03T19:32:21.668532] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-03T19:32:21.669332] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-03T19:32:21.671075] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-03T19:32:21.671867] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-03T19:32:21.677540] [DEBUG] [LOCAL ] IBN: Trimmed 76321 records to 53644 (keeping 200 days of data) [2025-10-03T19:32:22.166161] [DEBUG] [LOCAL ] IAG: Primary data saved (54232 records). [2025-10-03T19:32:22.166579] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-03T19:32:22.167801] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IAG took 30.6s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-03T19:32:22.451105] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:22.464258] [DEBUG] [LOCAL ] IBN: Primary data saved (53644 records). [2025-10-03T19:32:22.464563] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-03T19:32:22.464813] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IBN took 30.9s. Estimated remaining: 3h 1m 18s. Rate: 7.1 symbols/min [2025-10-03T19:32:22.665680] [DEBUG] [LOCAL ] IBTA: Loaded 37847 existing records from primary storage. [2025-10-03T19:32:22.684523] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:22.685450] [INFO ] [MAIN ] IBTA: Loaded 37847 existing records. [2025-10-03T19:32:22.818811] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-10-03T19:32:22.879059] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-03T19:32:22.948791] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:22.950394] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-03T19:32:22.950458] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-03T19:32:22.965466] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-03T19:32:22.965790] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-03T19:32:23.109988] [DEBUG] [LOCAL ] ICE: Loaded 53392 existing records from primary storage. [2025-10-03T19:32:23.121634] [INFO ] [MAIN ] ICE: Loaded 53392 existing records. [2025-10-03T19:32:23.563882] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:23.583961] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-03T19:32:23.584052] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-03T19:32:23.618576] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-03T19:32:23.618701] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-03T19:32:23.631098] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:23.672505] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-03T19:32:24.022265] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:24.022612] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-03T19:32:25.059976] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-03T19:32:25.061457] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-03T19:32:25.069934] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-03T19:32:25.072053] [INFO ] [REMOTE ] IBP: Full fetch complete (40991 records). [2025-10-03T19:32:25.072157] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-03T19:32:25.073587] [FATAL] [VALIDATOR ] IBP: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T19:32:25.073711] [FATAL] [MAIN ] IBP: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:32:25.073791] [WARN ] [MAIN ] IBP: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:32:25.073909] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-03T19:32:25.074012] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-03T19:32:25.074073] [INFO ] [LOCAL ] IBP: Starting deletion of derivative data. [2025-10-03T19:32:25.074442] [DEBUG] [LOCAL ] IBP: Deleted derivative data file. [2025-10-03T19:32:25.077434] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IBP took 33.5s. Estimated remaining: 3h 1m 2s. Rate: 7.1 symbols/min [2025-10-03T19:32:25.268996] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:25.322417] [DEBUG] [LOCAL ] ICL: Loaded 38682 existing records from primary storage. [2025-10-03T19:32:25.322792] [INFO ] [MAIN ] ICL: Loaded 38682 existing records. [2025-10-03T19:32:25.527605] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:25.527862] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-03T19:32:25.527914] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-03T19:32:25.529056] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-03T19:32:25.529120] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-03T19:32:25.948714] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:25.955454] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-03T19:32:25.956671] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (3.08 seconds). [2025-10-03T19:32:25.992555] [INFO ] [REMOTE ] IBM: Full fetch complete (77621 records). [2025-10-03T19:32:25.994933] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-03T19:32:25.994785] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-03T19:32:26.043876] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-03T19:32:26.426181] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:32:26.493977] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-03T19:32:26.493745] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-03T19:32:26.494195] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-03T19:32:26.496266] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-03T19:32:26.496475] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-03T19:32:26.498945] [DEBUG] [LOCAL ] IBM: Trimmed 77621 records to 54412 (keeping 200 days of data) [2025-10-03T19:32:26.869409] [DEBUG] [LOCAL ] IBM: Primary data saved (54412 records). [2025-10-03T19:32:26.869569] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-03T19:32:26.869697] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 35.3s. Estimated remaining: 3h 0m 46s. Rate: 7.1 symbols/min [2025-10-03T19:32:27.059132] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:27.100539] [DEBUG] [LOCAL ] IDA: Loaded 32394 existing records from primary storage. [2025-10-03T19:32:27.100888] [INFO ] [MAIN ] IDA: Loaded 32394 existing records. [2025-10-03T19:32:27.332393] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:27.333850] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-03T19:32:27.334557] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-03T19:32:27.336305] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-03T19:32:27.344791] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-03T19:32:27.345580] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-03T19:32:27.345828] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-03T19:32:27.761984] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:27.778408] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:32:27.814065] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-03T19:32:27.990741] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-03T19:32:28.790637] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-03T19:32:28.897073] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:32:29.590691] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-03T19:32:29.748729] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-03T19:32:30.023460] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:32:30.390734] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-03T19:32:30.942096] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:32:31.190702] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-03T19:32:31.872589] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:32:31.990710] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-03T19:32:32.598440] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:32:32.790739] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-03T19:32:33.604154] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-03T19:32:33.629664] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:32:34.390633] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-03T19:32:34.709091] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-03T19:32:34.789768] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:32:35.190737] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-03T19:32:35.561795] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T19:32:35.990742] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-03T19:32:36.039243] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-03T19:32:36.790748] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-03T19:32:37.379142] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:32:37.590693] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-03T19:32:37.909691] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-03T19:32:38.390710] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-03T19:32:38.893059] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:32:39.190704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-03T19:32:39.990636] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-03T19:32:40.255085] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:32:40.702322] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:32:40.790728] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-03T19:32:41.438296] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:32:41.590716] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-03T19:32:42.390706] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-03T19:32:42.535857] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-03T19:32:42.608935] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-03T19:32:43.190664] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-03T19:32:43.609834] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-03T19:32:43.990709] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-03T19:32:44.790639] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-03T19:32:45.134394] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-03T19:32:45.595749] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-03T19:32:45.614093] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:32:46.245065] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:32:46.390664] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-03T19:32:47.155981] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-03T19:32:47.190718] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-03T19:32:47.528120] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:32:47.990712] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-03T19:32:48.480541] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T19:32:48.790720] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-03T19:32:49.370896] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:32:49.590729] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-03T19:32:50.390702] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-03T19:32:50.661289] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:32:50.691637] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-03T19:32:51.190742] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-03T19:32:51.554953] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:32:51.990734] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-03T19:32:52.110498] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-03T19:32:52.112561] [INFO ] [REMOTE ] IDA: Full fetch complete (44872 records). [2025-10-03T19:32:52.112771] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-03T19:32:52.529063] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-03T19:32:52.529153] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-03T19:32:52.529963] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-03T19:32:52.530030] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-03T19:32:52.531210] [DEBUG] [LOCAL ] IDA: Trimmed 44872 records to 32618 (keeping 200 days of data) [2025-10-03T19:32:52.748857] [DEBUG] [LOCAL ] IDA: Primary data saved (32618 records). [2025-10-03T19:32:52.748999] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-03T19:32:52.749097] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IDA took 25.9s. Estimated remaining: 3h 0m 58s. Rate: 7.1 symbols/min [2025-10-03T19:32:52.795791] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-03T19:32:52.939268] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:52.951100] [DEBUG] [LOCAL ] IDE: Loaded 8807 existing records from primary storage. [2025-10-03T19:32:52.951332] [INFO ] [MAIN ] IDE: Loaded 8807 existing records. [2025-10-03T19:32:53.148890] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:53.149134] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-03T19:32:53.149187] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-03T19:32:53.149448] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-03T19:32:53.149511] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-03T19:32:53.621701] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:53.591564] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-03T19:32:53.625442] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-03T19:32:54.390677] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-03T19:32:54.782946] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:32:55.110284] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:32:55.190696] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-03T19:32:55.661911] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T19:32:55.663955] [INFO ] [REMOTE ] IBTA: Full fetch complete (50883 records). [2025-10-03T19:32:55.664062] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-03T19:32:55.995875] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-03T19:32:56.089895] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-03T19:32:56.089998] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-03T19:32:56.090871] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-03T19:32:56.090941] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-03T19:32:56.092147] [DEBUG] [LOCAL ] IBTA: Trimmed 50883 records to 38108 (keeping 200 days of data) [2025-10-03T19:32:56.324793] [DEBUG] [LOCAL ] IBTA: Primary data saved (38108 records). [2025-10-03T19:32:56.324972] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-03T19:32:56.325099] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. IBTA took 34.2s. Estimated remaining: 3h 0m 44s. Rate: 7.1 symbols/min [2025-10-03T19:32:56.521786] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:56.544960] [DEBUG] [LOCAL ] IDT: Loaded 18168 existing records from primary storage. [2025-10-03T19:32:56.545258] [INFO ] [MAIN ] IDT: Loaded 18168 existing records. [2025-10-03T19:32:56.760975] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:56.761269] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-03T19:32:56.761416] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-03T19:32:56.766741] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-03T19:32:56.767366] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-03T19:32:56.767606] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:32:56.796710] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-03T19:32:56.864968] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-03T19:32:56.891295] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-03T19:32:57.579838] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:57.612174] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-03T19:32:57.710058] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-03T19:32:57.723616] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:32:57.721484] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-03T19:32:57.735275] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-03T19:32:57.725121] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:32:57.736782] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-03T19:32:57.742779] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53782 (keeping 200 days of data) [2025-10-03T19:32:58.113331] [DEBUG] [LOCAL ] ICE: Primary data saved (53782 records). [2025-10-03T19:32:58.113486] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-03T19:32:58.113573] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICE took 35.6s. Estimated remaining: 3h 0m 28s. Rate: 7.1 symbols/min [2025-10-03T19:32:58.298016] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:32:58.343058] [DEBUG] [LOCAL ] IEX: Loaded 38652 existing records from primary storage. [2025-10-03T19:32:58.343389] [INFO ] [MAIN ] IEX: Loaded 38652 existing records. [2025-10-03T19:32:58.395841] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-03T19:32:58.565934] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:32:58.571687] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-03T19:32:58.571838] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-03T19:32:58.578759] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-03T19:32:58.579465] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-03T19:32:58.579392] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:32:58.984552] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:32:59.190700] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-03T19:32:59.222198] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:32:59.990735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-03T19:33:00.079294] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-03T19:33:00.790736] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-03T19:33:01.294403] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:33:01.296717] [INFO ] [REMOTE ] ICL: Full fetch complete (55966 records). [2025-10-03T19:33:01.296893] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-03T19:33:01.602107] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-03T19:33:01.623584] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-03T19:33:01.748295] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-03T19:33:01.748394] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-03T19:33:01.749317] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-03T19:33:01.749406] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-03T19:33:01.750745] [DEBUG] [LOCAL ] ICL: Trimmed 55966 records to 38938 (keeping 200 days of data) [2025-10-03T19:33:01.981742] [DEBUG] [LOCAL ] ICL: Primary data saved (38938 records). [2025-10-03T19:33:01.981900] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-03T19:33:01.982504] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. ICL took 36.9s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-03T19:33:02.199037] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:02.257084] [DEBUG] [LOCAL ] IFF: Loaded 51357 existing records from primary storage. [2025-10-03T19:33:02.257438] [INFO ] [MAIN ] IFF: Loaded 51357 existing records. [2025-10-03T19:33:02.395794] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-03T19:33:02.452981] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:02.460133] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-03T19:33:02.460230] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-03T19:33:02.461156] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-03T19:33:02.461214] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-03T19:33:02.463509] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-03T19:33:02.855251] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:03.190702] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-03T19:33:03.879921] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-03T19:33:03.990734] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-03T19:33:04.691109] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-03T19:33:04.766578] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:33:04.790621] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-03T19:33:05.590702] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-03T19:33:06.390715] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-03T19:33:06.870538] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-03T19:33:07.006918] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:33:07.190639] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-03T19:33:07.418908] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:33:07.990705] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-03T19:33:08.704097] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:33:08.715067] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-03T19:33:08.790691] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-03T19:33:09.590693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-03T19:33:10.239986] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:33:10.352377] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-03T19:33:10.390691] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-03T19:33:11.190686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-03T19:33:11.889971] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-03T19:33:11.990686] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-03T19:33:12.129908] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-03T19:33:12.722004] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-03T19:33:12.790678] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-03T19:33:13.590687] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-03T19:33:13.632082] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-03T19:33:14.390669] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-03T19:33:14.615091] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-03T19:33:15.190684] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-03T19:33:15.218565] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-03T19:33:15.990705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-03T19:33:16.790700] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-03T19:33:17.085257] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:33:17.590719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-03T19:33:17.694516] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:33:17.695691] [INFO ] [REMOTE ] IDE: Full fetch complete (12579 records). [2025-10-03T19:33:17.695775] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-03T19:33:17.886268] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:33:18.143694] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-03T19:33:18.143782] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-03T19:33:18.144123] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-03T19:33:18.144187] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-03T19:33:18.144750] [DEBUG] [LOCAL ] IDE: Trimmed 12579 records to 8867 (keeping 200 days of data) [2025-10-03T19:33:18.202456] [DEBUG] [LOCAL ] IDE: Primary data saved (8867 records). [2025-10-03T19:33:18.202594] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-03T19:33:18.202727] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDE took 25.5s. Estimated remaining: 3h 0m 15s. Rate: 7.1 symbols/min [2025-10-03T19:33:18.384297] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:18.390672] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-03T19:33:18.406469] [DEBUG] [LOCAL ] IFN: Loaded 18372 existing records from primary storage. [2025-10-03T19:33:18.406801] [INFO ] [MAIN ] IFN: Loaded 18372 existing records. [2025-10-03T19:33:18.634916] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:18.636799] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:33:18.635937] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-03T19:33:18.642046] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-03T19:33:18.642776] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-03T19:33:18.642871] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-03T19:33:19.052165] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:19.190694] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-03T19:33:19.823300] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:33:19.923530] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-03T19:33:19.990688] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-03T19:33:20.790709] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-03T19:33:21.167272] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-03T19:33:21.590721] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-03T19:33:22.321205] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:33:22.390726] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-03T19:33:22.967392] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:33:23.190701] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-03T19:33:23.784963] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-03T19:33:23.990640] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-03T19:33:24.229098] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:33:24.790635] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-03T19:33:25.176218] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:33:25.590751] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-03T19:33:26.084079] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:33:26.390704] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-03T19:33:26.690019] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-03T19:33:27.190693] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-03T19:33:27.891861] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:33:27.990628] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-03T19:33:28.337972] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:33:28.790718] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-03T19:33:29.478052] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:33:29.590881] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-03T19:33:29.836883] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:33:30.390728] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-03T19:33:31.190625] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-03T19:33:31.284196] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-03T19:33:31.316779] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:33:31.990686] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-03T19:33:32.500558] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-03T19:33:32.502723] [INFO ] [REMOTE ] IEX: Full fetch complete (53536 records). [2025-10-03T19:33:32.502879] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-03T19:33:32.796015] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-03T19:33:32.962490] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-03T19:33:32.962667] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-03T19:33:32.963679] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-03T19:33:32.963751] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-03T19:33:32.964989] [DEBUG] [LOCAL ] IEX: Trimmed 53536 records to 38871 (keeping 200 days of data) [2025-10-03T19:33:33.093349] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-03T19:33:33.254562] [DEBUG] [LOCAL ] IEX: Primary data saved (38871 records). [2025-10-03T19:33:33.254752] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-03T19:33:33.254865] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IEX took 35.1s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-10-03T19:33:33.435219] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:33.457779] [DEBUG] [LOCAL ] IFS: Loaded 23264 existing records from primary storage. [2025-10-03T19:33:33.458056] [INFO ] [MAIN ] IFS: Loaded 23264 existing records. [2025-10-03T19:33:33.604905] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-03T19:33:33.650796] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:33.651098] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-03T19:33:33.651153] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-03T19:33:33.651431] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-03T19:33:33.651491] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-03T19:33:34.056367] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:34.320566] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:33:34.390700] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-03T19:33:34.818153] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:33:35.190679] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-03T19:33:35.344029] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T19:33:35.990698] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-03T19:33:36.292901] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:33:36.790630] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-03T19:33:36.933850] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:33:37.590637] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-03T19:33:37.738144] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-03T19:33:38.390723] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-03T19:33:38.737043] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:33:39.190707] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-03T19:33:39.990684] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-03T19:33:40.097850] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-03T19:33:40.268144] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:33:40.790721] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-03T19:33:40.833663] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:33:40.835134] [INFO ] [REMOTE ] IFN: Full fetch complete (29183 records). [2025-10-03T19:33:40.835209] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-03T19:33:41.256336] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-03T19:33:41.256420] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-03T19:33:41.257089] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-03T19:33:41.257156] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-03T19:33:41.258019] [DEBUG] [LOCAL ] IFN: Trimmed 29183 records to 18598 (keeping 200 days of data) [2025-10-03T19:33:41.375549] [DEBUG] [LOCAL ] IFN: Primary data saved (18598 records). [2025-10-03T19:33:41.375743] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-03T19:33:41.375844] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IFN took 23.2s. Estimated remaining: 3h 0m 5s. Rate: 7.1 symbols/min [2025-10-03T19:33:41.572277] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:41.584078] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:33:41.590610] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-03T19:33:41.599899] [DEBUG] [LOCAL ] IGA: Loaded 9918 existing records from primary storage. [2025-10-03T19:33:41.600444] [INFO ] [MAIN ] IGA: Loaded 9918 existing records. [2025-10-03T19:33:41.814262] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:41.814547] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-03T19:33:41.814608] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-03T19:33:41.814857] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-03T19:33:41.814915] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-03T19:33:42.229108] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:42.390731] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-03T19:33:42.644720] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:33:42.868464] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-03T19:33:43.190710] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-03T19:33:43.990727] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-03T19:33:44.784522] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:33:44.790690] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-03T19:33:44.878731] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:33:45.590751] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-03T19:33:46.064521] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-03T19:33:46.390729] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-03T19:33:46.869004] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-03T19:33:46.871201] [INFO ] [REMOTE ] IDT: Full fetch complete (23101 records). [2025-10-03T19:33:46.871370] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-03T19:33:47.197450] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-03T19:33:47.303441] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-03T19:33:47.303528] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-03T19:33:47.304123] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-03T19:33:47.304190] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-03T19:33:47.305154] [DEBUG] [LOCAL ] IDT: Trimmed 23101 records to 18332 (keeping 200 days of data) [2025-10-03T19:33:47.426465] [DEBUG] [LOCAL ] IDT: Primary data saved (18332 records). [2025-10-03T19:33:47.426668] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-03T19:33:47.426814] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IDT took 51.1s. Estimated remaining: 2h 59m 54s. Rate: 7.1 symbols/min [2025-10-03T19:33:47.631477] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:47.653985] [DEBUG] [LOCAL ] IGD: Loaded 19256 existing records from primary storage. [2025-10-03T19:33:47.654260] [INFO ] [MAIN ] IGD: Loaded 19256 existing records. [2025-10-03T19:33:47.866353] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:47.866611] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-03T19:33:47.866701] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-03T19:33:47.867361] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-03T19:33:47.867453] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-03T19:33:47.995742] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-03T19:33:48.197150] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:33:48.305342] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:48.311903] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-03T19:33:48.314840] [INFO ] [REMOTE ] IFF: Full fetch complete (73067 records). [2025-10-03T19:33:48.315022] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-03T19:33:48.748796] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-03T19:33:48.748915] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-03T19:33:48.749897] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-03T19:33:48.749966] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-03T19:33:48.751539] [DEBUG] [LOCAL ] IFF: Trimmed 73067 records to 51736 (keeping 200 days of data) [2025-10-03T19:33:48.813195] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-03T19:33:49.113121] [DEBUG] [LOCAL ] IFF: Primary data saved (51736 records). [2025-10-03T19:33:49.113325] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-03T19:33:49.115242] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFF took 47.1s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-03T19:33:49.303096] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:33:49.347160] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:33:49.355826] [DEBUG] [LOCAL ] IGI: Loaded 3658 existing records from primary storage. [2025-10-03T19:33:49.356115] [INFO ] [MAIN ] IGI: Loaded 3658 existing records. [2025-10-03T19:33:49.563000] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:33:49.563211] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-03T19:33:49.563260] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-03T19:33:49.563477] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-03T19:33:49.563554] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-03T19:33:49.600068] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-03T19:33:50.005402] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:33:50.232942] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:33:50.381219] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-03T19:33:50.390664] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-03T19:33:51.048827] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-03T19:33:51.190695] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-03T19:33:51.990711] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-03T19:33:52.411498] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:33:52.782603] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:33:52.790672] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-03T19:33:53.558497] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T19:33:53.590729] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-03T19:33:54.390677] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-03T19:33:54.682425] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-03T19:33:55.110498] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:33:55.190676] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-03T19:33:55.990732] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-03T19:33:56.026264] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:33:56.790699] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-03T19:33:57.040409] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:33:57.527837] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-03T19:33:57.590632] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-03T19:33:58.355950] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:33:58.390621] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-03T19:33:58.852379] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-03T19:33:59.190703] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-03T19:33:59.721887] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T19:33:59.990667] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-03T19:34:00.790688] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-03T19:34:01.374608] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:34:01.590718] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-03T19:34:01.786004] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:34:02.390698] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-03T19:34:02.705253] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:34:03.190667] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-03T19:34:03.497507] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:34:03.938736] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:34:03.939875] [INFO ] [REMOTE ] IGA: Full fetch complete (13785 records). [2025-10-03T19:34:03.939988] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-03T19:34:03.998178] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-03T19:34:04.344094] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-03T19:34:04.344220] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-03T19:34:04.345349] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-03T19:34:04.345462] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-03T19:34:04.347905] [DEBUG] [LOCAL ] IGA: Trimmed 13785 records to 10018 (keeping 200 days of data) [2025-10-03T19:34:04.430592] [DEBUG] [LOCAL ] IGA: Primary data saved (10018 records). [2025-10-03T19:34:04.430848] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-03T19:34:04.431044] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IGA took 23.1s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-03T19:34:04.629570] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:04.671493] [DEBUG] [LOCAL ] IGR: Loaded 30686 existing records from primary storage. [2025-10-03T19:34:04.671932] [INFO ] [MAIN ] IGR: Loaded 30686 existing records. [2025-10-03T19:34:04.795873] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-03T19:34:04.858255] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:04.858817] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-03T19:34:04.858877] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-03T19:34:04.859187] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-03T19:34:04.859248] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-03T19:34:05.216045] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:05.285952] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-03T19:34:05.590699] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-03T19:34:05.778069] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:34:05.780982] [INFO ] [REMOTE ] IFS: Full fetch complete (31759 records). [2025-10-03T19:34:05.781081] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-03T19:34:06.195718] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-03T19:34:06.195816] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-03T19:34:06.196461] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-03T19:34:06.196504] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-03T19:34:06.198172] [DEBUG] [LOCAL ] IFS: Trimmed 31759 records to 23414 (keeping 200 days of data) [2025-10-03T19:34:06.344274] [DEBUG] [LOCAL ] IFS: Primary data saved (23414 records). [2025-10-03T19:34:06.344423] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-03T19:34:06.344525] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IFS took 33.1s. Estimated remaining: 2h 59m 21s. Rate: 7.1 symbols/min [2025-10-03T19:34:06.402268] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-03T19:34:06.530480] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:06.537254] [DEBUG] [LOCAL ] IH: Loaded 3128 existing records from primary storage. [2025-10-03T19:34:06.537426] [INFO ] [MAIN ] IH: Loaded 3128 existing records. [2025-10-03T19:34:06.685748] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T19:34:06.753873] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:06.754210] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-03T19:34:06.754271] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-03T19:34:06.754475] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-03T19:34:06.754543] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-03T19:34:07.140291] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:07.190751] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-03T19:34:07.931103] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-03T19:34:07.990610] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-03T19:34:08.121961] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-03T19:34:08.790714] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-03T19:34:08.830756] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:34:09.480150] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-03T19:34:09.590691] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-03T19:34:10.390749] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-03T19:34:10.952301] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-03T19:34:11.022315] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:34:11.190708] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-03T19:34:11.679029] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-03T19:34:11.990621] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-03T19:34:12.473637] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T19:34:12.790718] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-03T19:34:13.234112] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:34:13.590721] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-03T19:34:14.116693] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-03T19:34:14.390682] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-03T19:34:15.190715] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-03T19:34:15.726635] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-03T19:34:15.846636] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:34:15.990720] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-03T19:34:16.790786] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-03T19:34:17.287860] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-03T19:34:17.416048] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:34:17.590696] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-03T19:34:18.322086] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:34:18.390676] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-03T19:34:18.848967] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:34:19.190737] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-03T19:34:19.634666] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T19:34:19.990738] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-03T19:34:20.410781] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-03T19:34:20.790787] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-03T19:34:21.590638] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-03T19:34:21.645183] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:34:22.390716] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-03T19:34:22.438268] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:34:22.989415] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:34:23.190736] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-03T19:34:23.990695] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-03T19:34:24.188339] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:34:24.559768] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:34:24.790714] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-03T19:34:25.590778] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-03T19:34:25.802692] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-03T19:34:26.390779] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-03T19:34:26.868970] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T19:34:27.190682] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-03T19:34:27.272898] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:34:27.276257] [INFO ] [REMOTE ] IGD: Full fetch complete (29773 records). [2025-10-03T19:34:27.276419] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-03T19:34:27.691686] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-03T19:34:27.691791] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-03T19:34:27.692526] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-03T19:34:27.692595] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-03T19:34:27.693523] [DEBUG] [LOCAL ] IGD: Trimmed 29773 records to 19385 (keeping 200 days of data) [2025-10-03T19:34:27.790462] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-03T19:34:27.792940] [INFO ] [REMOTE ] IGI: Full fetch complete (5269 records). [2025-10-03T19:34:27.793407] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-03T19:34:27.992727] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-03T19:34:28.242105] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-03T19:34:28.243305] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-03T19:34:28.243686] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-03T19:34:28.244030] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-03T19:34:28.245914] [DEBUG] [LOCAL ] IGI: Trimmed 5269 records to 3706 (keeping 200 days of data) [2025-10-03T19:34:28.273087] [DEBUG] [LOCAL ] IGI: Primary data saved (3706 records). [2025-10-03T19:34:28.274130] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-03T19:34:28.274858] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IGI took 39.2s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-03T19:34:28.369296] [DEBUG] [LOCAL ] IGD: Primary data saved (19385 records). [2025-10-03T19:34:28.385988] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-03T19:34:28.386204] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGD took 41.0s. Estimated remaining: 2h 59m 10s. Rate: 7.1 symbols/min [2025-10-03T19:34:28.531905] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:28.559489] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:34:28.659413] [DEBUG] [LOCAL ] IHD: Loaded 6998 existing records from primary storage. [2025-10-03T19:34:28.658969] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:28.659729] [INFO ] [MAIN ] IHD: Loaded 6998 existing records. [2025-10-03T19:34:28.794253] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-03T19:34:28.853601] [DEBUG] [LOCAL ] IHG: Loaded 24606 existing records from primary storage. [2025-10-03T19:34:28.882835] [INFO ] [MAIN ] IHG: Loaded 24606 existing records. [2025-10-03T19:34:29.007956] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:29.040010] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-03T19:34:29.049505] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-03T19:34:29.072079] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-03T19:34:29.083122] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-03T19:34:29.282443] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:29.307236] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-03T19:34:29.307405] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-03T19:34:29.307801] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-03T19:34:29.309921] [INFO ] [REMOTE ] IH: Full fetch complete (4977 records). [2025-10-03T19:34:29.315633] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-03T19:34:29.316005] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-03T19:34:29.315882] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-03T19:34:29.599246] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-03T19:34:30.259359] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:30.425275] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-03T19:34:30.497157] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:30.503026] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-03T19:34:30.503341] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-03T19:34:30.503587] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-03T19:34:30.503635] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-03T19:34:30.504256] [DEBUG] [LOCAL ] IH: Trimmed 4977 records to 3145 (keeping 200 days of data) [2025-10-03T19:34:30.524388] [DEBUG] [LOCAL ] IH: Primary data saved (3145 records). [2025-10-03T19:34:30.524480] [INFO ] [MAIN ] IH: Full history saved. [2025-10-03T19:34:30.524590] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IH took 24.2s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-03T19:34:30.715727] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:30.762490] [DEBUG] [LOCAL ] IHS: Loaded 39304 existing records from primary storage. [2025-10-03T19:34:30.763011] [INFO ] [MAIN ] IHS: Loaded 39304 existing records. [2025-10-03T19:34:30.958775] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:30.959120] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-03T19:34:30.959189] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-03T19:34:30.960687] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-03T19:34:30.960753] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-03T19:34:31.119484] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-03T19:34:31.194333] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-03T19:34:31.238342] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:34:31.390070] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:31.990683] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-03T19:34:32.669285] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T19:34:32.790738] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-03T19:34:33.146924] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-03T19:34:33.590739] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-03T19:34:33.941733] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:34:34.191871] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T19:34:34.390723] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-03T19:34:35.190673] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-03T19:34:35.425517] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:34:35.624206] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-03T19:34:35.990731] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-03T19:34:36.790726] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-03T19:34:37.279294] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:34:37.590737] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-03T19:34:38.302163] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:34:38.362573] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-03T19:34:38.390632] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-03T19:34:39.190742] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-03T19:34:39.697878] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:34:39.844713] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T19:34:39.990701] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-03T19:34:40.790765] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-03T19:34:41.081500] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-03T19:34:41.590798] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-03T19:34:41.834998] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:34:42.390639] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-03T19:34:42.716139] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:34:43.190770] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-03T19:34:43.909346] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:34:43.990695] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-03T19:34:44.266996] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:34:44.269567] [INFO ] [REMOTE ] IGR: Full fetch complete (45703 records). [2025-10-03T19:34:44.269837] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-03T19:34:44.608575] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-03T19:34:44.766585] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-03T19:34:44.766744] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-03T19:34:44.767828] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-03T19:34:44.767897] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-03T19:34:44.769445] [DEBUG] [LOCAL ] IGR: Trimmed 45703 records to 30882 (keeping 200 days of data) [2025-10-03T19:34:44.824216] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-03T19:34:45.001949] [DEBUG] [LOCAL ] IGR: Primary data saved (30882 records). [2025-10-03T19:34:45.002183] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-03T19:34:45.002302] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IGR took 40.6s. Estimated remaining: 2h 58m 53s. Rate: 7.1 symbols/min [2025-10-03T19:34:45.223150] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:45.235405] [DEBUG] [LOCAL ] IIF: Loaded 5734 existing records from primary storage. [2025-10-03T19:34:45.235888] [INFO ] [MAIN ] IIF: Loaded 5734 existing records. [2025-10-03T19:34:45.554239] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:45.554629] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-03T19:34:45.554740] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-03T19:34:45.555409] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-03T19:34:45.555491] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-03T19:34:45.592453] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-03T19:34:46.092555] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:46.114486] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T19:34:46.390711] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-03T19:34:46.413756] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-03T19:34:47.190721] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-03T19:34:47.820533] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:34:47.990723] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-03T19:34:48.235385] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:34:48.770050] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:34:48.790637] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-03T19:34:49.473979] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:34:49.590752] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-03T19:34:50.317686] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-03T19:34:50.390673] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-03T19:34:51.071306] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-03T19:34:51.072356] [INFO ] [REMOTE ] IHD: Full fetch complete (11764 records). [2025-10-03T19:34:51.072432] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-03T19:34:51.195731] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-03T19:34:51.458557] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-03T19:34:51.458675] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-03T19:34:51.459040] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-03T19:34:51.459089] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-03T19:34:51.459710] [DEBUG] [LOCAL ] IHD: Trimmed 11764 records to 7057 (keeping 200 days of data) [2025-10-03T19:34:51.504998] [DEBUG] [LOCAL ] IHD: Primary data saved (7057 records). [2025-10-03T19:34:51.505167] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-03T19:34:51.505280] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IHD took 23.2s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-03T19:34:51.686403] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:34:51.703546] [DEBUG] [LOCAL ] IIIN: Loaded 16475 existing records from primary storage. [2025-10-03T19:34:51.703863] [INFO ] [MAIN ] IIIN: Loaded 16475 existing records. [2025-10-03T19:34:51.896596] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:34:51.897152] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-03T19:34:51.897213] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-03T19:34:51.898158] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-03T19:34:51.898221] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-03T19:34:51.995864] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-03T19:34:52.279475] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:34:52.790691] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-03T19:34:52.927465] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:34:53.495563] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-03T19:34:53.590747] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-03T19:34:53.679186] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:34:54.390745] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-03T19:34:54.932435] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-03T19:34:55.190754] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-03T19:34:55.990776] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-03T19:34:56.009156] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:34:56.107690] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T19:34:56.790739] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-03T19:34:57.055549] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:34:57.590674] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-03T19:34:57.924814] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:34:58.390730] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-03T19:34:59.121382] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:34:59.190881] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-03T19:34:59.414351] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:34:59.684856] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-03T19:34:59.990683] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-03T19:35:00.790697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-03T19:35:01.041926] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:35:01.590687] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-03T19:35:02.057082] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-03T19:35:02.390697] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-03T19:35:02.624684] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:35:03.190681] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-03T19:35:03.640316] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-03T19:35:03.990622] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-03T19:35:03.999832] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:35:04.790735] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-03T19:35:05.117837] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-03T19:35:05.498501] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T19:35:05.590694] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-03T19:35:06.390621] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-03T19:35:06.780243] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T19:35:06.829894] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:35:07.190679] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-03T19:35:07.963804] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-03T19:35:07.990628] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-03T19:35:08.619409] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:35:08.790685] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-03T19:35:09.381536] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:35:09.590703] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-03T19:35:10.298203] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:35:10.299064] [INFO ] [REMOTE ] IIF: Full fetch complete (9334 records). [2025-10-03T19:35:10.299171] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-03T19:35:10.395756] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-03T19:35:10.707855] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-03T19:35:10.708228] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-03T19:35:10.708594] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-03T19:35:10.708683] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-03T19:35:10.709298] [DEBUG] [LOCAL ] IIF: Trimmed 9334 records to 5751 (keeping 200 days of data) [2025-10-03T19:35:10.748281] [DEBUG] [LOCAL ] IIF: Primary data saved (5751 records). [2025-10-03T19:35:10.748449] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-03T19:35:10.748589] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IIF took 25.7s. Estimated remaining: 2h 58m 46s. Rate: 7.1 symbols/min [2025-10-03T19:35:10.946519] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:10.966971] [DEBUG] [LOCAL ] IIM: Loaded 16251 existing records from primary storage. [2025-10-03T19:35:10.967249] [INFO ] [MAIN ] IIM: Loaded 16251 existing records. [2025-10-03T19:35:11.190815] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-03T19:35:11.195536] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:11.196899] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-03T19:35:11.196986] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-03T19:35:11.198355] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-03T19:35:11.198443] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-03T19:35:11.587084] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-03T19:35:11.638341] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:11.990735] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-03T19:35:12.790631] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-03T19:35:12.859676] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-03T19:35:12.861488] [INFO ] [REMOTE ] IHG: Full fetch complete (33871 records). [2025-10-03T19:35:12.861590] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-03T19:35:13.274211] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-03T19:35:13.274412] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-03T19:35:13.275223] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-03T19:35:13.275303] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-03T19:35:13.288459] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:35:13.293702] [DEBUG] [LOCAL ] IHG: Trimmed 33871 records to 24747 (keeping 200 days of data) [2025-10-03T19:35:13.467893] [DEBUG] [LOCAL ] IHG: Primary data saved (24747 records). [2025-10-03T19:35:13.468029] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-03T19:35:13.468127] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IHG took 45.1s. Estimated remaining: 2h 58m 31s. Rate: 7.1 symbols/min [2025-10-03T19:35:13.595822] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-03T19:35:13.657170] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:13.690967] [DEBUG] [LOCAL ] IIPR: Loaded 30075 existing records from primary storage. [2025-10-03T19:35:13.691269] [INFO ] [MAIN ] IIPR: Loaded 30075 existing records. [2025-10-03T19:35:13.883837] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:13.884101] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-03T19:35:13.884152] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-03T19:35:13.885951] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-03T19:35:13.886014] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-03T19:35:14.268606] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:14.361755] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:35:14.390718] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-03T19:35:14.842127] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-03T19:35:14.979046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:35:15.190717] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-03T19:35:15.990672] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-03T19:35:16.625620] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:35:16.790725] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-03T19:35:17.074946] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T19:35:17.590726] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-03T19:35:18.226343] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-03T19:35:18.390703] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-03T19:35:18.522160] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-03T19:35:19.190725] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-03T19:35:19.692323] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-03T19:35:19.990685] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-03T19:35:20.421277] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:35:20.790738] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-03T19:35:21.590698] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-03T19:35:21.735753] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T19:35:22.363901] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:35:22.390713] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-03T19:35:23.190734] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-03T19:35:23.729064] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (3.74 seconds). [2025-10-03T19:35:23.731130] [INFO ] [REMOTE ] IHS: Full fetch complete (51455 records). [2025-10-03T19:35:23.731269] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-03T19:35:23.732528] [FATAL] [VALIDATOR ] IHS: Data is stale - most recent date (2025-10-02) is before last completed trading day (2025-10-03). Symbol may be delisted or halted. [2025-10-03T19:35:23.732624] [FATAL] [MAIN ] IHS: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:35:23.732709] [WARN ] [MAIN ] IHS: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:35:23.732759] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-03T19:35:23.732824] [DEBUG] [LOCAL ] IHS: No primary data file found to delete. [2025-10-03T19:35:23.732861] [INFO ] [LOCAL ] IHS: Starting deletion of derivative data. [2025-10-03T19:35:23.733436] [DEBUG] [LOCAL ] IHS: Deleted derivative data file. [2025-10-03T19:35:23.733567] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IHS took 53.2s. Estimated remaining: 2h 58m 25s. Rate: 7.1 symbols/min [2025-10-03T19:35:23.920762] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:23.944040] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-03T19:35:23.994758] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-03T19:35:23.996949] [DEBUG] [LOCAL ] IMAX: Loaded 43087 existing records from primary storage. [2025-10-03T19:35:23.997429] [INFO ] [MAIN ] IMAX: Loaded 43087 existing records. [2025-10-03T19:35:24.075867] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-03T19:35:24.109416] [INFO ] [REMOTE ] IIIN: Full fetch complete (24871 records). [2025-10-03T19:35:24.120868] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-03T19:35:24.345915] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:24.356458] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-03T19:35:24.377883] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-03T19:35:24.412832] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-03T19:35:24.430937] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-03T19:35:24.793528] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-03T19:35:24.924257] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-03T19:35:24.954394] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-03T19:35:24.966966] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-03T19:35:24.973972] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-03T19:35:25.008466] [DEBUG] [LOCAL ] IIIN: Trimmed 24871 records to 16544 (keeping 200 days of data) [2025-10-03T19:35:25.124747] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:25.189795] [DEBUG] [LOCAL ] IIIN: Primary data saved (16544 records). [2025-10-03T19:35:25.189944] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-03T19:35:25.190054] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 33.7s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-03T19:35:25.377966] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:25.397627] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:35:25.455472] [DEBUG] [LOCAL ] INFA: Loaded 49887 existing records from primary storage. [2025-10-03T19:35:25.455853] [INFO ] [MAIN ] INFA: Loaded 49887 existing records. [2025-10-03T19:35:25.606276] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-03T19:35:25.656243] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:25.656672] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-03T19:35:25.656810] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-03T19:35:25.659131] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-03T19:35:25.659290] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-03T19:35:25.797469] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:35:26.054991] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:26.390694] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-03T19:35:27.190689] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-03T19:35:27.261409] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:35:27.709061] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-03T19:35:27.990754] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-03T19:35:28.647946] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:35:28.790717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-03T19:35:29.437139] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:35:29.590713] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-03T19:35:30.296320] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:35:30.390631] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-03T19:35:30.511495] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:35:31.190738] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-03T19:35:31.902389] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:35:31.990720] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-03T19:35:32.678310] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:35:32.790737] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-03T19:35:33.461953] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:35:33.590752] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-03T19:35:34.338205] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:35:34.390676] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-03T19:35:35.120225] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:35:35.190705] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-03T19:35:35.310040] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:35:35.990717] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-03T19:35:36.790704] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-03T19:35:36.842549] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-03T19:35:37.315794] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-03T19:35:37.590742] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-03T19:35:37.773442] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:35:38.390730] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-03T19:35:39.029607] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T19:35:39.190703] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-03T19:35:39.229957] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-03T19:35:39.990711] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-03T19:35:40.209873] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:35:40.790699] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-03T19:35:41.024011] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-03T19:35:41.590700] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-03T19:35:42.390734] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-03T19:35:42.687887] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-03T19:35:42.689787] [INFO ] [REMOTE ] IIM: Full fetch complete (25619 records). [2025-10-03T19:35:42.689882] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-03T19:35:43.108379] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-03T19:35:43.108466] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-03T19:35:43.109043] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-03T19:35:43.109119] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-03T19:35:43.110045] [DEBUG] [LOCAL ] IIM: Trimmed 25619 records to 16408 (keeping 200 days of data) [2025-10-03T19:35:43.190820] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-03T19:35:43.224916] [DEBUG] [LOCAL ] IIM: Primary data saved (16408 records). [2025-10-03T19:35:43.225107] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-03T19:35:43.225224] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IIM took 32.5s. Estimated remaining: 2h 58m 11s. Rate: 7.1 symbols/min [2025-10-03T19:35:43.421162] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:43.453432] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:35:43.521042] [DEBUG] [LOCAL ] INFY: Loaded 53985 existing records from primary storage. [2025-10-03T19:35:43.521388] [INFO ] [MAIN ] INFY: Loaded 53985 existing records. [2025-10-03T19:35:43.721306] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:43.721671] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-03T19:35:43.721884] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-03T19:35:43.723468] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-03T19:35:43.723531] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-03T19:35:43.862822] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T19:35:44.002484] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-03T19:35:44.139839] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:44.353544] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:35:44.790722] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-03T19:35:45.519605] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:35:45.590708] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-03T19:35:46.390748] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-03T19:35:46.462006] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T19:35:47.169782] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:35:47.190623] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-03T19:35:47.788469] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T19:35:47.990726] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-03T19:35:48.658082] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-03T19:35:48.790731] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-03T19:35:49.590690] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-03T19:35:49.730891] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:35:50.396802] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-03T19:35:50.402408] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-03T19:35:51.190696] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-03T19:35:51.226113] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:35:51.990620] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-03T19:35:52.099900] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:35:52.794367] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-03T19:35:52.799824] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T19:35:53.590708] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-03T19:35:53.728530] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:35:54.390711] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-03T19:35:54.547866] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:35:54.798662] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-03T19:35:54.801119] [INFO ] [REMOTE ] IMAX: Full fetch complete (59957 records). [2025-10-03T19:35:54.801259] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-03T19:35:55.198862] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-03T19:35:55.244024] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-03T19:35:55.244117] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-03T19:35:55.245069] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-03T19:35:55.245137] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-03T19:35:55.246966] [DEBUG] [LOCAL ] IMAX: Trimmed 59957 records to 43420 (keeping 200 days of data) [2025-10-03T19:35:55.519053] [DEBUG] [LOCAL ] IMAX: Primary data saved (43420 records). [2025-10-03T19:35:55.519209] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-03T19:35:55.519343] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IMAX took 31.8s. Estimated remaining: 2h 58m 7s. Rate: 7.1 symbols/min [2025-10-03T19:35:55.717619] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:55.715803] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:35:55.720517] [INFO ] [REMOTE ] IIPR: Full fetch complete (44849 records). [2025-10-03T19:35:55.720612] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-03T19:35:56.015817] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-03T19:35:56.109510] [DEBUG] [LOCAL ] ING: Loaded 51091 existing records from primary storage. [2025-10-03T19:35:56.110507] [INFO ] [MAIN ] ING: Loaded 51091 existing records. [2025-10-03T19:35:56.500968] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-03T19:35:56.516714] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-03T19:35:56.518953] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-03T19:35:56.519145] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-03T19:35:56.548953] [DEBUG] [LOCAL ] IIPR: Trimmed 44849 records to 30310 (keeping 200 days of data) [2025-10-03T19:35:56.575602] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:35:56.703696] [INFO ] [REMOTE ] INFA: Full fetch complete (71329 records). [2025-10-03T19:35:56.767327] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:56.768491] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-03T19:35:56.769094] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-03T19:35:56.771515] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-03T19:35:56.774085] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-03T19:35:56.789255] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-03T19:35:57.710581] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-03T19:35:57.737508] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-03T19:35:57.738962] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-03T19:35:57.739355] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-03T19:35:57.786754] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:57.788053] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-03T19:35:57.791638] [DEBUG] [LOCAL ] INFA: Trimmed 71329 records to 50218 (keeping 200 days of data) [2025-10-03T19:35:57.987475] [DEBUG] [LOCAL ] IIPR: Primary data saved (30310 records). [2025-10-03T19:35:57.994258] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-03T19:35:57.996312] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. IIPR took 44.5s. Estimated remaining: 2h 57m 52s. Rate: 7.1 symbols/min [2025-10-03T19:35:58.314438] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:58.369545] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-03T19:35:58.392518] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-03T19:35:58.424755] [DEBUG] [LOCAL ] INGM: Loaded 28854 existing records from primary storage. [2025-10-03T19:35:58.430791] [INFO ] [MAIN ] INGM: Loaded 28854 existing records. [2025-10-03T19:35:58.661068] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:58.662906] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-03T19:35:58.663631] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-03T19:35:58.665754] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-03T19:35:58.666709] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-03T19:35:58.807466] [DEBUG] [LOCAL ] INFA: Primary data saved (50218 records). [2025-10-03T19:35:58.817952] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-03T19:35:58.838434] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. INFA took 33.6s. Estimated remaining: 2h 57m 34s. Rate: 7.1 symbols/min [2025-10-03T19:35:59.251218] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:35:59.283737] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:59.284144] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-03T19:35:59.317056] [DEBUG] [LOCAL ] INGR: Loaded 33646 existing records from primary storage. [2025-10-03T19:35:59.317372] [INFO ] [MAIN ] INGR: Loaded 33646 existing records. [2025-10-03T19:35:59.505756] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:35:59.506027] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-03T19:35:59.506079] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-03T19:35:59.507290] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-03T19:35:59.507352] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-03T19:35:59.887133] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:35:59.887555] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-03T19:35:59.922935] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-03T19:35:59.990688] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-03T19:36:00.344982] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:36:00.375137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-03T19:36:00.790718] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-03T19:36:01.095518] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:36:01.590685] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-03T19:36:01.781405] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-03T19:36:02.390754] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-03T19:36:02.636398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-03T19:36:02.667482] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:36:03.190699] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-03T19:36:03.990690] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-03T19:36:04.040958] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:36:04.790627] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-03T19:36:04.992105] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-03T19:36:05.145037] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:36:05.590682] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-03T19:36:06.390679] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-03T19:36:06.672767] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:36:07.190695] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-03T19:36:07.713041] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-03T19:36:07.769042] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:36:07.990690] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-03T19:36:08.790730] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-03T19:36:09.045222] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T19:36:09.590733] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-03T19:36:09.812925] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-03T19:36:10.191247] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:36:10.390674] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-03T19:36:11.117582] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:36:11.190676] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-03T19:36:11.990729] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-03T19:36:12.255116] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:36:12.617693] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-03T19:36:12.790718] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-03T19:36:13.279754] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:36:13.590708] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-03T19:36:14.390635] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-03T19:36:14.585309] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-03T19:36:15.141552] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:36:15.190714] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-03T19:36:15.784206] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-03T19:36:15.786998] [INFO ] [REMOTE ] INFY: Full fetch complete (77542 records). [2025-10-03T19:36:15.787141] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-03T19:36:15.996855] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-03T19:36:16.239065] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-03T19:36:16.239152] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-03T19:36:16.240349] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-03T19:36:16.240417] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-03T19:36:16.242019] [DEBUG] [LOCAL ] INFY: Trimmed 77542 records to 54375 (keeping 200 days of data) [2025-10-03T19:36:16.592040] [DEBUG] [LOCAL ] INFY: Primary data saved (54375 records). [2025-10-03T19:36:16.592296] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-03T19:36:16.592451] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. INFY took 33.4s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-10-03T19:36:16.780228] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:16.790683] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-03T19:36:16.821697] [DEBUG] [LOCAL ] INN: Loaded 41983 existing records from primary storage. [2025-10-03T19:36:16.821996] [INFO ] [MAIN ] INN: Loaded 41983 existing records. [2025-10-03T19:36:17.033449] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:17.034128] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-03T19:36:17.034357] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-03T19:36:17.035556] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-03T19:36:17.035732] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-03T19:36:17.203783] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:36:17.487969] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:36:17.569101] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:17.590717] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-03T19:36:18.319121] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:36:18.390673] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-03T19:36:19.082187] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:36:19.190717] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-03T19:36:19.990664] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-03T19:36:20.168926] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:36:20.549368] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:36:20.790726] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-03T19:36:21.153339] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-03T19:36:21.590688] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-03T19:36:22.142457] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-03T19:36:22.390734] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-03T19:36:22.990543] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-03T19:36:23.190720] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-03T19:36:23.614221] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:36:23.990742] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-03T19:36:24.635314] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:36:24.638915] [INFO ] [REMOTE ] ING: Full fetch complete (73626 records). [2025-10-03T19:36:24.639040] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-03T19:36:24.794678] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-03T19:36:25.060941] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-03T19:36:25.061061] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-03T19:36:25.062177] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-03T19:36:25.062255] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-03T19:36:25.063853] [DEBUG] [LOCAL ] ING: Trimmed 73626 records to 51453 (keeping 200 days of data) [2025-10-03T19:36:25.302776] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-03T19:36:25.417220] [DEBUG] [LOCAL ] ING: Primary data saved (51453 records). [2025-10-03T19:36:25.417364] [INFO ] [MAIN ] ING: Full history saved. [2025-10-03T19:36:25.417461] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. ING took 29.9s. Estimated remaining: 2h 57m 29s. Rate: 7.1 symbols/min [2025-10-03T19:36:25.595242] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:25.595348] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-03T19:36:25.596631] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-03T19:36:25.596724] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-03T19:36:25.596852] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-03T19:36:25.596896] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-03T19:36:25.596941] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-03T19:36:25.596974] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-03T19:36:25.988922] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:26.297677] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:36:26.390679] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-03T19:36:26.596899] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:36:26.597226] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-03T19:36:26.597350] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:36:26.597428] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-03T19:36:26.597497] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:36:26.597573] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-03T19:36:26.597665] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-03T19:36:26.597726] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-03T19:36:26.597813] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-03T19:36:26.597871] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INR took 1.2s. Estimated remaining: 2h 57m 12s. Rate: 7.1 symbols/min [2025-10-03T19:36:26.805326] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:26.829454] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T19:36:26.871196] [DEBUG] [LOCAL ] INSP: Loaded 37471 existing records from primary storage. [2025-10-03T19:36:26.871538] [INFO ] [MAIN ] INSP: Loaded 37471 existing records. [2025-10-03T19:36:27.071884] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:27.072176] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-03T19:36:27.072258] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-03T19:36:27.072842] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-03T19:36:27.072905] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-03T19:36:27.191082] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-03T19:36:27.482211] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:27.990638] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-03T19:36:28.452873] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:36:28.790701] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-03T19:36:29.107760] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:36:29.590729] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-03T19:36:30.223071] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:36:30.390719] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-03T19:36:30.576932] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:36:30.580316] [INFO ] [REMOTE ] INGR: Full fetch complete (50318 records). [2025-10-03T19:36:30.580495] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-03T19:36:31.024243] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-03T19:36:31.024328] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-03T19:36:31.025215] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-03T19:36:31.025281] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-03T19:36:31.026454] [DEBUG] [LOCAL ] INGR: Trimmed 50318 records to 33949 (keeping 200 days of data) [2025-10-03T19:36:31.201259] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-03T19:36:31.255354] [DEBUG] [LOCAL ] INGR: Primary data saved (33949 records). [2025-10-03T19:36:31.255508] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-03T19:36:31.255596] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGR took 32.4s. Estimated remaining: 2h 56m 59s. Rate: 7.1 symbols/min [2025-10-03T19:36:31.455344] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:31.498943] [DEBUG] [LOCAL ] INSW: Loaded 40240 existing records from primary storage. [2025-10-03T19:36:31.499259] [INFO ] [MAIN ] INSW: Loaded 40240 existing records. [2025-10-03T19:36:31.699033] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:31.699460] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-03T19:36:31.699604] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-03T19:36:31.701037] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-03T19:36:31.701104] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-03T19:36:31.907333] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:36:31.996494] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-03T19:36:32.136591] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:32.565252] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:36:32.790720] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-03T19:36:33.539066] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:36:33.590730] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-03T19:36:34.364767] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:36:34.390636] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-03T19:36:35.014975] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:36:35.190673] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-03T19:36:35.620595] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T19:36:35.990712] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-03T19:36:36.723315] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:36:36.790639] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-03T19:36:36.980968] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:36:36.982770] [INFO ] [REMOTE ] INGM: Full fetch complete (42543 records). [2025-10-03T19:36:36.982868] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-03T19:36:37.386662] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-03T19:36:37.386756] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-03T19:36:37.387489] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-03T19:36:37.387554] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-03T19:36:37.388597] [DEBUG] [LOCAL ] INGM: Trimmed 42543 records to 29093 (keeping 200 days of data) [2025-10-03T19:36:37.585511] [DEBUG] [LOCAL ] INGM: Primary data saved (29093 records). [2025-10-03T19:36:37.585719] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-03T19:36:37.585867] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INGM took 39.6s. Estimated remaining: 2h 56m 48s. Rate: 7.1 symbols/min [2025-10-03T19:36:37.598541] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-03T19:36:37.792797] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:37.851160] [DEBUG] [LOCAL ] INVH: Loaded 53521 existing records from primary storage. [2025-10-03T19:36:37.851585] [INFO ] [MAIN ] INVH: Loaded 53521 existing records. [2025-10-03T19:36:38.047993] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:38.048214] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-03T19:36:38.048292] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-03T19:36:38.050997] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-03T19:36:38.051062] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-03T19:36:38.395165] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-03T19:36:38.454885] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:38.483877] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:36:39.130542] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-03T19:36:39.190734] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-03T19:36:39.990670] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-03T19:36:40.101402] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-03T19:36:40.551919] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:36:40.790735] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-03T19:36:41.595792] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-03T19:36:41.620032] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:36:42.225227] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:36:42.390722] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-03T19:36:43.190743] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-03T19:36:43.252627] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:36:43.846927] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:36:43.990737] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-03T19:36:44.790714] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-03T19:36:44.990093] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:36:45.348940] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:36:45.590701] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-03T19:36:46.077370] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-03T19:36:46.390704] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-03T19:36:47.190732] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-03T19:36:47.337982] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-03T19:36:47.990727] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-03T19:36:48.030273] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:36:48.537942] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:36:48.540729] [INFO ] [REMOTE ] INN: Full fetch complete (57866 records). [2025-10-03T19:36:48.540883] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-03T19:36:48.804227] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-03T19:36:49.144850] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-03T19:36:49.144974] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-03T19:36:49.146814] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-03T19:36:49.146903] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-03T19:36:49.148788] [DEBUG] [LOCAL ] INN: Trimmed 57866 records to 42281 (keeping 200 days of data) [2025-10-03T19:36:49.499776] [DEBUG] [LOCAL ] INN: Primary data saved (42281 records). [2025-10-03T19:36:49.499932] [INFO ] [MAIN ] INN: Full history saved. [2025-10-03T19:36:49.500054] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INN took 32.9s. Estimated remaining: 2h 56m 44s. Rate: 7.1 symbols/min [2025-10-03T19:36:49.593335] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-03T19:36:49.711667] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:36:49.747225] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:36:49.784798] [DEBUG] [LOCAL ] INVX: Loaded 29238 existing records from primary storage. [2025-10-03T19:36:49.785099] [INFO ] [MAIN ] INVX: Loaded 29238 existing records. [2025-10-03T19:36:49.977977] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:36:49.978363] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-03T19:36:49.978470] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-03T19:36:49.979739] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-03T19:36:49.979802] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-03T19:36:50.207266] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T19:36:50.398605] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-03T19:36:50.430806] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:36:50.938195] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:36:51.190709] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-03T19:36:51.990635] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-03T19:36:52.182100] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:36:52.707823] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:36:52.790614] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-03T19:36:53.262890] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T19:36:53.590730] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-03T19:36:54.390708] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-03T19:36:54.505102] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:36:55.017978] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:36:55.190700] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-03T19:36:55.931967] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-03T19:36:55.990719] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-03T19:36:56.552804] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:36:56.790725] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-03T19:36:57.596099] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-03T19:36:57.607849] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:36:58.175128] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-03T19:36:58.390711] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-03T19:36:59.190729] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-03T19:36:59.348992] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:36:59.418594] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-03T19:36:59.990699] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-03T19:37:00.674822] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:37:00.790694] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-03T19:37:01.279612] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-03T19:37:01.590681] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-03T19:37:02.306114] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:37:02.390689] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-03T19:37:03.130717] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:37:03.133108] [INFO ] [REMOTE ] INSP: Full fetch complete (53143 records). [2025-10-03T19:37:03.133252] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-03T19:37:03.195788] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-03T19:37:03.555794] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-03T19:37:03.555907] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-03T19:37:03.556842] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-03T19:37:03.556909] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-03T19:37:03.558385] [DEBUG] [LOCAL ] INSP: Trimmed 53143 records to 37804 (keeping 200 days of data) [2025-10-03T19:37:03.804908] [DEBUG] [LOCAL ] INSP: Primary data saved (37804 records). [2025-10-03T19:37:03.805064] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-03T19:37:03.805166] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INSP took 37.2s. Estimated remaining: 2h 56m 42s. Rate: 7.1 symbols/min [2025-10-03T19:37:03.984608] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:03.990672] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-03T19:37:04.042920] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-10-03T19:37:04.043268] [INFO ] [MAIN ] IONQ: Loaded 54178 existing records. [2025-10-03T19:37:04.239073] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:04.239401] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-03T19:37:04.239468] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-03T19:37:04.240171] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-03T19:37:04.240296] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-03T19:37:04.395466] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:37:04.657688] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:37:04.706737] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:04.790668] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-03T19:37:05.520027] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-03T19:37:05.590731] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-03T19:37:06.390718] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-03T19:37:06.536927] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-03T19:37:06.807769] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:37:06.809795] [INFO ] [REMOTE ] INSW: Full fetch complete (60390 records). [2025-10-03T19:37:06.809901] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-03T19:37:07.195967] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-03T19:37:07.243588] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-03T19:37:07.243698] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-03T19:37:07.244609] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-03T19:37:07.244702] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-03T19:37:07.246063] [DEBUG] [LOCAL ] INSW: Trimmed 60390 records to 40456 (keeping 200 days of data) [2025-10-03T19:37:07.502422] [DEBUG] [LOCAL ] INSW: Primary data saved (40456 records). [2025-10-03T19:37:07.502554] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-03T19:37:07.504920] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INSW took 36.2s. Estimated remaining: 2h 56m 28s. Rate: 7.1 symbols/min [2025-10-03T19:37:07.696750] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:07.757306] [DEBUG] [LOCAL ] IOT: Loaded 53861 existing records from primary storage. [2025-10-03T19:37:07.757664] [INFO ] [MAIN ] IOT: Loaded 53861 existing records. [2025-10-03T19:37:07.938313] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:37:07.990258] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:07.990700] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-03T19:37:07.991049] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-03T19:37:07.991950] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-03T19:37:07.992622] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-03T19:37:07.992725] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-03T19:37:08.381973] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:08.790731] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-03T19:37:09.071156] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-03T19:37:09.140779] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-03T19:37:09.590701] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-03T19:37:10.390724] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-03T19:37:10.879583] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:37:11.190695] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-03T19:37:11.548676] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-10-03T19:37:11.990634] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-03T19:37:12.309735] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:37:12.576783] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-03T19:37:12.790714] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-03T19:37:13.590708] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-03T19:37:14.390626] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-03T19:37:14.472475] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-03T19:37:14.527863] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:37:14.903261] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:37:15.190708] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-03T19:37:15.706542] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:37:15.709436] [INFO ] [REMOTE ] INVH: Full fetch complete (76722 records). [2025-10-03T19:37:15.709575] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-03T19:37:15.996938] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-03T19:37:16.150492] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-03T19:37:16.150599] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-03T19:37:16.151865] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-03T19:37:16.151936] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-03T19:37:16.153570] [DEBUG] [LOCAL ] INVH: Trimmed 76722 records to 53907 (keeping 200 days of data) [2025-10-03T19:37:16.403368] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-03T19:37:16.532533] [DEBUG] [LOCAL ] INVH: Primary data saved (53907 records). [2025-10-03T19:37:16.532709] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-03T19:37:16.532808] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVH took 38.9s. Estimated remaining: 2h 56m 20s. Rate: 7.1 symbols/min [2025-10-03T19:37:16.790675] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-03T19:37:17.590684] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-03T19:37:17.792159] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-03T19:37:17.793969] [INFO ] [REMOTE ] INVX: Full fetch complete (43981 records). [2025-10-03T19:37:17.794070] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-03T19:37:18.193530] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-03T19:37:18.193865] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-03T19:37:18.194919] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-03T19:37:18.194997] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-03T19:37:18.198100] [DEBUG] [LOCAL ] INVX: Trimmed 43981 records to 29430 (keeping 200 days of data) [2025-10-03T19:37:18.380699] [DEBUG] [LOCAL ] INVX: Primary data saved (29430 records). [2025-10-03T19:37:18.380843] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-03T19:37:18.380993] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INVX took 28.9s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-03T19:37:18.450374] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-03T19:37:18.461822] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-03T19:37:19.263181] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:37:19.273869] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-03T19:37:21.227282] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.77 seconds). [2025-10-03T19:37:21.240587] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-03T19:37:21.309273] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T19:37:21.321439] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-03T19:37:23.197134] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:37:23.209766] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-03T19:37:24.010152] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-10-03T19:37:24.022109] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-03T19:37:25.113991] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:37:25.126875] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-03T19:37:26.794596] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-10-03T19:37:26.806841] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-03T19:37:26.939568] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-03T19:37:26.952098] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-03T19:37:28.939835] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-03T19:37:28.952935] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-03T19:37:29.412695] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-10-03T19:37:29.425592] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-03T19:37:30.624205] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:37:30.637940] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-03T19:37:32.399493] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-03T19:37:32.412944] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-03T19:37:32.601485] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-03T19:37:32.614339] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-03T19:37:34.330318] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-03T19:37:34.333265] [INFO ] [REMOTE ] IOT: Full fetch complete (77385 records). [2025-10-03T19:37:34.333390] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-03T19:37:34.745071] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-03T19:37:34.745215] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-03T19:37:34.746830] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-03T19:37:34.746971] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-03T19:37:34.749436] [DEBUG] [LOCAL ] IOT: Trimmed 77385 records to 54251 (keeping 200 days of data) [2025-10-03T19:37:34.876366] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-03T19:37:34.901863] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-03T19:37:35.143027] [DEBUG] [LOCAL ] IOT: Primary data saved (54251 records). [2025-10-03T19:37:35.143261] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-03T19:37:35.144107] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IOT took 27.6s. Estimated remaining: 2h 56m 5s. Rate: 7.1 symbols/min [2025-10-03T19:37:37.701095] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-03T19:37:37.714718] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-03T19:37:40.271369] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.56 seconds). [2025-10-03T19:37:40.274538] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-03T19:37:40.274930] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-03T19:37:40.706551] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-03T19:37:40.706702] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-03T19:37:40.708006] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-03T19:37:40.708076] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-03T19:37:40.710176] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54568 (keeping 200 days of data) [2025-10-03T19:37:41.149398] [DEBUG] [LOCAL ] IONQ: Primary data saved (54568 records). [2025-10-03T19:37:41.149570] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-03T19:37:41.149686] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IONQ took 37.3s. Estimated remaining: 2h 55m 54s. Rate: 7.1 symbols/min [2025-10-03T19:37:42.107775] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.130987] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.134975] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.129887] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:37:42.160950] [DEBUG] [LOCAL ] IQI: Loaded 18227 existing records from primary storage. [2025-10-03T19:37:42.166268] [INFO ] [MAIN ] IQI: Loaded 18227 existing records. [2025-10-03T19:37:42.312163] [DEBUG] [LOCAL ] IPI: Loaded 21605 existing records from primary storage. [2025-10-03T19:37:42.339238] [INFO ] [MAIN ] IPI: Loaded 21605 existing records. [2025-10-03T19:37:42.437090] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:42.519472] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-03T19:37:42.533863] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-03T19:37:42.519092] [DEBUG] [LOCAL ] IPG: Loaded 53719 existing records from primary storage. [2025-10-03T19:37:42.535367] [INFO ] [MAIN ] IPG: Loaded 53719 existing records. [2025-10-03T19:37:42.540557] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-03T19:37:42.590977] [DEBUG] [LOCAL ] IP: Loaded 53702 existing records from primary storage. [2025-10-03T19:37:42.607482] [INFO ] [MAIN ] IP: Loaded 53702 existing records. [2025-10-03T19:37:42.607370] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-03T19:37:42.881538] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:42.959531] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-03T19:37:42.992998] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-03T19:37:43.077692] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-03T19:37:43.175160] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:43.170951] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-03T19:37:43.228360] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-03T19:37:43.213750] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:37:43.252148] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-03T19:37:43.279044] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-03T19:37:43.340694] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-03T19:37:43.397436] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-03T19:37:43.377502] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-03T19:37:43.428716] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-03T19:37:43.434022] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-03T19:37:43.930838] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.038342] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-03T19:37:44.341760] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.374289] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-03T19:37:44.644746] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.646818] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-03T19:37:44.671118] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:37:44.671767] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-03T19:37:45.373836] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:37:45.379168] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-03T19:37:45.447510] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:37:45.451443] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-03T19:37:46.370734] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:37:46.375925] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-03T19:37:46.447528] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-03T19:37:46.480504] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-03T19:37:46.484777] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:37:46.496685] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-03T19:37:46.568879] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:37:46.580019] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-03T19:37:47.158432] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-03T19:37:47.163718] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-03T19:37:47.441923] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:37:47.446207] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-03T19:37:47.870948] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:37:47.882296] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-03T19:37:47.995629] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:37:48.007066] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-03T19:37:48.179806] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:37:48.183908] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-03T19:37:48.701987] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T19:37:48.707561] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-03T19:37:49.006076] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:37:49.011703] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-03T19:37:49.363631] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:37:49.375249] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-03T19:37:49.587945] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T19:37:49.592952] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-03T19:37:49.916925] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-03T19:37:49.929005] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-03T19:37:49.953270] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-03T19:37:49.960326] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-03T19:37:50.558437] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:37:50.562714] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-03T19:37:50.786703] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:37:50.817120] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-03T19:37:50.819856] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-03T19:37:50.826480] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-03T19:37:51.629495] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-03T19:37:51.634631] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-03T19:37:51.727692] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T19:37:51.740539] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-03T19:37:51.831874] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T19:37:51.990694] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-03T19:37:52.413219] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:37:52.508483] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:37:52.790711] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-03T19:37:53.037344] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-03T19:37:53.367196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:37:53.590726] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-03T19:37:54.390719] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-03T19:37:54.737141] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:37:54.946532] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:37:55.190724] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-03T19:37:55.963196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-03T19:37:55.990628] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-03T19:37:56.790711] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-03T19:37:56.962685] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:37:57.590716] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-03T19:37:57.875846] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-03T19:37:57.949839] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:37:58.390709] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-03T19:37:58.730753] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-03T19:37:59.190723] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-03T19:37:59.990741] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-03T19:38:00.295888] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:38:00.297486] [INFO ] [REMOTE ] IQI: Full fetch complete (27020 records). [2025-10-03T19:38:00.297594] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-03T19:38:00.657748] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-03T19:38:00.765939] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-03T19:38:00.766026] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-03T19:38:00.766673] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-03T19:38:00.766740] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-03T19:38:00.767504] [DEBUG] [LOCAL ] IQI: Trimmed 27020 records to 18347 (keeping 200 days of data) [2025-10-03T19:38:00.825004] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-03T19:38:00.898139] [DEBUG] [LOCAL ] IQI: Primary data saved (18347 records). [2025-10-03T19:38:00.898350] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-03T19:38:00.898454] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IQI took 19.7s. Estimated remaining: 2h 55m 58s. Rate: 7.1 symbols/min [2025-10-03T19:38:01.093756] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:01.130093] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:38:01.132807] [INFO ] [REMOTE ] IPI: Full fetch complete (29429 records). [2025-10-03T19:38:01.132928] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-03T19:38:01.265798] [DEBUG] [LOCAL ] IQV: Loaded 50465 existing records from primary storage. [2025-10-03T19:38:01.281619] [INFO ] [MAIN ] IQV: Loaded 50465 existing records. [2025-10-03T19:38:01.599768] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-03T19:38:01.697492] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:01.739813] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-03T19:38:01.768732] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-03T19:38:01.783683] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-03T19:38:01.783798] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-03T19:38:01.784535] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-03T19:38:01.784588] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-03T19:38:01.785198] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-03T19:38:01.785448] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-03T19:38:01.852572] [DEBUG] [LOCAL ] IPI: Trimmed 29429 records to 21849 (keeping 200 days of data) [2025-10-03T19:38:02.297041] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:02.340874] [DEBUG] [LOCAL ] IPI: Primary data saved (21849 records). [2025-10-03T19:38:02.341040] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-03T19:38:02.341142] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IPI took 21.2s. Estimated remaining: 2h 55m 42s. Rate: 7.1 symbols/min [2025-10-03T19:38:02.414593] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-03T19:38:02.544260] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:02.581537] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:38:02.645515] [DEBUG] [LOCAL ] IR: Loaded 53077 existing records from primary storage. [2025-10-03T19:38:02.645977] [INFO ] [MAIN ] IR: Loaded 53077 existing records. [2025-10-03T19:38:02.826113] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:02.826397] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-03T19:38:02.826451] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-03T19:38:02.828118] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-03T19:38:02.828183] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-03T19:38:03.202297] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-03T19:38:03.226772] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:03.531702] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:38:03.750757] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:38:03.990733] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-03T19:38:04.790693] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-03T19:38:05.014513] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-03T19:38:05.525870] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:38:05.590630] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-03T19:38:06.396403] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-03T19:38:06.402685] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:38:07.190637] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-03T19:38:07.405019] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-03T19:38:07.407921] [INFO ] [REMOTE ] IP: Full fetch complete (77111 records). [2025-10-03T19:38:07.408043] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-03T19:38:07.868392] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-03T19:38:07.868599] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-03T19:38:07.870041] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-03T19:38:07.870200] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-03T19:38:07.874501] [DEBUG] [LOCAL ] IP: Trimmed 77111 records to 54091 (keeping 200 days of data) [2025-10-03T19:38:07.990687] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-03T19:38:08.145419] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:38:08.278620] [DEBUG] [LOCAL ] IP: Primary data saved (54091 records). [2025-10-03T19:38:08.278835] [INFO ] [MAIN ] IP: Full history saved. [2025-10-03T19:38:08.278993] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IP took 27.1s. Estimated remaining: 2h 55m 31s. Rate: 7.1 symbols/min [2025-10-03T19:38:08.478625] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:08.534299] [DEBUG] [LOCAL ] IRM: Loaded 49653 existing records from primary storage. [2025-10-03T19:38:08.534830] [INFO ] [MAIN ] IRM: Loaded 49653 existing records. [2025-10-03T19:38:08.763900] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:08.764153] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-03T19:38:08.764455] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-03T19:38:08.764999] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-03T19:38:08.765066] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-03T19:38:08.802724] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-03T19:38:08.974188] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:38:09.216087] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:09.590707] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-03T19:38:09.816446] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T19:38:10.390659] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-03T19:38:10.589378] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:38:11.190719] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-03T19:38:11.471510] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:38:11.990709] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-03T19:38:12.075162] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:38:12.596508] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:38:12.790685] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-03T19:38:13.590634] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-03T19:38:13.839713] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-03T19:38:14.390686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-03T19:38:14.507738] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-03T19:38:15.135704] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:38:15.190670] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-03T19:38:15.990745] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-03T19:38:16.597309] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-03T19:38:16.790741] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-03T19:38:17.053748] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-03T19:38:17.391005] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:38:17.590693] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-03T19:38:18.390709] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-03T19:38:18.568169] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T19:38:19.190734] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-03T19:38:19.599493] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-03T19:38:19.923982] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T19:38:19.927283] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-03T19:38:19.927528] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-03T19:38:20.002582] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-03T19:38:20.395719] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-03T19:38:20.395828] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-03T19:38:20.397080] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-03T19:38:20.397174] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-03T19:38:20.399470] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 54109 (keeping 200 days of data) [2025-10-03T19:38:20.780103] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-03T19:38:20.795409] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-03T19:38:20.822267] [DEBUG] [LOCAL ] IPG: Primary data saved (54109 records). [2025-10-03T19:38:20.822795] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-03T19:38:20.822938] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IPG took 39.7s. Estimated remaining: 2h 55m 27s. Rate: 7.1 symbols/min [2025-10-03T19:38:21.014887] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:21.036504] [DEBUG] [LOCAL ] IRS: Loaded 22194 existing records from primary storage. [2025-10-03T19:38:21.036793] [INFO ] [MAIN ] IRS: Loaded 22194 existing records. [2025-10-03T19:38:21.241894] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:21.242211] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-03T19:38:21.242268] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-03T19:38:21.242906] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-03T19:38:21.242979] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-03T19:38:21.595770] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-03T19:38:21.656343] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:21.810866] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:38:22.390630] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-03T19:38:22.745742] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:38:23.190630] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-03T19:38:23.266758] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-03T19:38:23.295099] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T19:38:23.990716] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-03T19:38:24.790688] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-03T19:38:25.036343] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-03T19:38:25.590724] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-03T19:38:25.708297] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:38:26.071086] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-03T19:38:26.390673] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-03T19:38:27.000019] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-03T19:38:27.190750] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-03T19:38:27.404768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:38:27.990725] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-03T19:38:28.798968] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-03T19:38:28.805324] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-03T19:38:29.590733] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-03T19:38:29.648892] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-03T19:38:30.299506] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:38:30.390715] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-03T19:38:31.154983] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:38:31.158296] [INFO ] [REMOTE ] IQV: Full fetch complete (72215 records). [2025-10-03T19:38:31.158492] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-03T19:38:31.195826] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-03T19:38:31.596413] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-03T19:38:31.596500] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-03T19:38:31.597678] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-03T19:38:31.597789] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-03T19:38:31.599374] [DEBUG] [LOCAL ] IQV: Trimmed 72215 records to 50838 (keeping 200 days of data) [2025-10-03T19:38:31.925220] [DEBUG] [LOCAL ] IQV: Primary data saved (50838 records). [2025-10-03T19:38:31.925391] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-03T19:38:31.925499] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IQV took 31.0s. Estimated remaining: 2h 55m 21s. Rate: 7.1 symbols/min [2025-10-03T19:38:31.998194] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-03T19:38:32.138525] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:32.198160] [DEBUG] [LOCAL ] IRT: Loaded 50773 existing records from primary storage. [2025-10-03T19:38:32.198572] [INFO ] [MAIN ] IRT: Loaded 50773 existing records. [2025-10-03T19:38:32.370896] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-03T19:38:32.455401] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:32.455734] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-03T19:38:32.455801] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-03T19:38:32.456728] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-03T19:38:32.456810] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-03T19:38:32.794016] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-03T19:38:32.862288] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:32.966850] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:38:33.050238] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:38:33.590740] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-03T19:38:34.345603] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:38:34.348421] [INFO ] [REMOTE ] IR: Full fetch complete (76215 records). [2025-10-03T19:38:34.348563] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-03T19:38:34.396058] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-03T19:38:34.839530] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-03T19:38:34.839740] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-03T19:38:34.840854] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-03T19:38:34.841045] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-03T19:38:34.842759] [DEBUG] [LOCAL ] IR: Trimmed 76215 records to 53466 (keeping 200 days of data) [2025-10-03T19:38:34.988028] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:38:35.206018] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-03T19:38:35.233795] [DEBUG] [LOCAL ] IR: Primary data saved (53466 records). [2025-10-03T19:38:35.233947] [INFO ] [MAIN ] IR: Full history saved. [2025-10-03T19:38:35.234529] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IR took 32.9s. Estimated remaining: 2h 55m 7s. Rate: 7.1 symbols/min [2025-10-03T19:38:35.424479] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:35.446528] [DEBUG] [LOCAL ] ISD: Loaded 15710 existing records from primary storage. [2025-10-03T19:38:35.446823] [INFO ] [MAIN ] ISD: Loaded 15710 existing records. [2025-10-03T19:38:35.635176] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:35.635412] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-03T19:38:35.635493] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-03T19:38:35.635841] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-03T19:38:35.635901] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-03T19:38:35.995676] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-03T19:38:36.026639] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:36.245275] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-03T19:38:36.741031] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-03T19:38:36.796951] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-03T19:38:36.819310] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:38:37.590692] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-03T19:38:38.390668] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-03T19:38:38.738639] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:38:39.197192] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-03T19:38:39.229450] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-03T19:38:39.516959] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-03T19:38:39.990690] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-03T19:38:40.647734] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:38:40.650355] [INFO ] [REMOTE ] IRM: Full fetch complete (72294 records). [2025-10-03T19:38:40.650476] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-03T19:38:40.793325] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-03T19:38:40.896212] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-03T19:38:41.106881] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-03T19:38:41.106995] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-03T19:38:41.108029] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-03T19:38:41.108097] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-03T19:38:41.109709] [DEBUG] [LOCAL ] IRM: Trimmed 72294 records to 50029 (keeping 200 days of data) [2025-10-03T19:38:41.435904] [DEBUG] [LOCAL ] IRM: Primary data saved (50029 records). [2025-10-03T19:38:41.436056] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-03T19:38:41.436161] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRM took 33.2s. Estimated remaining: 2h 54m 56s. Rate: 7.1 symbols/min [2025-10-03T19:38:41.595685] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-03T19:38:41.621897] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:41.665897] [DEBUG] [LOCAL ] IT: Loaded 42328 existing records from primary storage. [2025-10-03T19:38:41.666215] [INFO ] [MAIN ] IT: Loaded 42328 existing records. [2025-10-03T19:38:41.861240] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:41.861749] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-03T19:38:41.861895] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-03T19:38:41.862454] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-03T19:38:41.862522] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-03T19:38:41.986947] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:38:42.302666] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:42.390706] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-03T19:38:42.656022] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-03T19:38:43.190711] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-03T19:38:43.990669] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-03T19:38:44.220121] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:38:44.549350] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-03T19:38:44.717467] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T19:38:44.790713] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-03T19:38:45.590701] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-03T19:38:46.133680] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-03T19:38:46.390681] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-03T19:38:46.628768] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-03T19:38:47.190684] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-03T19:38:47.990708] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-03T19:38:48.269863] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:38:48.626226] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:38:48.627963] [INFO ] [REMOTE ] IRS: Full fetch complete (32268 records). [2025-10-03T19:38:48.628045] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-03T19:38:48.791539] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-03T19:38:49.029700] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-03T19:38:49.029919] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-03T19:38:49.030785] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-03T19:38:49.031017] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-03T19:38:49.032195] [DEBUG] [LOCAL ] IRS: Trimmed 32268 records to 22375 (keeping 200 days of data) [2025-10-03T19:38:49.140024] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-03T19:38:49.195513] [DEBUG] [LOCAL ] IRS: Primary data saved (22375 records). [2025-10-03T19:38:49.195664] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-03T19:38:49.195766] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IRS took 28.4s. Estimated remaining: 2h 54m 47s. Rate: 7.1 symbols/min [2025-10-03T19:38:49.381435] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:38:49.413246] [DEBUG] [LOCAL ] ITGR: Loaded 31551 existing records from primary storage. [2025-10-03T19:38:49.413543] [INFO ] [MAIN ] ITGR: Loaded 31551 existing records. [2025-10-03T19:38:49.591684] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-03T19:38:49.618782] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:38:49.619041] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-03T19:38:49.619117] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-03T19:38:49.621104] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-03T19:38:49.621187] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-03T19:38:50.048556] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:38:50.390690] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-03T19:38:50.494303] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:38:50.712976] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-03T19:38:51.190733] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-03T19:38:51.720352] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-03T19:38:51.990688] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-03T19:38:52.758775] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:38:52.790701] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-03T19:38:53.463966] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:38:53.590722] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-03T19:38:53.851007] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:38:54.390674] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-03T19:38:54.778620] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T19:38:55.190682] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-03T19:38:55.990639] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-03T19:38:56.046457] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-03T19:38:56.122115] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:38:56.790685] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-03T19:38:57.587923] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:38:57.595693] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-03T19:38:57.733497] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T19:38:58.390688] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-03T19:38:59.177319] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:38:59.190613] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-03T19:38:59.332714] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-03T19:38:59.990626] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-03T19:39:00.520932] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T19:39:00.790727] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-03T19:39:01.412212] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:39:01.590705] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-03T19:39:01.954175] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-03T19:39:01.957819] [INFO ] [REMOTE ] IRT: Full fetch complete (72652 records). [2025-10-03T19:39:01.958028] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-03T19:39:02.386037] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-03T19:39:02.386128] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-03T19:39:02.387116] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-03T19:39:02.387183] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-03T19:39:02.388715] [DEBUG] [LOCAL ] IRT: Trimmed 72652 records to 51140 (keeping 200 days of data) [2025-10-03T19:39:02.442545] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-03T19:39:02.721359] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:39:02.746445] [DEBUG] [LOCAL ] IRT: Primary data saved (51140 records). [2025-10-03T19:39:02.746605] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-03T19:39:02.746783] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IRT took 30.8s. Estimated remaining: 2h 54m 44s. Rate: 7.1 symbols/min [2025-10-03T19:39:02.945466] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:02.987299] [DEBUG] [LOCAL ] ITT: Loaded 32995 existing records from primary storage. [2025-10-03T19:39:02.987605] [INFO ] [MAIN ] ITT: Loaded 32995 existing records. [2025-10-03T19:39:03.191173] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:03.191343] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-03T19:39:03.193113] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-03T19:39:03.193199] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-03T19:39:03.193934] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-03T19:39:03.194002] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-03T19:39:03.574230] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:03.990738] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-03T19:39:04.347177] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T19:39:04.387486] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:39:04.790685] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-03T19:39:05.479736] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:39:05.590695] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-03T19:39:06.390628] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-03T19:39:06.584329] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:39:06.627672] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-03T19:39:07.190818] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-03T19:39:07.684369] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-03T19:39:07.990740] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-03T19:39:08.790684] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-03T19:39:08.919498] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:39:09.352068] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-03T19:39:09.590682] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-03T19:39:09.830746] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-03T19:39:10.390682] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-03T19:39:11.156940] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:39:11.190705] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-03T19:39:11.246576] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:39:11.990726] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-03T19:39:12.614084] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-03T19:39:12.790693] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-03T19:39:13.590725] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-03T19:39:13.768538] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:39:13.771483] [INFO ] [REMOTE ] IT: Full fetch complete (56368 records). [2025-10-03T19:39:13.771625] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-03T19:39:14.212349] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-03T19:39:14.212603] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-03T19:39:14.213826] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-03T19:39:14.213915] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-03T19:39:14.215818] [DEBUG] [LOCAL ] IT: Trimmed 56368 records to 42648 (keeping 200 days of data) [2025-10-03T19:39:14.249993] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:39:14.442354] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-03T19:39:14.546717] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T19:39:14.554732] [DEBUG] [LOCAL ] IT: Primary data saved (42648 records). [2025-10-03T19:39:14.554907] [INFO ] [MAIN ] IT: Full history saved. [2025-10-03T19:39:14.555024] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. IT took 33.1s. Estimated remaining: 2h 54m 40s. Rate: 7.1 symbols/min [2025-10-03T19:39:14.752486] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:14.810096] [DEBUG] [LOCAL ] ITUB: Loaded 53711 existing records from primary storage. [2025-10-03T19:39:14.810474] [INFO ] [MAIN ] ITUB: Loaded 53711 existing records. [2025-10-03T19:39:15.011104] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:15.011366] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-03T19:39:15.011455] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-03T19:39:15.012007] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-03T19:39:15.012068] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-03T19:39:15.197166] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-03T19:39:15.435865] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:15.990735] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-03T19:39:16.174963] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-03T19:39:16.179682] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:39:16.187758] [INFO ] [REMOTE ] ISD: Full fetch complete (24078 records). [2025-10-03T19:39:16.188529] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-03T19:39:16.586211] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-03T19:39:16.586318] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-03T19:39:16.587180] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-03T19:39:16.587247] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-03T19:39:16.588038] [DEBUG] [LOCAL ] ISD: Trimmed 24078 records to 15880 (keeping 200 days of data) [2025-10-03T19:39:16.693054] [DEBUG] [LOCAL ] ISD: Primary data saved (15880 records). [2025-10-03T19:39:16.693257] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-03T19:39:16.693379] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. ISD took 41.5s. Estimated remaining: 2h 54m 24s. Rate: 7.1 symbols/min [2025-10-03T19:39:16.797516] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-03T19:39:16.879244] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:16.937168] [DEBUG] [LOCAL ] ITW: Loaded 46101 existing records from primary storage. [2025-10-03T19:39:16.937594] [INFO ] [MAIN ] ITW: Loaded 46101 existing records. [2025-10-03T19:39:17.122785] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:17.123126] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-03T19:39:17.123186] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-03T19:39:17.123754] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-03T19:39:17.123814] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-03T19:39:17.503142] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:17.590682] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-03T19:39:17.816360] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:39:18.390687] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-03T19:39:18.534696] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:39:18.917298] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-03T19:39:19.190694] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-03T19:39:19.990692] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-03T19:39:20.203462] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T19:39:20.426272] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T19:39:20.790738] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-03T19:39:21.590721] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-03T19:39:21.638216] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:39:22.390688] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-03T19:39:22.678959] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-03T19:39:23.032825] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-03T19:39:23.190709] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-03T19:39:23.730674] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:39:23.990711] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-03T19:39:24.585760] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:39:24.790678] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-03T19:39:25.245094] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T19:39:25.590622] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-03T19:39:25.750430] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-03T19:39:26.390688] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-03T19:39:26.889965] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:39:27.190717] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-03T19:39:27.301852] [DEBUG] [REMOTE ] ITUB: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-03T19:39:27.302204] [WARN ] [REMOTE ] ITUB: No data returned for month 2025-04 [2025-10-03T19:39:27.302300] [FATAL] [REMOTE ] ITUB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:39:27.302386] [FATAL] [MAIN ] ITUB: Failed to fetch primary data. [2025-10-03T19:39:27.302454] [WARN ] [MAIN ] ITUB: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:39:27.302530] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-03T19:39:27.302597] [DEBUG] [LOCAL ] ITUB: No primary data file found to delete. [2025-10-03T19:39:27.302665] [INFO ] [LOCAL ] ITUB: Starting deletion of derivative data. [2025-10-03T19:39:27.303310] [DEBUG] [LOCAL ] ITUB: Deleted derivative data file. [2025-10-03T19:39:27.303400] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. ITUB took 12.7s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-10-03T19:39:27.425673] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:39:27.448733] [INFO ] [REMOTE ] ITGR: Full fetch complete (41893 records). [2025-10-03T19:39:27.478092] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-03T19:39:27.504585] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:27.885851] [DEBUG] [LOCAL ] IVR: Loaded 48258 existing records from primary storage. [2025-10-03T19:39:27.917485] [INFO ] [MAIN ] IVR: Loaded 48258 existing records. [2025-10-03T19:39:27.995739] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-03T19:39:28.003343] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-03T19:39:28.003473] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-03T19:39:28.023559] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-03T19:39:28.030537] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-03T19:39:28.089049] [DEBUG] [LOCAL ] ITGR: Trimmed 41893 records to 31755 (keeping 200 days of data) [2025-10-03T19:39:28.243146] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:28.249362] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-03T19:39:28.253788] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-03T19:39:28.256364] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-03T19:39:28.256434] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-03T19:39:28.738450] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:28.752466] [DEBUG] [LOCAL ] ITGR: Primary data saved (31755 records). [2025-10-03T19:39:28.752634] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-03T19:39:28.752788] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITGR took 39.6s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-10-03T19:39:28.798787] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-03T19:39:28.940936] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:28.974591] [DEBUG] [LOCAL ] IVT: Loaded 30940 existing records from primary storage. [2025-10-03T19:39:28.974913] [INFO ] [MAIN ] IVT: Loaded 30940 existing records. [2025-10-03T19:39:29.166033] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:29.166256] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-03T19:39:29.166306] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-03T19:39:29.166519] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-03T19:39:29.166579] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-03T19:39:29.569521] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-03T19:39:29.587431] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:29.590611] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-03T19:39:30.390690] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-03T19:39:30.443535] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:39:30.505323] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-03T19:39:31.190732] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-03T19:39:31.791740] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:39:31.990706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-03T19:39:32.319410] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-03T19:39:32.321259] [INFO ] [REMOTE ] ITT: Full fetch complete (47010 records). [2025-10-03T19:39:32.321372] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-03T19:39:32.721555] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-03T19:39:32.721638] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-03T19:39:32.722438] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-03T19:39:32.722484] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-03T19:39:32.723546] [DEBUG] [LOCAL ] ITT: Trimmed 47010 records to 33181 (keeping 200 days of data) [2025-10-03T19:39:32.812522] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-03T19:39:32.938364] [DEBUG] [LOCAL ] ITT: Primary data saved (33181 records). [2025-10-03T19:39:32.938537] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-03T19:39:32.938662] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. ITT took 30.2s. Estimated remaining: 2h 53m 49s. Rate: 7.1 symbols/min [2025-10-03T19:39:33.115056] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:39:33.167994] [DEBUG] [LOCAL ] IVZ: Loaded 53517 existing records from primary storage. [2025-10-03T19:39:33.168391] [INFO ] [MAIN ] IVZ: Loaded 53517 existing records. [2025-10-03T19:39:33.356220] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:39:33.356499] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-03T19:39:33.356551] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-03T19:39:33.356911] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-03T19:39:33.356975] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-03T19:39:33.599366] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-03T19:39:33.743772] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:39:33.775439] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-03T19:39:34.070507] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:39:34.390691] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-03T19:39:34.567833] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-03T19:39:35.190724] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-03T19:39:35.929275] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:39:35.990706] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-03T19:39:36.790636] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-03T19:39:36.879873] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:39:37.590732] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-03T19:39:37.648526] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-03T19:39:38.066080] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:39:38.390696] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-03T19:39:38.927258] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-03T19:39:39.190714] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-03T19:39:39.990690] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-03T19:39:40.030911] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-03T19:39:40.790682] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-03T19:39:41.142861] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-03T19:39:41.590668] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-03T19:39:41.687935] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:39:42.390691] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-03T19:39:42.845711] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:39:43.147345] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:39:43.190735] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-03T19:39:43.990679] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-03T19:39:44.277080] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:39:44.790634] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-03T19:39:44.917610] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:39:45.590698] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-03T19:39:45.714578] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-03T19:39:46.390629] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-03T19:39:46.470606] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:39:47.190709] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-03T19:39:47.693748] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-03T19:39:47.970707] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:39:47.990683] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-03T19:39:48.790685] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-03T19:39:49.097883] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-03T19:39:49.590722] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-03T19:39:49.733690] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:39:50.390633] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-03T19:39:50.512694] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:39:51.072358] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-03T19:39:51.190746] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-03T19:39:51.990673] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-03T19:39:52.057057] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-03T19:39:52.568384] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-03T19:39:52.790697] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-03T19:39:53.516511] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:39:53.590689] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-03T19:39:54.085195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-03T19:39:54.390727] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-03T19:39:55.190700] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-03T19:39:55.235941] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:39:55.294738] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-03T19:39:55.990697] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-03T19:39:56.790706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-03T19:39:57.157186] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T19:39:57.535235] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:39:57.590681] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-03T19:39:58.400862] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-03T19:39:58.409629] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:39:58.961149] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-03T19:39:59.190699] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-03T19:39:59.635851] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-03T19:39:59.990735] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-03T19:40:00.790677] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-03T19:40:01.020775] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-03T19:40:01.590470] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:40:01.592421] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-03T19:40:01.594402] [INFO ] [REMOTE ] ITW: Full fetch complete (66426 records). [2025-10-03T19:40:01.594569] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-03T19:40:02.033907] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-03T19:40:02.034029] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-03T19:40:02.035280] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-03T19:40:02.035404] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-03T19:40:02.037246] [DEBUG] [LOCAL ] ITW: Trimmed 66426 records to 46423 (keeping 200 days of data) [2025-10-03T19:40:02.210965] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:40:02.404107] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-03T19:40:02.432638] [DEBUG] [LOCAL ] ITW: Primary data saved (46423 records). [2025-10-03T19:40:02.432846] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-03T19:40:02.433903] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 45.7s. Estimated remaining: 2h 54m 4s. Rate: 7.1 symbols/min [2025-10-03T19:40:02.623136] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:02.651075] [DEBUG] [LOCAL ] IX: Loaded 22607 existing records from primary storage. [2025-10-03T19:40:02.651349] [INFO ] [MAIN ] IX: Loaded 22607 existing records. [2025-10-03T19:40:02.854516] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:02.854799] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-03T19:40:02.854864] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-03T19:40:02.855193] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-03T19:40:02.855253] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-03T19:40:03.200979] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-03T19:40:03.245716] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:03.376875] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:40:03.382796] [INFO ] [REMOTE ] IVZ: Full fetch complete (76804 records). [2025-10-03T19:40:03.383009] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-03T19:40:03.834586] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-03T19:40:03.834713] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-03T19:40:03.835851] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-03T19:40:03.835923] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-03T19:40:03.837888] [DEBUG] [LOCAL ] IVZ: Trimmed 76804 records to 53906 (keeping 200 days of data) [2025-10-03T19:40:04.038540] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-03T19:40:04.202854] [DEBUG] [LOCAL ] IVZ: Primary data saved (53906 records). [2025-10-03T19:40:04.203012] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-03T19:40:04.203120] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. IVZ took 31.3s. Estimated remaining: 2h 53m 48s. Rate: 7.1 symbols/min [2025-10-03T19:40:04.418755] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:40:04.423172] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:04.427255] [INFO ] [REMOTE ] IVT: Full fetch complete (45492 records). [2025-10-03T19:40:04.427773] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-03T19:40:04.585297] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T19:40:04.796742] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-03T19:40:04.823568] [DEBUG] [LOCAL ] J: Loaded 40454 existing records from primary storage. [2025-10-03T19:40:04.867370] [INFO ] [MAIN ] J: Loaded 40454 existing records. [2025-10-03T19:40:04.999938] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-03T19:40:05.263964] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-03T19:40:05.264064] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-03T19:40:05.265039] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-03T19:40:05.265130] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-03T19:40:05.263756] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:05.265502] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-03T19:40:05.265558] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-03T19:40:05.266167] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-03T19:40:05.266244] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-03T19:40:05.345813] [DEBUG] [LOCAL ] IVT: Trimmed 45492 records to 31154 (keeping 200 days of data) [2025-10-03T19:40:05.595219] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-03T19:40:05.774333] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:05.876822] [DEBUG] [LOCAL ] IVT: Primary data saved (31154 records). [2025-10-03T19:40:05.876976] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-03T19:40:05.877078] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 37.1s. Estimated remaining: 2h 53m 32s. Rate: 7.1 symbols/min [2025-10-03T19:40:06.058006] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:06.107745] [DEBUG] [LOCAL ] JBGS: Loaded 42686 existing records from primary storage. [2025-10-03T19:40:06.108058] [INFO ] [MAIN ] JBGS: Loaded 42686 existing records. [2025-10-03T19:40:06.300873] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:06.301105] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-03T19:40:06.301161] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-03T19:40:06.301492] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-03T19:40:06.301564] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-03T19:40:06.393132] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-03T19:40:06.426928] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:40:06.704963] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:06.803331] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-03T19:40:06.806233] [INFO ] [REMOTE ] IVR: Full fetch complete (69238 records). [2025-10-03T19:40:06.806365] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-03T19:40:07.205509] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-03T19:40:07.267810] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-03T19:40:07.267966] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-03T19:40:07.269122] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-03T19:40:07.269191] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-03T19:40:07.271075] [DEBUG] [LOCAL ] IVR: Trimmed 69238 records to 48643 (keeping 200 days of data) [2025-10-03T19:40:07.581820] [DEBUG] [LOCAL ] IVR: Primary data saved (48643 records). [2025-10-03T19:40:07.581975] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-03T19:40:07.582101] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. IVR took 40.3s. Estimated remaining: 2h 53m 16s. Rate: 7.1 symbols/min [2025-10-03T19:40:07.777408] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:07.822073] [DEBUG] [LOCAL ] JBI: Loaded 43831 existing records from primary storage. [2025-10-03T19:40:07.822416] [INFO ] [MAIN ] JBI: Loaded 43831 existing records. [2025-10-03T19:40:07.993511] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-03T19:40:08.017427] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:08.017926] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-03T19:40:08.018006] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-03T19:40:08.018619] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-03T19:40:08.018768] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-03T19:40:08.223830] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:40:08.449204] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:08.713419] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:40:08.790708] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-03T19:40:08.874627] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-03T19:40:09.590702] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-03T19:40:10.366708] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:40:10.390620] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-03T19:40:10.659221] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:40:11.190701] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-03T19:40:11.990638] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-03T19:40:12.099091] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:40:12.585513] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T19:40:12.790715] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-03T19:40:13.312388] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-03T19:40:13.590712] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-03T19:40:14.379477] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-03T19:40:14.390616] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-03T19:40:14.892604] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:40:15.190677] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-03T19:40:15.990701] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-03T19:40:16.055810] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:40:16.335511] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:40:16.790726] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-03T19:40:17.590745] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-03T19:40:17.705903] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:40:18.390682] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-03T19:40:18.426175] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-03T19:40:19.190625] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-03T19:40:19.230478] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:40:19.990747] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-03T19:40:20.269362] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-03T19:40:20.790723] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-03T19:40:20.996586] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-03T19:40:21.445791] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:40:21.590719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-03T19:40:21.924054] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:40:22.390717] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-03T19:40:22.993867] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-03T19:40:23.190713] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-03T19:40:23.226858] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-03T19:40:23.990707] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-03T19:40:24.693768] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:40:24.746857] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-03T19:40:24.790637] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-03T19:40:25.590731] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-03T19:40:25.911543] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-03T19:40:26.390721] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-03T19:40:27.033384] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:40:27.190743] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-03T19:40:27.900029] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:40:27.990708] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-03T19:40:28.790723] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-03T19:40:28.839367] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-03T19:40:28.840804] [INFO ] [REMOTE ] IX: Full fetch complete (27378 records). [2025-10-03T19:40:28.840906] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-03T19:40:29.061247] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:40:29.308297] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-03T19:40:29.308411] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-03T19:40:29.309091] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-03T19:40:29.309200] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-03T19:40:29.310033] [DEBUG] [LOCAL ] IX: Trimmed 27378 records to 22726 (keeping 200 days of data) [2025-10-03T19:40:29.448426] [DEBUG] [LOCAL ] IX: Primary data saved (22726 records). [2025-10-03T19:40:29.448572] [INFO ] [MAIN ] IX: Full history saved. [2025-10-03T19:40:29.448713] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IX took 27.0s. Estimated remaining: 2h 53m 22s. Rate: 7.1 symbols/min [2025-10-03T19:40:29.600938] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-03T19:40:29.637410] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:29.690451] [DEBUG] [LOCAL ] JBL: Loaded 48752 existing records from primary storage. [2025-10-03T19:40:29.690872] [INFO ] [MAIN ] JBL: Loaded 48752 existing records. [2025-10-03T19:40:29.898587] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:29.899001] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-03T19:40:29.899221] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-03T19:40:29.899543] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-03T19:40:29.899736] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-03T19:40:30.094101] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:40:30.330617] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:30.390683] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-03T19:40:31.190694] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-03T19:40:31.308316] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:40:31.889840] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:40:31.990719] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-03T19:40:32.790708] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-03T19:40:32.994042] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:40:33.594684] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-03T19:40:33.600426] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:40:33.929193] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:40:33.931847] [INFO ] [REMOTE ] J: Full fetch complete (59133 records). [2025-10-03T19:40:33.931983] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-03T19:40:34.373751] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-03T19:40:34.373848] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-03T19:40:34.374946] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-03T19:40:34.375017] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-03T19:40:34.376494] [DEBUG] [LOCAL ] J: Trimmed 59133 records to 40756 (keeping 200 days of data) [2025-10-03T19:40:34.434963] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-03T19:40:34.649103] [DEBUG] [LOCAL ] J: Primary data saved (40756 records). [2025-10-03T19:40:34.649237] [INFO ] [MAIN ] J: Full history saved. [2025-10-03T19:40:34.649326] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. J took 30.4s. Estimated remaining: 2h 53m 10s. Rate: 7.1 symbols/min [2025-10-03T19:40:34.843851] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:34.873597] [DEBUG] [LOCAL ] JBND: Loaded 26305 existing records from primary storage. [2025-10-03T19:40:34.874007] [INFO ] [MAIN ] JBND: Loaded 26305 existing records. [2025-10-03T19:40:35.094746] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:35.095043] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-03T19:40:35.095108] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-03T19:40:35.095384] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-03T19:40:35.095485] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-03T19:40:35.196964] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-03T19:40:35.535578] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:40:35.727507] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:35.990754] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-03T19:40:36.043924] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:40:36.790689] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-03T19:40:37.055132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:40:37.482207] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-03T19:40:37.590700] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-03T19:40:37.977015] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:40:38.390728] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-03T19:40:39.190635] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-03T19:40:39.220872] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:40:39.599867] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-03T19:40:39.990702] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-03T19:40:40.416432] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:40:40.418975] [INFO ] [REMOTE ] JBGS: Full fetch complete (59404 records). [2025-10-03T19:40:40.419081] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-03T19:40:40.795783] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-03T19:40:40.848027] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-03T19:40:40.848120] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-03T19:40:40.849161] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-03T19:40:40.849232] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-03T19:40:40.851121] [DEBUG] [LOCAL ] JBGS: Trimmed 59404 records to 42986 (keeping 200 days of data) [2025-10-03T19:40:41.130788] [DEBUG] [LOCAL ] JBGS: Primary data saved (42986 records). [2025-10-03T19:40:41.130943] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-03T19:40:41.131087] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBGS took 35.3s. Estimated remaining: 2h 52m 60s. Rate: 7.1 symbols/min [2025-10-03T19:40:41.332918] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:41.333294] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-03T19:40:41.333482] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-03T19:40:41.333705] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-03T19:40:41.333831] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-03T19:40:41.333970] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-03T19:40:41.334071] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-03T19:40:41.509928] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:40:41.594216] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-03T19:40:41.815635] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:42.390754] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-03T19:40:42.794204] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-03T19:40:43.190703] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-03T19:40:43.246866] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:40:43.312047] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-03T19:40:43.990738] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-03T19:40:44.181998] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:40:44.182316] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-03T19:40:44.182410] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:40:44.182458] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-03T19:40:44.182492] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:40:44.182530] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-03T19:40:44.182587] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-03T19:40:44.182624] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-03T19:40:44.182712] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-03T19:40:44.182792] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBS took 3.1s. Estimated remaining: 2h 52m 46s. Rate: 7.1 symbols/min [2025-10-03T19:40:44.383047] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:44.383294] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-03T19:40:44.383353] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-03T19:40:44.383484] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-03T19:40:44.383534] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-03T19:40:44.383580] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-03T19:40:44.383614] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-03T19:40:44.802333] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-03T19:40:44.808992] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:44.859948] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:40:45.590742] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-03T19:40:45.793725] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:40:45.794066] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-03T19:40:45.794160] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:40:45.794209] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-03T19:40:45.794283] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:40:45.794357] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-03T19:40:45.794423] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-03T19:40:45.794481] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-03T19:40:45.794523] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-03T19:40:45.794601] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBTM took 1.6s. Estimated remaining: 2h 52m 30s. Rate: 7.1 symbols/min [2025-10-03T19:40:45.937356] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:40:46.014074] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:46.024671] [DEBUG] [LOCAL ] JCE: Loaded 6893 existing records from primary storage. [2025-10-03T19:40:46.024942] [INFO ] [MAIN ] JCE: Loaded 6893 existing records. [2025-10-03T19:40:46.223204] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:46.223452] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-03T19:40:46.223503] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-03T19:40:46.223784] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-03T19:40:46.223845] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-03T19:40:46.395808] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-03T19:40:46.633694] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:47.190708] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-03T19:40:47.990687] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-03T19:40:48.132584] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-03T19:40:48.193450] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:40:48.790686] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-03T19:40:48.935801] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-03T19:40:49.590692] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-03T19:40:50.129539] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T19:40:50.390692] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-03T19:40:51.190679] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-03T19:40:51.486127] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:40:51.765717] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:40:51.774812] [INFO ] [REMOTE ] JBI: Full fetch complete (64394 records). [2025-10-03T19:40:51.776320] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:40:51.776467] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-03T19:40:51.995869] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-03T19:40:52.207919] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-03T19:40:52.208026] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-03T19:40:52.209207] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-03T19:40:52.209279] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-03T19:40:52.211017] [DEBUG] [LOCAL ] JBI: Trimmed 64394 records to 44153 (keeping 200 days of data) [2025-10-03T19:40:52.466047] [DEBUG] [LOCAL ] JBI: Primary data saved (44153 records). [2025-10-03T19:40:52.466190] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-03T19:40:52.466291] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBI took 44.9s. Estimated remaining: 2h 52m 19s. Rate: 7.1 symbols/min [2025-10-03T19:40:52.669041] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:40:52.725385] [DEBUG] [LOCAL ] JCI: Loaded 53933 existing records from primary storage. [2025-10-03T19:40:52.725760] [INFO ] [MAIN ] JCI: Loaded 53933 existing records. [2025-10-03T19:40:52.795835] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-03T19:40:52.929609] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:40:52.929867] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-03T19:40:52.929919] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-03T19:40:52.930374] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-03T19:40:52.930435] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-03T19:40:53.338014] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:40:53.421997] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:40:53.590713] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-03T19:40:53.910719] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-03T19:40:54.161403] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T19:40:54.390695] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-03T19:40:55.190703] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-03T19:40:55.990684] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-03T19:40:56.006584] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:40:56.040415] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:40:56.790712] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-03T19:40:57.590696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-03T19:40:57.679225] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:40:58.390716] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-03T19:40:58.675951] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T19:40:58.731250] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-03T19:40:58.975913] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:40:59.190700] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-03T19:40:59.990704] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-03T19:41:00.251379] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-03T19:41:00.790723] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-03T19:41:01.401047] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:41:01.403731] [INFO ] [REMOTE ] JBL: Full fetch complete (70448 records). [2025-10-03T19:41:01.403902] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-03T19:41:01.602581] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-03T19:41:01.861780] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-03T19:41:01.861911] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-03T19:41:01.862911] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-03T19:41:01.862981] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-03T19:41:01.864529] [DEBUG] [LOCAL ] JBL: Trimmed 70448 records to 49138 (keeping 200 days of data) [2025-10-03T19:41:02.023610] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-03T19:41:02.238416] [DEBUG] [LOCAL ] JBL: Primary data saved (49138 records). [2025-10-03T19:41:02.238581] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-03T19:41:02.239434] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JBL took 32.8s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-10-03T19:41:02.402294] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-03T19:41:02.438285] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:02.490669] [DEBUG] [LOCAL ] JEF: Loaded 50415 existing records from primary storage. [2025-10-03T19:41:02.491019] [INFO ] [MAIN ] JEF: Loaded 50415 existing records. [2025-10-03T19:41:02.692502] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:02.692829] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-03T19:41:02.692883] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-03T19:41:02.694678] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-03T19:41:02.694751] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-03T19:41:03.076789] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:03.183507] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:41:03.190604] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-03T19:41:03.433376] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T19:41:03.853711] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-03T19:41:03.990699] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-03T19:41:04.790699] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-03T19:41:05.285143] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-03T19:41:05.500200] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-03T19:41:05.590697] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-03T19:41:06.390710] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-03T19:41:07.177969] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T19:41:07.190610] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-03T19:41:07.238199] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-03T19:41:07.910986] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-03T19:41:07.912206] [INFO ] [REMOTE ] JCE: Full fetch complete (9516 records). [2025-10-03T19:41:07.912281] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-03T19:41:07.995817] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-03T19:41:08.301750] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-03T19:41:08.301865] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-03T19:41:08.302111] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-03T19:41:08.302152] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-03T19:41:08.302605] [DEBUG] [LOCAL ] JCE: Trimmed 9516 records to 6994 (keeping 200 days of data) [2025-10-03T19:41:08.349260] [DEBUG] [LOCAL ] JCE: Primary data saved (6994 records). [2025-10-03T19:41:08.349410] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-03T19:41:08.349497] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JCE took 22.6s. Estimated remaining: 2h 52m 2s. Rate: 7.1 symbols/min [2025-10-03T19:41:08.535816] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:08.584419] [DEBUG] [LOCAL ] JELD: Loaded 46427 existing records from primary storage. [2025-10-03T19:41:08.584874] [INFO ] [MAIN ] JELD: Loaded 46427 existing records. [2025-10-03T19:41:08.797179] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:08.797314] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-03T19:41:08.797720] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-03T19:41:08.797792] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-03T19:41:08.799109] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-03T19:41:08.799218] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-03T19:41:09.171464] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:09.487573] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-03T19:41:09.590696] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-03T19:41:10.247732] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-03T19:41:10.390752] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-03T19:41:10.954015] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:41:11.190748] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-03T19:41:11.755951] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:41:11.990707] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-03T19:41:12.296359] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-03T19:41:12.790716] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-03T19:41:13.572688] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-03T19:41:13.590631] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-03T19:41:14.127574] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-03T19:41:14.390720] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-03T19:41:14.790595] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-03T19:41:14.792510] [INFO ] [REMOTE ] JBND: Full fetch complete (34416 records). [2025-10-03T19:41:14.792595] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-03T19:41:15.191090] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-03T19:41:15.190825] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-03T19:41:15.192053] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-03T19:41:15.192875] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-03T19:41:15.192992] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-03T19:41:15.194123] [DEBUG] [LOCAL ] JBND: Trimmed 34416 records to 26559 (keeping 200 days of data) [2025-10-03T19:41:15.366094] [DEBUG] [LOCAL ] JBND: Primary data saved (26559 records). [2025-10-03T19:41:15.366238] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-03T19:41:15.366382] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBND took 40.7s. Estimated remaining: 2h 51m 52s. Rate: 7.1 symbols/min [2025-10-03T19:41:15.550313] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:15.562535] [DEBUG] [LOCAL ] JEQ: Loaded 8924 existing records from primary storage. [2025-10-03T19:41:15.562809] [INFO ] [MAIN ] JEQ: Loaded 8924 existing records. [2025-10-03T19:41:15.772370] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:15.772752] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-03T19:41:15.772867] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-03T19:41:15.773520] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-03T19:41:15.773684] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-03T19:41:15.930574] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:41:15.991970] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-03T19:41:16.199886] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:16.696378] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:41:16.790717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-03T19:41:17.173755] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-10-03T19:41:17.557508] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:41:17.590757] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-03T19:41:17.995691] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-03T19:41:18.390711] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-03T19:41:19.190736] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-03T19:41:19.990639] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-03T19:41:20.279566] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:41:20.790724] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-03T19:41:20.919443] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:41:21.201810] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:41:21.590727] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-03T19:41:22.390694] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-03T19:41:22.613808] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:41:23.190728] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-03T19:41:23.355806] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T19:41:23.961726] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:41:23.990625] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-03T19:41:24.790694] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-03T19:41:25.161896] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-03T19:41:25.590696] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-03T19:41:25.769582] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-03T19:41:25.958366] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-03T19:41:26.376084] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:41:26.390631] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-03T19:41:27.190723] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-03T19:41:27.693100] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-03T19:41:27.990731] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-03T19:41:28.096414] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-03T19:41:28.790756] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-03T19:41:29.590689] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-03T19:41:29.631005] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:41:29.649998] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:41:30.390677] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-03T19:41:31.134961] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-03T19:41:31.190728] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-03T19:41:31.911785] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-03T19:41:31.990704] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-03T19:41:32.146020] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:41:32.790717] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-03T19:41:33.593901] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-03T19:41:33.594839] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:41:33.629761] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-03T19:41:34.390697] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-03T19:41:34.995864] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:41:35.190697] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-03T19:41:35.330065] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:41:35.990725] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-03T19:41:36.790685] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-03T19:41:36.830894] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-03T19:41:37.590694] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-03T19:41:37.799093] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:41:38.314154] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:41:38.317230] [INFO ] [REMOTE ] JEF: Full fetch complete (72970 records). [2025-10-03T19:41:38.317424] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-03T19:41:38.395893] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-03T19:41:38.637352] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-03T19:41:38.863871] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-03T19:41:38.864018] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-03T19:41:38.865258] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-03T19:41:38.865343] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-03T19:41:38.867238] [DEBUG] [LOCAL ] JEF: Trimmed 72970 records to 50784 (keeping 200 days of data) [2025-10-03T19:41:39.212861] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-03T19:41:39.253721] [DEBUG] [LOCAL ] JEF: Primary data saved (50784 records). [2025-10-03T19:41:39.253855] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-03T19:41:39.254467] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEF took 37.0s. Estimated remaining: 2h 51m 60s. Rate: 7.1 symbols/min [2025-10-03T19:41:39.446043] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:39.481949] [DEBUG] [LOCAL ] JFR: Loaded 30936 existing records from primary storage. [2025-10-03T19:41:39.482227] [INFO ] [MAIN ] JFR: Loaded 30936 existing records. [2025-10-03T19:41:39.710257] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:39.710560] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-03T19:41:39.710614] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-03T19:41:39.710875] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-03T19:41:39.710933] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-03T19:41:39.996008] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-03T19:41:40.118588] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:40.137975] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-03T19:41:40.790635] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-03T19:41:40.812537] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:41:41.111839] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-03T19:41:41.590706] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-03T19:41:42.170089] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:41:42.172787] [INFO ] [REMOTE ] JELD: Full fetch complete (64129 records). [2025-10-03T19:41:42.172941] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-03T19:41:42.250488] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-03T19:41:42.274203] [INFO ] [REMOTE ] JEQ: Full fetch complete (11819 records). [2025-10-03T19:41:42.300533] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-03T19:41:42.393662] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-03T19:41:43.043090] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-03T19:41:43.048698] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-03T19:41:43.052975] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-03T19:41:43.060234] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-03T19:41:43.089560] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-03T19:41:43.089689] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-03T19:41:43.089943] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-03T19:41:43.090171] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-03T19:41:43.090685] [DEBUG] [LOCAL ] JELD: Trimmed 64129 records to 46721 (keeping 200 days of data) [2025-10-03T19:41:43.091056] [DEBUG] [LOCAL ] JEQ: Trimmed 11819 records to 8975 (keeping 200 days of data) [2025-10-03T19:41:43.210700] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-03T19:41:43.233982] [DEBUG] [LOCAL ] JEQ: Primary data saved (8975 records). [2025-10-03T19:41:43.234870] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-03T19:41:43.235326] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JEQ took 27.9s. Estimated remaining: 2h 51m 46s. Rate: 7.1 symbols/min [2025-10-03T19:41:43.445580] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:43.551632] [DEBUG] [LOCAL ] JGH: Loaded 11163 existing records from primary storage. [2025-10-03T19:41:43.552724] [INFO ] [MAIN ] JGH: Loaded 11163 existing records. [2025-10-03T19:41:43.776228] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:43.779811] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-03T19:41:43.780487] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-03T19:41:43.781712] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-03T19:41:43.782293] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-03T19:41:44.209679] [DEBUG] [LOCAL ] JELD: Primary data saved (46721 records). [2025-10-03T19:41:44.232006] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-03T19:41:44.231393] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-03T19:41:44.262189] [INFO ] [REMOTE ] JCI: Full fetch complete (77409 records). [2025-10-03T19:41:44.278313] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-03T19:41:44.245186] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JELD took 35.9s. Estimated remaining: 2h 51m 30s. Rate: 7.1 symbols/min [2025-10-03T19:41:44.319833] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:44.407310] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-03T19:41:44.680131] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:44.969481] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-03T19:41:44.969767] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-03T19:41:44.971117] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-03T19:41:44.979164] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-03T19:41:45.017796] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-03T19:41:45.015507] [DEBUG] [LOCAL ] JHG: Loaded 47986 existing records from primary storage. [2025-10-03T19:41:45.027553] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-03T19:41:45.027934] [INFO ] [MAIN ] JHG: Loaded 47986 existing records. [2025-10-03T19:41:45.028261] [DEBUG] [LOCAL ] JCI: Trimmed 77409 records to 54318 (keeping 200 days of data) [2025-10-03T19:41:45.356499] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:45.367311] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-03T19:41:45.368326] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-03T19:41:45.370717] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-03T19:41:45.372754] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-03T19:41:45.609789] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:41:45.624818] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-03T19:41:45.937621] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:46.042130] [DEBUG] [LOCAL ] JCI: Primary data saved (54318 records). [2025-10-03T19:41:46.042289] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-03T19:41:46.042379] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JCI took 53.6s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-03T19:41:46.227772] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:41:46.234942] [DEBUG] [LOCAL ] JHI: Loaded 3612 existing records from primary storage. [2025-10-03T19:41:46.235170] [INFO ] [MAIN ] JHI: Loaded 3612 existing records. [2025-10-03T19:41:46.406245] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-03T19:41:46.456427] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:41:46.457242] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-03T19:41:46.457329] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-03T19:41:46.457998] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-03T19:41:46.458062] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-03T19:41:46.609130] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:41:46.621902] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:41:46.908850] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:41:47.190696] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-03T19:41:47.942150] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-03T19:41:47.990711] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-03T19:41:48.291558] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-03T19:41:48.593551] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-03T19:41:48.790707] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-03T19:41:49.590719] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-03T19:41:49.633671] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:41:50.327276] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-03T19:41:50.390691] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-03T19:41:51.190703] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-03T19:41:51.811388] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-03T19:41:51.870056] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:41:51.990681] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-03T19:41:52.445213] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-03T19:41:52.790701] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-03T19:41:53.590735] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-03T19:41:54.359295] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-03T19:41:54.390634] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-03T19:41:54.408727] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:41:55.190709] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-03T19:41:55.846579] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-03T19:41:55.990712] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-03T19:41:56.589980] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T19:41:56.590530] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-03T19:41:56.790738] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-03T19:41:57.590684] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-03T19:41:58.388216] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-03T19:41:58.391299] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-03T19:41:58.467492] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-03T19:41:59.042010] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-03T19:41:59.190695] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-03T19:41:59.990715] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-03T19:42:00.718859] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-03T19:42:00.790705] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-03T19:42:01.163857] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-03T19:42:01.374985] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-03T19:42:01.590810] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-03T19:42:02.372285] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-03T19:42:02.390609] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-03T19:42:03.175505] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:42:03.190599] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-03T19:42:03.990666] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-03T19:42:04.000685] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-03T19:42:04.625042] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-03T19:42:04.790751] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-03T19:42:05.590635] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-03T19:42:06.026614] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-03T19:42:06.390680] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-03T19:42:06.400856] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:42:07.190711] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-03T19:42:07.681071] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-03T19:42:07.990630] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-03T19:42:08.087160] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-03T19:42:08.745096] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-03T19:42:08.746363] [INFO ] [REMOTE ] JGH: Full fetch complete (15058 records). [2025-10-03T19:42:08.746439] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-03T19:42:08.795829] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-03T19:42:09.135321] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-03T19:42:09.135421] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-03T19:42:09.135818] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-03T19:42:09.135883] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-03T19:42:09.136523] [DEBUG] [LOCAL ] JGH: Trimmed 15058 records to 11242 (keeping 200 days of data) [2025-10-03T19:42:09.210955] [DEBUG] [LOCAL ] JGH: Primary data saved (11242 records). [2025-10-03T19:42:09.211120] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-03T19:42:09.211215] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JGH took 26.0s. Estimated remaining: 2h 51m 22s. Rate: 7.1 symbols/min [2025-10-03T19:42:09.392852] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:09.398785] [DEBUG] [LOCAL ] JHS: Loaded 2834 existing records from primary storage. [2025-10-03T19:42:09.398967] [INFO ] [MAIN ] JHS: Loaded 2834 existing records. [2025-10-03T19:42:09.591707] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-03T19:42:09.591591] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:09.593080] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-03T19:42:09.593138] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-03T19:42:09.593364] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-03T19:42:09.593425] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-03T19:42:10.012571] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:10.298473] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:42:10.390701] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-03T19:42:10.930046] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-03T19:42:11.199056] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-03T19:42:11.206938] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:42:11.990681] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-03T19:42:12.528833] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-03T19:42:12.530726] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-03T19:42:12.790719] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-03T19:42:13.379364] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-03T19:42:13.590692] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-03T19:42:14.176260] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:42:14.390721] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-03T19:42:15.190729] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-03T19:42:15.915968] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T19:42:15.939835] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:42:15.990637] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-03T19:42:16.438230] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-03T19:42:16.790695] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-03T19:42:17.590686] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-03T19:42:18.121824] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-03T19:42:18.395819] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-03T19:42:18.409588] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-03T19:42:18.963527] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T19:42:18.964332] [INFO ] [REMOTE ] JHI: Full fetch complete (5251 records). [2025-10-03T19:42:18.964438] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-03T19:42:19.199015] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-03T19:42:19.362181] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-03T19:42:19.362272] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-03T19:42:19.362471] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-03T19:42:19.362537] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-03T19:42:19.363135] [DEBUG] [LOCAL ] JHI: Trimmed 5251 records to 3638 (keeping 200 days of data) [2025-10-03T19:42:19.387620] [DEBUG] [LOCAL ] JHI: Primary data saved (3638 records). [2025-10-03T19:42:19.387806] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-03T19:42:19.387935] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JHI took 33.3s. Estimated remaining: 2h 51m 15s. Rate: 7.1 symbols/min [2025-10-03T19:42:19.585139] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:19.641267] [DEBUG] [LOCAL ] JHX: Loaded 52271 existing records from primary storage. [2025-10-03T19:42:19.641604] [INFO ] [MAIN ] JHX: Loaded 52271 existing records. [2025-10-03T19:42:19.842344] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:19.843836] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-03T19:42:19.843911] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-03T19:42:19.844793] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-03T19:42:19.844853] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-03T19:42:20.001019] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-03T19:42:20.255274] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:20.790745] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-03T19:42:20.870015] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:42:21.230703] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:42:21.237038] [INFO ] [REMOTE ] JFR: Full fetch complete (48396 records). [2025-10-03T19:42:21.237268] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-03T19:42:21.595919] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-03T19:42:21.821136] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T19:42:21.867497] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-03T19:42:21.867591] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-03T19:42:21.868705] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-03T19:42:21.868789] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-03T19:42:21.870237] [DEBUG] [LOCAL ] JFR: Trimmed 48396 records to 31302 (keeping 200 days of data) [2025-10-03T19:42:22.082266] [DEBUG] [LOCAL ] JFR: Primary data saved (31302 records). [2025-10-03T19:42:22.082434] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-03T19:42:22.083154] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JFR took 42.8s. Estimated remaining: 2h 51m 1s. Rate: 7.1 symbols/min [2025-10-03T19:42:22.182906] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-03T19:42:22.291077] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:22.324208] [DEBUG] [LOCAL ] JILL: Loaded 16768 existing records from primary storage. [2025-10-03T19:42:22.324514] [INFO ] [MAIN ] JILL: Loaded 16768 existing records. [2025-10-03T19:42:22.392234] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-03T19:42:22.539052] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:22.539297] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-03T19:42:22.539383] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-03T19:42:22.539696] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-03T19:42:22.539756] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-03T19:42:22.964334] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:23.190721] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-03T19:42:23.977808] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:42:23.990610] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-03T19:42:24.026610] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-03T19:42:24.790735] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-03T19:42:25.353826] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-03T19:42:25.507165] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-03T19:42:25.511157] [INFO ] [REMOTE ] JHG: Full fetch complete (68281 records). [2025-10-03T19:42:25.511280] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-03T19:42:25.595906] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-03T19:42:25.935415] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-03T19:42:25.935502] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-03T19:42:25.936684] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-03T19:42:25.936763] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-03T19:42:25.938263] [DEBUG] [LOCAL ] JHG: Trimmed 68281 records to 48335 (keeping 200 days of data) [2025-10-03T19:42:26.236985] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T19:42:26.254698] [DEBUG] [LOCAL ] JHG: Primary data saved (48335 records). [2025-10-03T19:42:26.254877] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-03T19:42:26.255022] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 42.0s. Estimated remaining: 2h 50m 48s. Rate: 7.1 symbols/min [2025-10-03T19:42:26.402775] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-03T19:42:26.438343] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:26.481550] [DEBUG] [LOCAL ] JKS: Loaded 40360 existing records from primary storage. [2025-10-03T19:42:26.481891] [INFO ] [MAIN ] JKS: Loaded 40360 existing records. [2025-10-03T19:42:26.675897] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:42:26.676139] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-03T19:42:26.676190] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-03T19:42:26.676449] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-03T19:42:26.676510] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-03T19:42:27.060557] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:27.190711] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-03T19:42:27.385625] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-03T19:42:27.990730] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-03T19:42:28.010786] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:42:28.790718] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-03T19:42:28.957572] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-03T19:42:29.472132] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-03T19:42:29.590715] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-03T19:42:30.390712] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-03T19:42:30.850067] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-03T19:42:31.158686] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:42:31.190699] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-03T19:42:31.721044] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:42:31.721831] [INFO ] [REMOTE ] JHS: Full fetch complete (4478 records). [2025-10-03T19:42:31.721901] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-03T19:42:31.995915] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-03T19:42:32.121974] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-03T19:42:32.122095] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-03T19:42:32.122335] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-03T19:42:32.122400] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-03T19:42:32.122840] [DEBUG] [LOCAL ] JHS: Trimmed 4478 records to 2882 (keeping 200 days of data) [2025-10-03T19:42:32.141072] [DEBUG] [LOCAL ] JHS: Primary data saved (2882 records). [2025-10-03T19:42:32.141174] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-03T19:42:32.141255] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 22.9s. Estimated remaining: 2h 50m 37s. Rate: 7.1 symbols/min [2025-10-03T19:42:32.319103] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:42:32.319292] [DEBUG] [LOCAL ] JLL: No existing data file found in primary storage. [2025-10-03T19:42:32.319349] [WARN ] [MAIN ] JLL: No existing data found, performing full refresh instead. [2025-10-03T19:42:32.319486] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-03T19:42:32.319530] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-03T19:42:32.319575] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-10-03T19:42:32.319609] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-03T19:42:32.703953] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:42:32.790688] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-03T19:42:33.590630] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-03T19:42:33.629635] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:42:34.026694] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-03T19:42:34.390689] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-03T19:42:34.404937] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-03T19:42:35.190684] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-03T19:42:35.970843] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-03T19:42:35.990609] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-03T19:42:36.207675] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:42:36.790705] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-03T19:42:37.248748] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:42:37.590723] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-03T19:42:37.800816] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:42:38.390726] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-03T19:42:39.190710] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-03T19:42:39.300151] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:42:39.330403] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:42:39.990715] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-03T19:42:40.167700] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:42:40.790710] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-03T19:42:41.590709] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-03T19:42:41.697105] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-03T19:42:42.243030] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:42:42.390698] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-03T19:42:43.060322] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:42:43.190689] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-03T19:42:43.827179] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:42:43.990702] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-03T19:42:44.790631] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-03T19:42:44.897608] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-03T19:42:44.963882] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-03T19:42:45.590710] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-03T19:42:46.326681] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-03T19:42:46.390680] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-03T19:42:47.190688] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-03T19:42:47.481191] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-03T19:42:47.831730] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-03T19:42:47.990706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-03T19:42:48.795822] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-03T19:42:48.811216] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-03T19:42:49.104860] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:42:49.590671] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-03T19:42:49.742819] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-03T19:42:50.390872] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-03T19:42:51.190679] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-03T19:42:51.390259] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:42:51.422295] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-03T19:42:51.990718] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-03T19:42:52.790626] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-03T19:42:52.851615] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:42:52.853089] [INFO ] [REMOTE ] JILL: Full fetch complete (22749 records). [2025-10-03T19:42:52.853164] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-03T19:42:53.207304] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:42:53.301886] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-03T19:42:53.301967] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-03T19:42:53.302488] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-03T19:42:53.302554] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-03T19:42:53.303337] [DEBUG] [LOCAL ] JILL: Trimmed 22749 records to 16861 (keeping 200 days of data) [2025-10-03T19:42:53.414956] [DEBUG] [LOCAL ] JILL: Primary data saved (16861 records). [2025-10-03T19:42:53.415114] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-03T19:42:53.415234] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JILL took 31.3s. Estimated remaining: 2h 50m 42s. Rate: 7.1 symbols/min [2025-10-03T19:42:53.590697] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-03T19:42:54.214323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-03T19:42:54.390718] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-03T19:42:54.879281] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-03T19:42:54.882164] [INFO ] [REMOTE ] JHX: Full fetch complete (59134 records). [2025-10-03T19:42:54.882312] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-03T19:42:55.200227] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-03T19:42:55.358855] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-03T19:42:55.359056] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-03T19:42:55.360104] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-03T19:42:55.360178] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-03T19:42:55.361739] [DEBUG] [LOCAL ] JHX: Trimmed 59134 records to 52661 (keeping 200 days of data) [2025-10-03T19:42:55.703766] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-03T19:42:55.736084] [DEBUG] [LOCAL ] JHX: Primary data saved (52661 records). [2025-10-03T19:42:55.736246] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-03T19:42:55.736366] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JHX took 36.3s. Estimated remaining: 2h 50m 27s. Rate: 7.1 symbols/min [2025-10-03T19:42:55.990695] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-03T19:42:56.713261] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:42:56.790720] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-03T19:42:57.359305] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:42:57.590733] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-03T19:42:58.323312] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:42:58.390621] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-03T19:42:59.021365] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-03T19:42:59.190741] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-03T19:42:59.728607] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-03T19:42:59.990744] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-03T19:43:00.608506] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:43:00.790706] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-03T19:43:01.536592] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:43:01.590694] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-03T19:43:01.724219] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-03T19:43:01.725937] [INFO ] [REMOTE ] JLL: Full fetch complete (44754 records). [2025-10-03T19:43:01.726050] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-03T19:43:02.195238] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-03T19:43:02.195318] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-03T19:43:02.196141] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-03T19:43:02.196215] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-03T19:43:02.198128] [DEBUG] [LOCAL ] JLL: Trimmed 44754 records to 31853 (keeping 200 days of data) [2025-10-03T19:43:02.404499] [DEBUG] [LOCAL ] JLL: Primary data saved (31853 records). [2025-10-03T19:43:02.404668] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-03T19:43:02.404764] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JLL took 30.3s. Estimated remaining: 2h 50m 17s. Rate: 7.1 symbols/min [2025-10-03T19:43:02.951606] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-03T19:43:02.954803] [INFO ] [REMOTE ] JKS: Full fetch complete (58921 records). [2025-10-03T19:43:02.954943] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-03T19:43:03.360026] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-03T19:43:03.360122] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-03T19:43:03.361320] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-03T19:43:03.361409] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-03T19:43:03.362861] [DEBUG] [LOCAL ] JKS: Trimmed 58921 records to 40657 (keeping 200 days of data) [2025-10-03T19:43:03.621209] [DEBUG] [LOCAL ] JKS: Primary data saved (40657 records). [2025-10-03T19:43:03.621368] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-03T19:43:03.621486] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JKS took 37.4s. Estimated remaining: 2h 50m 1s. Rate: 7.1 symbols/min [2025-10-03T19:43:04.313358] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.307421] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.371011] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.385130] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-03T19:43:04.406104] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:04.406421] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-03T19:43:04.406791] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-03T19:43:04.406962] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-03T19:43:04.407032] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-03T19:43:04.407069] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-03T19:43:04.509460] [DEBUG] [LOCAL ] JLS: Loaded 4162 existing records from primary storage. [2025-10-03T19:43:04.540503] [INFO ] [MAIN ] JLS: Loaded 4162 existing records. [2025-10-03T19:43:04.838557] [DEBUG] [LOCAL ] JMIA: Loaded 51046 existing records from primary storage. [2025-10-03T19:43:04.899458] [INFO ] [MAIN ] JMIA: Loaded 51046 existing records. [2025-10-03T19:43:05.018668] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.024607] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.052696] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-03T19:43:04.988026] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-10-03T19:43:05.112525] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-03T19:43:05.125439] [INFO ] [MAIN ] JNJ: Loaded 54143 existing records. [2025-10-03T19:43:05.136344] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-03T19:43:05.131013] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:05.204878] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-03T19:43:05.597308] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.634287] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.649670] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-03T19:43:05.700085] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:05.736878] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-03T19:43:05.742313] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-03T19:43:05.736629] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-03T19:43:05.762398] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-03T19:43:05.783587] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-03T19:43:05.783530] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-03T19:43:06.069175] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:43:06.140695] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-03T19:43:06.184106] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.259483] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-03T19:43:06.636087] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.664358] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-03T19:43:06.649677] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-03T19:43:06.680293] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-03T19:43:06.714076] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:06.714581] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-03T19:43:07.060183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-03T19:43:07.175441] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-03T19:43:07.190681] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-03T19:43:07.520819] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-03T19:43:07.990740] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-03T19:43:08.548015] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:43:08.567092] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T19:43:08.790714] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-03T19:43:09.210566] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-10-03T19:43:09.225941] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-03T19:43:09.590715] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-03T19:43:10.390718] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-03T19:43:10.963829] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-03T19:43:11.190675] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-03T19:43:11.920460] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-10-03T19:43:11.947878] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-03T19:43:11.990700] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-03T19:43:12.445875] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-03T19:43:12.790714] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-03T19:43:13.590707] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-03T19:43:14.222393] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-03T19:43:14.390707] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-03T19:43:14.544576] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:43:15.052772] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-03T19:43:15.190726] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-03T19:43:15.990717] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-03T19:43:16.790681] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-03T19:43:17.277725] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-03T19:43:17.309886] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-03T19:43:17.590635] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-03T19:43:17.656526] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:43:18.065342] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T19:43:18.390722] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-03T19:43:19.190728] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-03T19:43:19.990682] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-03T19:43:20.262011] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-03T19:43:20.429172] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-03T19:43:20.790698] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-03T19:43:21.434096] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-03T19:43:21.590730] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-03T19:43:21.884592] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-03T19:43:22.187637] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-03T19:43:22.390692] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-03T19:43:23.190687] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-03T19:43:23.839417] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:43:23.840200] [INFO ] [REMOTE ] JMM: Full fetch complete (2323 records). [2025-10-03T19:43:23.840270] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-03T19:43:23.990987] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-03T19:43:24.037158] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-03T19:43:24.037437] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:43:24.037584] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:43:24.037754] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-03T19:43:24.037905] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-03T19:43:24.037983] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-03T19:43:24.038182] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-03T19:43:24.038290] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 20.4s. Estimated remaining: 2h 50m 5s. Rate: 7.1 symbols/min [2025-10-03T19:43:24.227346] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:24.259542] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:43:24.326768] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-10-03T19:43:24.327253] [INFO ] [MAIN ] JOBY: Loaded 54189 existing records. [2025-10-03T19:43:24.525281] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:24.525569] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-03T19:43:24.525670] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-03T19:43:24.526034] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-03T19:43:24.526107] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-03T19:43:24.756018] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-03T19:43:24.795829] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-03T19:43:24.983416] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:25.590691] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-03T19:43:26.227745] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-03T19:43:26.390689] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-03T19:43:26.696062] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-03T19:43:26.941462] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-03T19:43:27.190687] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-03T19:43:27.990722] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-03T19:43:28.790690] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-03T19:43:29.132628] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-03T19:43:29.590772] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-03T19:43:30.200780] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-03T19:43:30.390749] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-03T19:43:30.546162] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-03T19:43:30.621342] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-03T19:43:30.979791] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:43:30.980702] [INFO ] [REMOTE ] JLS: Full fetch complete (5841 records). [2025-10-03T19:43:30.980788] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-03T19:43:31.195845] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-03T19:43:31.390253] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-03T19:43:31.390372] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-03T19:43:31.390562] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-03T19:43:31.390605] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-03T19:43:31.391065] [DEBUG] [LOCAL ] JLS: Trimmed 5841 records to 4193 (keeping 200 days of data) [2025-10-03T19:43:31.418536] [DEBUG] [LOCAL ] JLS: Primary data saved (4193 records). [2025-10-03T19:43:31.418700] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-03T19:43:31.418817] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JLS took 27.8s. Estimated remaining: 2h 49m 55s. Rate: 7.1 symbols/min [2025-10-03T19:43:31.605350] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:31.629951] [DEBUG] [LOCAL ] JOE: Loaded 24297 existing records from primary storage. [2025-10-03T19:43:31.630232] [INFO ] [MAIN ] JOE: Loaded 24297 existing records. [2025-10-03T19:43:31.836184] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:31.836424] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-03T19:43:31.836472] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-03T19:43:31.836800] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-03T19:43:31.836862] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-03T19:43:31.992178] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-03T19:43:32.217301] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:32.790718] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-03T19:43:33.590683] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-03T19:43:33.871871] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-10-03T19:43:34.080409] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-03T19:43:34.390635] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-03T19:43:34.714085] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-03T19:43:34.908976] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-03T19:43:35.190688] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-03T19:43:35.990697] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-03T19:43:36.790709] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-03T19:43:36.829236] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-10-03T19:43:37.590718] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-03T19:43:37.832982] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-10-03T19:43:37.984508] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-03T19:43:38.110625] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:43:38.390688] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-03T19:43:39.190699] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-03T19:43:39.535548] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:43:39.820390] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-03T19:43:39.990692] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-03T19:43:40.790686] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-03T19:43:41.590634] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-03T19:43:41.763623] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-10-03T19:43:41.884702] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-03T19:43:41.887456] [INFO ] [REMOTE ] JMIA: Full fetch complete (73273 records). [2025-10-03T19:43:41.887570] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-03T19:43:42.313250] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:43:42.345397] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-03T19:43:42.345499] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-03T19:43:42.346724] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-03T19:43:42.346801] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-03T19:43:42.348473] [DEBUG] [LOCAL ] JMIA: Trimmed 73273 records to 51428 (keeping 200 days of data) [2025-10-03T19:43:42.394245] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-03T19:43:42.665881] [DEBUG] [LOCAL ] JMIA: Primary data saved (51428 records). [2025-10-03T19:43:42.666046] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-03T19:43:42.666157] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JMIA took 39.0s. Estimated remaining: 2h 49m 50s. Rate: 7.1 symbols/min [2025-10-03T19:43:42.851066] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:42.860464] [DEBUG] [LOCAL ] JOF: Loaded 7036 existing records from primary storage. [2025-10-03T19:43:42.860699] [INFO ] [MAIN ] JOF: Loaded 7036 existing records. [2025-10-03T19:43:43.062733] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:43.062971] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-03T19:43:43.063024] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-03T19:43:43.063223] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-03T19:43:43.063283] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-03T19:43:43.194307] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-03T19:43:43.486119] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:43.770569] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:43:43.791378] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-10-03T19:43:43.990676] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-03T19:43:44.790639] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-03T19:43:44.965363] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-03T19:43:45.590776] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-03T19:43:45.794216] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-03T19:43:46.390713] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-03T19:43:46.732369] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-03T19:43:46.988537] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:43:46.994862] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-03T19:43:47.190728] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-03T19:43:47.990714] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-03T19:43:48.790731] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-03T19:43:49.101714] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-03T19:43:49.410759] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-03T19:43:49.590726] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-03T19:43:50.390706] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-03T19:43:50.811357] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-03T19:43:50.820369] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-03T19:43:50.831339] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-03T19:43:50.832113] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-03T19:43:51.195835] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-03T19:43:51.295486] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-03T19:43:51.295617] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-03T19:43:51.296917] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-03T19:43:51.296989] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-03T19:43:51.298757] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54533 (keeping 200 days of data) [2025-10-03T19:43:51.673891] [DEBUG] [LOCAL ] JNJ: Primary data saved (54533 records). [2025-10-03T19:43:51.674047] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-03T19:43:51.674153] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JNJ took 48.0s. Estimated remaining: 2h 49m 42s. Rate: 7.1 symbols/min [2025-10-03T19:43:51.871949] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:51.908398] [DEBUG] [LOCAL ] JPC: Loaded 37383 existing records from primary storage. [2025-10-03T19:43:51.908733] [INFO ] [MAIN ] JPC: Loaded 37383 existing records. [2025-10-03T19:43:51.995861] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-03T19:43:52.106054] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:52.106293] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-03T19:43:52.106346] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-03T19:43:52.106710] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-03T19:43:52.106773] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-03T19:43:52.499482] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T19:43:52.570115] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:52.608375] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T19:43:52.790630] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-03T19:43:52.867670] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T19:43:53.590639] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-03T19:43:53.919405] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-03T19:43:54.390759] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-03T19:43:55.190665] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-03T19:43:55.334066] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-03T19:43:55.335564] [INFO ] [REMOTE ] JOE: Full fetch complete (36027 records). [2025-10-03T19:43:55.335673] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-03T19:43:55.750771] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-03T19:43:55.750864] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-03T19:43:55.751680] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-03T19:43:55.751764] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-03T19:43:55.752809] [DEBUG] [LOCAL ] JOE: Trimmed 36027 records to 24485 (keeping 200 days of data) [2025-10-03T19:43:55.922672] [DEBUG] [LOCAL ] JOE: Primary data saved (24485 records). [2025-10-03T19:43:55.923831] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-03T19:43:55.925974] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-03T19:43:55.926838] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOE took 24.5s. Estimated remaining: 2h 49m 29s. Rate: 7.1 symbols/min [2025-10-03T19:43:55.991081] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-03T19:43:56.126011] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:43:56.186714] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-10-03T19:43:56.187052] [INFO ] [MAIN ] JPM: Loaded 54184 existing records. [2025-10-03T19:43:56.381203] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:43:56.381490] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-03T19:43:56.381593] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-03T19:43:56.382080] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-03T19:43:56.382179] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-03T19:43:56.537819] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-10-03T19:43:56.793046] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-03T19:43:56.832713] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:43:56.851358] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-03T19:43:57.590741] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-03T19:43:58.390696] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-03T19:43:59.190721] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-03T19:43:59.580415] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-10-03T19:43:59.643674] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T19:43:59.801717] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T19:43:59.997186] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-03T19:44:00.005014] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:44:00.500949] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-03T19:44:00.790720] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-03T19:44:01.583520] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-03T19:44:01.590631] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-03T19:44:02.390703] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-03T19:44:02.407678] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:44:03.190715] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-03T19:44:03.802605] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-03T19:44:03.990691] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-03T19:44:04.790690] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-03T19:44:05.503918] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:44:05.590769] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-03T19:44:05.891989] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.70 seconds). [2025-10-03T19:44:06.390694] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-03T19:44:06.900372] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-03T19:44:06.938134] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-03T19:44:07.039888] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-03T19:44:07.190711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-03T19:44:07.990774] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-03T19:44:08.524056] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-03T19:44:08.525004] [INFO ] [REMOTE ] JOF: Full fetch complete (9464 records). [2025-10-03T19:44:08.525079] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-03T19:44:08.811608] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-03T19:44:08.936204] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:44:08.989329] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-03T19:44:08.989413] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-03T19:44:08.989696] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-03T19:44:08.989761] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-03T19:44:08.990307] [DEBUG] [LOCAL ] JOF: Trimmed 9464 records to 7072 (keeping 200 days of data) [2025-10-03T19:44:09.040482] [DEBUG] [LOCAL ] JOF: Primary data saved (7072 records). [2025-10-03T19:44:09.040883] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-03T19:44:09.041015] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOF took 26.4s. Estimated remaining: 2h 49m 25s. Rate: 7.1 symbols/min [2025-10-03T19:44:09.233679] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:09.280982] [DEBUG] [LOCAL ] JQC: Loaded 34592 existing records from primary storage. [2025-10-03T19:44:09.281381] [INFO ] [MAIN ] JQC: Loaded 34592 existing records. [2025-10-03T19:44:09.492778] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:09.493033] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-03T19:44:09.493084] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-03T19:44:09.493311] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-03T19:44:09.493370] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-03T19:44:09.599525] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-03T19:44:09.880306] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:10.390710] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-03T19:44:11.190632] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-03T19:44:11.448067] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-03T19:44:11.451413] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-03T19:44:11.451595] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-03T19:44:11.912378] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-03T19:44:11.913068] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-03T19:44:11.914412] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-03T19:44:11.914610] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-03T19:44:11.949940] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:44:11.955355] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54579 (keeping 200 days of data) [2025-10-03T19:44:11.979287] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T19:44:12.037872] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-03T19:44:12.332748] [DEBUG] [LOCAL ] JOBY: Primary data saved (54579 records). [2025-10-03T19:44:12.332905] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-03T19:44:12.333006] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 48.3s. Estimated remaining: 2h 49m 12s. Rate: 7.1 symbols/min [2025-10-03T19:44:12.530612] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:12.557308] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-03T19:44:12.580129] [DEBUG] [LOCAL ] JRI: Loaded 14997 existing records from primary storage. [2025-10-03T19:44:12.580437] [INFO ] [MAIN ] JRI: Loaded 14997 existing records. [2025-10-03T19:44:12.781582] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:12.781851] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-03T19:44:12.781905] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-03T19:44:12.782144] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-03T19:44:12.782205] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-03T19:44:12.795799] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-03T19:44:13.191838] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:13.401177] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:44:13.590738] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-03T19:44:14.390711] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-03T19:44:15.102988] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:44:15.190701] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-03T19:44:15.370145] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:44:15.501214] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-10-03T19:44:15.990730] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-03T19:44:16.611718] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-03T19:44:16.790690] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-03T19:44:17.431904] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:44:17.590690] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-03T19:44:18.073288] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:44:18.390713] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-03T19:44:18.660072] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-03T19:44:19.190704] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-03T19:44:19.990679] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-03T19:44:20.124985] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:44:20.790681] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-03T19:44:21.043061] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-10-03T19:44:21.293289] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-03T19:44:21.590748] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-03T19:44:21.784903] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-03T19:44:22.390728] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-03T19:44:22.764489] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:44:22.767979] [INFO ] [REMOTE ] JPC: Full fetch complete (55633 records). [2025-10-03T19:44:22.768381] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-03T19:44:23.197679] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-03T19:44:23.378296] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-03T19:44:23.378419] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-03T19:44:23.380387] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-03T19:44:23.380478] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-03T19:44:23.382408] [DEBUG] [LOCAL ] JPC: Trimmed 55633 records to 37668 (keeping 200 days of data) [2025-10-03T19:44:23.650762] [DEBUG] [LOCAL ] JPC: Primary data saved (37668 records). [2025-10-03T19:44:23.650918] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-03T19:44:23.651029] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 32.0s. Estimated remaining: 2h 49m 6s. Rate: 7.1 symbols/min [2025-10-03T19:44:23.841663] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:23.855067] [DEBUG] [LOCAL ] JRS: Loaded 11452 existing records from primary storage. [2025-10-03T19:44:23.855313] [INFO ] [MAIN ] JRS: Loaded 11452 existing records. [2025-10-03T19:44:24.004248] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-03T19:44:24.054834] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:24.055181] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-03T19:44:24.055294] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-03T19:44:24.055501] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-03T19:44:24.055562] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-03T19:44:24.476159] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:24.651454] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-03T19:44:24.790717] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-03T19:44:24.835405] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-03T19:44:25.076134] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-03T19:44:25.590805] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-03T19:44:26.216664] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-03T19:44:26.376883] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T19:44:26.390631] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-03T19:44:26.997988] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-03T19:44:27.190706] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-03T19:44:27.990722] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-03T19:44:28.790728] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-03T19:44:29.187256] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-03T19:44:29.375850] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-03T19:44:29.557265] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-03T19:44:29.590733] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-03T19:44:30.390683] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-03T19:44:30.618121] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-03T19:44:31.190738] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-03T19:44:31.837438] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-03T19:44:31.990703] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-03T19:44:32.323347] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:44:32.790711] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-03T19:44:33.292740] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-03T19:44:33.536836] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-03T19:44:33.590680] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-03T19:44:34.390718] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-03T19:44:34.519450] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:44:35.190720] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-03T19:44:35.776832] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:44:35.990704] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-03T19:44:36.005959] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-03T19:44:36.790676] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-03T19:44:36.812736] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-03T19:44:37.590690] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-03T19:44:38.062699] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-03T19:44:38.065177] [INFO ] [REMOTE ] JQC: Full fetch complete (49420 records). [2025-10-03T19:44:38.065285] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-03T19:44:38.395772] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-03T19:44:38.487683] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-03T19:44:38.487822] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-03T19:44:38.488747] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-03T19:44:38.488814] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-03T19:44:38.490057] [DEBUG] [LOCAL ] JQC: Trimmed 49420 records to 34960 (keeping 200 days of data) [2025-10-03T19:44:38.706922] [DEBUG] [LOCAL ] JQC: Primary data saved (34960 records). [2025-10-03T19:44:38.707090] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-03T19:44:38.707181] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JQC took 29.7s. Estimated remaining: 2h 49m 4s. Rate: 7.1 symbols/min [2025-10-03T19:44:38.904685] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:38.955028] [DEBUG] [LOCAL ] JXN: Loaded 45845 existing records from primary storage. [2025-10-03T19:44:38.955399] [INFO ] [MAIN ] JXN: Loaded 45845 existing records. [2025-10-03T19:44:39.145204] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:39.145476] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-03T19:44:39.145526] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-03T19:44:39.145797] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-03T19:44:39.145866] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-03T19:44:39.203553] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-03T19:44:39.541920] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:39.543188] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-03T19:44:39.990676] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-03T19:44:40.047899] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-03T19:44:40.110770] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-10-03T19:44:40.790629] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-03T19:44:40.861621] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-03T19:44:40.863122] [INFO ] [REMOTE ] JRI: Full fetch complete (23330 records). [2025-10-03T19:44:40.863212] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-03T19:44:41.279761] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-03T19:44:41.279851] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-03T19:44:41.280332] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-03T19:44:41.280424] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-03T19:44:41.281329] [DEBUG] [LOCAL ] JRI: Trimmed 23330 records to 15135 (keeping 200 days of data) [2025-10-03T19:44:41.378395] [DEBUG] [LOCAL ] JRI: Primary data saved (15135 records). [2025-10-03T19:44:41.378553] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-03T19:44:41.378680] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRI took 29.0s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-10-03T19:44:41.563245] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:41.591808] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-03T19:44:41.615687] [DEBUG] [LOCAL ] K: Loaded 50366 existing records from primary storage. [2025-10-03T19:44:41.616065] [INFO ] [MAIN ] K: Loaded 50366 existing records. [2025-10-03T19:44:41.808932] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:41.809241] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-03T19:44:41.809320] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-03T19:44:41.809632] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-03T19:44:41.809732] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-03T19:44:42.204177] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:42.390721] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-03T19:44:43.114318] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T19:44:43.157043] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:44:43.190632] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-03T19:44:43.983355] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-03T19:44:43.993638] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-03T19:44:44.723405] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-03T19:44:44.790696] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-03T19:44:44.847937] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-03T19:44:45.590734] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-03T19:44:46.390739] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-03T19:44:47.188891] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-03T19:44:47.189478] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:44:47.209200] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-03T19:44:47.264481] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-10-03T19:44:47.990725] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-03T19:44:48.596040] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-03T19:44:48.790741] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-03T19:44:48.906589] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:44:49.590766] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-03T19:44:50.390675] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-03T19:44:50.511489] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-03T19:44:50.728111] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-03T19:44:51.176442] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:44:51.190622] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-03T19:44:51.970367] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-03T19:44:51.990691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-03T19:44:52.790715] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-03T19:44:53.590731] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-03T19:44:53.623712] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-03T19:44:54.390716] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-03T19:44:55.051894] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T19:44:55.054893] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-03T19:44:55.055065] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-03T19:44:55.195787] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-03T19:44:55.266436] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-03T19:44:55.309327] [INFO ] [REMOTE ] JRS: Full fetch complete (16367 records). [2025-10-03T19:44:55.334390] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-03T19:44:55.741190] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-03T19:44:55.763370] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-03T19:44:55.781725] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-03T19:44:55.792726] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-03T19:44:55.884945] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54574 (keeping 200 days of data) [2025-10-03T19:44:55.980923] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-03T19:44:55.984200] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-03T19:44:55.985093] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-03T19:44:55.985233] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-03T19:44:55.989183] [DEBUG] [LOCAL ] JRS: Trimmed 16367 records to 11561 (keeping 200 days of data) [2025-10-03T19:44:55.988632] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-10-03T19:44:56.100831] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-03T19:44:56.195708] [DEBUG] [LOCAL ] JRS: Primary data saved (11561 records). [2025-10-03T19:44:56.196444] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-03T19:44:56.196929] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JRS took 32.5s. Estimated remaining: 2h 48m 48s. Rate: 7.1 symbols/min [2025-10-03T19:44:56.396360] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:56.506319] [DEBUG] [LOCAL ] KAI: Loaded 13381 existing records from primary storage. [2025-10-03T19:44:56.507196] [INFO ] [MAIN ] KAI: Loaded 13381 existing records. [2025-10-03T19:44:56.725290] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:56.728943] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-03T19:44:56.729446] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-03T19:44:56.730404] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-03T19:44:56.731720] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-03T19:44:57.164849] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:57.166021] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-03T19:44:57.267906] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-03T19:44:57.307548] [DEBUG] [LOCAL ] JPM: Primary data saved (54574 records). [2025-10-03T19:44:57.307755] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-03T19:44:57.308614] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JPM took 1m 1s. Estimated remaining: 2h 48m 32s. Rate: 7.1 symbols/min [2025-10-03T19:44:57.495760] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:44:57.551953] [DEBUG] [LOCAL ] KAR: Loaded 40252 existing records from primary storage. [2025-10-03T19:44:57.552377] [INFO ] [MAIN ] KAR: Loaded 40252 existing records. [2025-10-03T19:44:57.600687] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-03T19:44:57.754737] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:44:57.755556] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-03T19:44:57.755618] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-03T19:44:57.755974] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-03T19:44:57.756035] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-03T19:44:58.159001] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:44:58.191598] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-03T19:44:58.211926] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-03T19:44:58.390694] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-03T19:44:59.187458] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-03T19:44:59.190601] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-03T19:44:59.431556] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:44:59.990703] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-03T19:45:00.184835] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-03T19:45:00.790700] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-03T19:45:01.590746] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-03T19:45:01.876056] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:45:02.209853] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:45:02.390728] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-03T19:45:03.190630] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-03T19:45:03.287981] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:45:03.990723] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-03T19:45:04.121696] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:45:04.239510] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-03T19:45:04.790716] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-03T19:45:05.590719] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-03T19:45:05.651741] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-03T19:45:06.390708] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-03T19:45:06.683470] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:45:07.060764] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:45:07.190743] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-03T19:45:07.935893] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-03T19:45:07.990689] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-03T19:45:08.584273] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-03T19:45:08.790705] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-03T19:45:09.391555] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:45:09.393901] [INFO ] [REMOTE ] JXN: Full fetch complete (65212 records). [2025-10-03T19:45:09.394033] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-03T19:45:09.597372] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-03T19:45:09.836541] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-03T19:45:09.836677] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-03T19:45:09.837842] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-03T19:45:09.837910] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-03T19:45:09.839367] [DEBUG] [LOCAL ] JXN: Trimmed 65212 records to 46137 (keeping 200 days of data) [2025-10-03T19:45:10.153360] [DEBUG] [LOCAL ] JXN: Primary data saved (46137 records). [2025-10-03T19:45:10.153514] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-03T19:45:10.153638] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. JXN took 31.4s. Estimated remaining: 2h 48m 28s. Rate: 7.1 symbols/min [2025-10-03T19:45:10.356881] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:10.381088] [DEBUG] [LOCAL ] KB: Loaded 24074 existing records from primary storage. [2025-10-03T19:45:10.381485] [INFO ] [MAIN ] KB: Loaded 24074 existing records. [2025-10-03T19:45:10.399498] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-03T19:45:10.620024] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:10.622761] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-03T19:45:10.622929] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-03T19:45:10.623078] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-03T19:45:10.635530] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-03T19:45:10.635631] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-03T19:45:11.030455] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:11.130770] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-03T19:45:11.190700] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-03T19:45:11.618035] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:45:11.990731] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-03T19:45:12.587357] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:45:12.790714] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-03T19:45:13.590638] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-03T19:45:13.786887] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:45:13.897063] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-03T19:45:14.390715] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-03T19:45:15.128236] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-03T19:45:15.190742] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-03T19:45:15.902562] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-03T19:45:15.911502] [INFO ] [REMOTE ] K: Full fetch complete (72103 records). [2025-10-03T19:45:15.911825] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-03T19:45:16.003900] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-03T19:45:16.467039] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-03T19:45:16.467214] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-03T19:45:16.468671] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-03T19:45:16.468767] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-03T19:45:16.470501] [DEBUG] [LOCAL ] K: Trimmed 72103 records to 50735 (keeping 200 days of data) [2025-10-03T19:45:16.795887] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-03T19:45:16.803578] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:45:16.832547] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-03T19:45:16.933206] [DEBUG] [LOCAL ] K: Primary data saved (50735 records). [2025-10-03T19:45:16.933359] [INFO ] [MAIN ] K: Full history saved. [2025-10-03T19:45:16.933477] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. K took 35.6s. Estimated remaining: 2h 48m 18s. Rate: 7.1 symbols/min [2025-10-03T19:45:17.115472] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:17.138249] [DEBUG] [LOCAL ] KBDC: Loaded 21392 existing records from primary storage. [2025-10-03T19:45:17.138525] [INFO ] [MAIN ] KBDC: Loaded 21392 existing records. [2025-10-03T19:45:17.334384] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:17.334680] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-03T19:45:17.334743] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-03T19:45:17.334961] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-03T19:45:17.335022] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-03T19:45:17.594623] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-03T19:45:17.753890] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:17.764832] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:45:18.390711] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-03T19:45:19.075498] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-03T19:45:19.190685] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-03T19:45:19.253540] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:45:19.990697] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-03T19:45:20.126463] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:45:20.790667] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-03T19:45:21.123914] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-03T19:45:21.590689] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-03T19:45:21.646547] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-03T19:45:22.390711] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-03T19:45:23.082226] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T19:45:23.103116] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-03T19:45:23.190676] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-03T19:45:23.990748] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-03T19:45:24.626200] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-03T19:45:24.678983] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-03T19:45:24.790705] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-03T19:45:25.590723] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-03T19:45:26.371590] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-03T19:45:26.390616] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-03T19:45:26.417477] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:45:26.418870] [INFO ] [REMOTE ] KAI: Full fetch complete (18852 records). [2025-10-03T19:45:26.418969] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-03T19:45:26.836003] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-03T19:45:26.836099] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-03T19:45:26.836555] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-03T19:45:26.836602] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-03T19:45:26.837381] [DEBUG] [LOCAL ] KAI: Trimmed 18852 records to 13475 (keeping 200 days of data) [2025-10-03T19:45:26.926231] [DEBUG] [LOCAL ] KAI: Primary data saved (13475 records). [2025-10-03T19:45:26.926388] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-03T19:45:26.926500] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. KAI took 30.7s. Estimated remaining: 2h 48m 11s. Rate: 7.1 symbols/min [2025-10-03T19:45:27.120975] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:27.171580] [DEBUG] [LOCAL ] KBH: Loaded 49218 existing records from primary storage. [2025-10-03T19:45:27.172001] [INFO ] [MAIN ] KBH: Loaded 49218 existing records. [2025-10-03T19:45:27.195817] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-03T19:45:27.370091] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:27.370330] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-03T19:45:27.370380] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-03T19:45:27.370688] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-03T19:45:27.370747] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-03T19:45:27.763315] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:27.769046] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-03T19:45:27.771356] [INFO ] [REMOTE ] KAR: Full fetch complete (56882 records). [2025-10-03T19:45:27.771445] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-03T19:45:27.999319] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-03T19:45:28.133717] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-03T19:45:28.234190] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-03T19:45:28.234284] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-03T19:45:28.235372] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-03T19:45:28.235442] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-03T19:45:28.236875] [DEBUG] [LOCAL ] KAR: Trimmed 56882 records to 40570 (keeping 200 days of data) [2025-10-03T19:45:28.481240] [DEBUG] [LOCAL ] KAR: Primary data saved (40570 records). [2025-10-03T19:45:28.481371] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-03T19:45:28.482068] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 31.2s. Estimated remaining: 2h 47m 56s. Rate: 7.1 symbols/min [2025-10-03T19:45:28.665205] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:28.722174] [DEBUG] [LOCAL ] KBR: Loaded 48339 existing records from primary storage. [2025-10-03T19:45:28.722773] [INFO ] [MAIN ] KBR: Loaded 48339 existing records. [2025-10-03T19:45:28.795831] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-03T19:45:28.927500] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:28.927778] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-03T19:45:28.927833] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-03T19:45:28.928238] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-03T19:45:28.928300] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-03T19:45:29.324075] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:29.590631] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-03T19:45:29.790908] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:45:30.086107] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-03T19:45:30.343682] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-03T19:45:30.390705] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-03T19:45:31.190699] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-03T19:45:31.262260] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-03T19:45:31.990741] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-03T19:45:32.790637] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-03T19:45:32.885261] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:45:33.084775] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-03T19:45:33.590711] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-03T19:45:33.938234] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-03T19:45:34.337563] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-03T19:45:34.390690] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-03T19:45:35.190697] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-03T19:45:35.999543] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-03T19:45:36.019494] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:45:36.553988] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:45:36.790729] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-03T19:45:37.592166] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-03T19:45:37.595531] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:45:38.390695] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-03T19:45:38.555348] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:45:38.721088] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:45:39.190686] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-03T19:45:39.468298] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-03T19:45:39.990696] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-03T19:45:40.790697] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-03T19:45:40.949267] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:45:41.567691] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:45:41.590629] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-03T19:45:41.619263] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-03T19:45:42.390697] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-03T19:45:42.946894] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-03T19:45:43.190699] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-03T19:45:43.991366] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-03T19:45:43.997062] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:45:44.535963] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-03T19:45:44.790739] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-03T19:45:44.888339] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-03T19:45:45.590724] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-03T19:45:46.374529] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-03T19:45:46.390620] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-03T19:45:46.791052] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-03T19:45:47.190716] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-03T19:45:47.990735] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-03T19:45:48.149381] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-03T19:45:48.151755] [INFO ] [REMOTE ] KBDC: Full fetch complete (29024 records). [2025-10-03T19:45:48.151848] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-03T19:45:48.394124] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T19:45:48.622155] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-03T19:45:48.622256] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-03T19:45:48.622952] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-03T19:45:48.623029] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-03T19:45:48.623884] [DEBUG] [LOCAL ] KBDC: Trimmed 29024 records to 21640 (keeping 200 days of data) [2025-10-03T19:45:48.763746] [DEBUG] [LOCAL ] KBDC: Primary data saved (21640 records). [2025-10-03T19:45:48.763886] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-03T19:45:48.763994] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KBDC took 31.8s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-10-03T19:45:48.795845] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-03T19:45:48.955093] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:49.009548] [DEBUG] [LOCAL ] KD: Loaded 52682 existing records from primary storage. [2025-10-03T19:45:49.009969] [INFO ] [MAIN ] KD: Loaded 52682 existing records. [2025-10-03T19:45:49.208264] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:49.208510] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-03T19:45:49.208560] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-03T19:45:49.208862] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-03T19:45:49.208930] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-03T19:45:49.592902] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-03T19:45:49.592760] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:49.637081] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-03T19:45:50.390635] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-03T19:45:50.561087] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-03T19:45:50.653626] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:45:51.190685] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-03T19:45:51.990669] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-03T19:45:52.032188] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:45:52.033493] [INFO ] [REMOTE ] KB: Full fetch complete (33957 records). [2025-10-03T19:45:52.033585] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-03T19:45:52.492987] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-03T19:45:52.493826] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-03T19:45:52.495857] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-03T19:45:52.496786] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-03T19:45:52.496874] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-03T19:45:52.514108] [DEBUG] [LOCAL ] KB: Trimmed 33957 records to 24181 (keeping 200 days of data) [2025-10-03T19:45:52.690170] [DEBUG] [LOCAL ] KB: Primary data saved (24181 records). [2025-10-03T19:45:52.690315] [INFO ] [MAIN ] KB: Full history saved. [2025-10-03T19:45:52.690435] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KB took 42.5s. Estimated remaining: 2h 47m 46s. Rate: 7.1 symbols/min [2025-10-03T19:45:52.798985] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-03T19:45:52.884839] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:45:52.893124] [DEBUG] [LOCAL ] KEN: Loaded 4749 existing records from primary storage. [2025-10-03T19:45:52.893386] [INFO ] [MAIN ] KEN: Loaded 4749 existing records. [2025-10-03T19:45:53.081973] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:45:53.082216] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-03T19:45:53.082269] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-03T19:45:53.082498] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-03T19:45:53.082600] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-03T19:45:53.469122] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:45:53.590721] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-03T19:45:53.689964] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T19:45:54.061161] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-03T19:45:54.390720] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-03T19:45:55.190606] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:45:55.190741] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-03T19:45:55.781874] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:45:55.990725] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-03T19:45:56.123808] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-03T19:45:56.554725] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-03T19:45:56.790730] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-03T19:45:57.176370] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-03T19:45:57.590722] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-03T19:45:58.390737] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-03T19:45:59.190677] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-03T19:45:59.311376] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:45:59.968216] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:45:59.970706] [INFO ] [REMOTE ] KBH: Full fetch complete (70719 records). [2025-10-03T19:45:59.970807] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-03T19:45:59.995871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-03T19:46:00.402408] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-03T19:46:00.402493] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-03T19:46:00.403484] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-03T19:46:00.403550] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-03T19:46:00.405250] [DEBUG] [LOCAL ] KBH: Trimmed 70719 records to 49576 (keeping 200 days of data) [2025-10-03T19:46:00.733628] [DEBUG] [LOCAL ] KBH: Primary data saved (49576 records). [2025-10-03T19:46:00.733864] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-03T19:46:00.734010] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KBH took 33.8s. Estimated remaining: 2h 47m 38s. Rate: 7.1 symbols/min [2025-10-03T19:46:00.795787] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-03T19:46:00.796044] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-03T19:46:00.947565] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:00.979449] [DEBUG] [LOCAL ] KEP: Loaded 31283 existing records from primary storage. [2025-10-03T19:46:00.979765] [INFO ] [MAIN ] KEP: Loaded 31283 existing records. [2025-10-03T19:46:01.180158] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:01.180561] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-03T19:46:01.180715] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-03T19:46:01.181151] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-03T19:46:01.181325] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-03T19:46:01.394086] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-03T19:46:01.597155] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-03T19:46:01.643817] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:02.332688] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:46:02.390725] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-03T19:46:02.517760] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-03T19:46:03.190708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-03T19:46:03.990716] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-03T19:46:04.034175] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:46:04.496696] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:46:04.790712] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-03T19:46:05.590714] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-03T19:46:05.682728] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-03T19:46:06.249672] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:46:06.252353] [INFO ] [REMOTE ] KBR: Full fetch complete (69851 records). [2025-10-03T19:46:06.252500] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-03T19:46:06.395826] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-03T19:46:06.700667] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-03T19:46:06.700910] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-03T19:46:06.702158] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-03T19:46:06.702228] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-03T19:46:06.703939] [DEBUG] [LOCAL ] KBR: Trimmed 69851 records to 48697 (keeping 200 days of data) [2025-10-03T19:46:06.789806] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:46:07.070403] [DEBUG] [LOCAL ] KBR: Primary data saved (48697 records). [2025-10-03T19:46:07.071310] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-03T19:46:07.072754] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KBR took 38.6s. Estimated remaining: 2h 47m 27s. Rate: 7.1 symbols/min [2025-10-03T19:46:07.195913] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-03T19:46:07.292445] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:07.337583] [DEBUG] [LOCAL ] KEX: Loaded 38410 existing records from primary storage. [2025-10-03T19:46:07.337945] [INFO ] [MAIN ] KEX: Loaded 38410 existing records. [2025-10-03T19:46:07.534963] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:07.535172] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-03T19:46:07.535281] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-03T19:46:07.535779] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-03T19:46:07.535838] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-03T19:46:07.902731] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-03T19:46:07.993758] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-03T19:46:08.030794] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:08.427206] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-03T19:46:08.790747] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-03T19:46:09.016925] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-03T19:46:09.590707] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-03T19:46:10.341302] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-03T19:46:10.390681] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-03T19:46:10.673153] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:46:11.190695] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-03T19:46:11.897418] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:46:11.990703] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-03T19:46:12.790637] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-03T19:46:13.058671] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T19:46:13.390790] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-03T19:46:13.420109] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:46:13.590700] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-03T19:46:14.390735] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-03T19:46:14.946504] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:46:15.190708] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-03T19:46:15.458771] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-03T19:46:15.990701] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-03T19:46:16.524535] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-03T19:46:16.525903] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:46:16.790727] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-03T19:46:17.590732] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-03T19:46:18.390694] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-03T19:46:18.479891] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-03T19:46:19.051983] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-03T19:46:19.190688] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-03T19:46:19.701129] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:46:19.759083] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:46:19.990694] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-03T19:46:20.790701] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-03T19:46:21.590672] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-03T19:46:21.876756] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-03T19:46:22.049749] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-03T19:46:22.050569] [INFO ] [REMOTE ] KEN: Full fetch complete (5932 records). [2025-10-03T19:46:22.050668] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-03T19:46:22.393999] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-03T19:46:22.463711] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-03T19:46:22.463883] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-03T19:46:22.464205] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-03T19:46:22.464325] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-03T19:46:22.465239] [DEBUG] [LOCAL ] KEN: Trimmed 5932 records to 4758 (keeping 200 days of data) [2025-10-03T19:46:22.515789] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-03T19:46:22.533964] [DEBUG] [LOCAL ] KEN: Primary data saved (4758 records). [2025-10-03T19:46:22.534499] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-03T19:46:22.534621] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KEN took 29.8s. Estimated remaining: 2h 47m 26s. Rate: 7.1 symbols/min [2025-10-03T19:46:22.757842] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:22.758052] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-03T19:46:22.758096] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-03T19:46:22.758266] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-03T19:46:22.758309] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-03T19:46:22.758358] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-03T19:46:22.758396] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-03T19:46:23.196054] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-03T19:46:23.203826] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:23.990679] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-03T19:46:24.400045] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-03T19:46:24.775850] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:46:24.790615] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-03T19:46:25.509955] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:46:25.590712] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-03T19:46:26.152317] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-03T19:46:26.390714] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-03T19:46:27.150249] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:46:27.190668] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-03T19:46:27.719800] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-03T19:46:27.990686] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-03T19:46:28.543876] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-03T19:46:28.790735] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-03T19:46:28.828449] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-03T19:46:28.830448] [INFO ] [REMOTE ] KEP: Full fetch complete (41824 records). [2025-10-03T19:46:28.830581] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-03T19:46:29.244050] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-03T19:46:29.244136] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-03T19:46:29.244995] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-03T19:46:29.245065] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-03T19:46:29.246084] [DEBUG] [LOCAL ] KEP: Trimmed 41824 records to 31512 (keeping 200 days of data) [2025-10-03T19:46:29.440719] [DEBUG] [LOCAL ] KEP: Primary data saved (31512 records). [2025-10-03T19:46:29.440867] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-03T19:46:29.440997] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KEP took 28.7s. Estimated remaining: 2h 47m 16s. Rate: 7.1 symbols/min [2025-10-03T19:46:29.595903] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-03T19:46:29.632897] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:29.686816] [DEBUG] [LOCAL ] KEYS: Loaded 43450 existing records from primary storage. [2025-10-03T19:46:29.687169] [INFO ] [MAIN ] KEYS: Loaded 43450 existing records. [2025-10-03T19:46:29.884761] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:29.885014] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-03T19:46:29.885065] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-03T19:46:29.885672] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-03T19:46:29.885735] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-03T19:46:30.282270] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:30.390669] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-03T19:46:30.477404] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:46:31.146193] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:46:31.190697] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-03T19:46:31.990719] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-03T19:46:32.127631] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:46:32.790675] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-03T19:46:32.826980] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-03T19:46:32.830067] [INFO ] [REMOTE ] KD: Full fetch complete (75656 records). [2025-10-03T19:46:32.830243] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-03T19:46:33.267181] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-03T19:46:33.267272] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-03T19:46:33.268477] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-03T19:46:33.268548] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-03T19:46:33.270178] [DEBUG] [LOCAL ] KD: Trimmed 75656 records to 53067 (keeping 200 days of data) [2025-10-03T19:46:33.591688] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-03T19:46:33.597591] [DEBUG] [LOCAL ] KD: Primary data saved (53067 records). [2025-10-03T19:46:33.597831] [INFO ] [MAIN ] KD: Full history saved. [2025-10-03T19:46:33.597957] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KD took 44.8s. Estimated remaining: 2h 47m 3s. Rate: 7.1 symbols/min [2025-10-03T19:46:33.818543] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:46:33.823090] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:33.836595] [DEBUG] [LOCAL ] KF: Loaded 2452 existing records from primary storage. [2025-10-03T19:46:33.836804] [INFO ] [MAIN ] KF: Loaded 2452 existing records. [2025-10-03T19:46:34.031048] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:34.031630] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-03T19:46:34.031741] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-03T19:46:34.032014] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-03T19:46:34.032076] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-03T19:46:34.393576] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-03T19:46:34.435485] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:34.534834] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:46:35.116422] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:46:35.190708] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-03T19:46:35.666105] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T19:46:35.990683] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-03T19:46:36.057139] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-03T19:46:36.790700] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-03T19:46:37.282391] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-03T19:46:37.595881] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-03T19:46:37.611787] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:46:38.390736] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-03T19:46:39.190678] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-03T19:46:39.300318] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:46:39.576488] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-03T19:46:39.649981] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-03T19:46:39.990740] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-03T19:46:40.790728] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-03T19:46:41.590740] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-03T19:46:41.724078] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:46:42.197334] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-03T19:46:42.390675] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-03T19:46:42.428058] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:46:42.977774] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-03T19:46:43.190722] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-03T19:46:43.990711] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-03T19:46:44.358779] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-03T19:46:44.712326] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-03T19:46:44.790735] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-03T19:46:45.590689] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-03T19:46:46.390638] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-03T19:46:46.713447] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-03T19:46:47.062769] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:46:47.065095] [INFO ] [REMOTE ] KEX: Full fetch complete (55881 records). [2025-10-03T19:46:47.065228] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-03T19:46:47.153727] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-03T19:46:47.195756] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-03T19:46:47.483765] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-03T19:46:47.483854] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-03T19:46:47.484799] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-03T19:46:47.484869] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-03T19:46:47.488773] [DEBUG] [LOCAL ] KEX: Trimmed 55881 records to 38713 (keeping 200 days of data) [2025-10-03T19:46:47.740421] [DEBUG] [LOCAL ] KEX: Primary data saved (38713 records). [2025-10-03T19:46:47.740576] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-03T19:46:47.742571] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KEX took 40.7s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-03T19:46:47.930528] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:47.961798] [DEBUG] [LOCAL ] KFRC: Loaded 19732 existing records from primary storage. [2025-10-03T19:46:47.962074] [INFO ] [MAIN ] KFRC: Loaded 19732 existing records. [2025-10-03T19:46:47.995988] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-03T19:46:48.184511] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:48.184807] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-03T19:46:48.184863] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-03T19:46:48.185416] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-03T19:46:48.185477] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-03T19:46:48.620557] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:48.790679] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-03T19:46:49.025199] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:46:49.233899] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-03T19:46:49.385308] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-03T19:46:49.590714] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-03T19:46:50.015326] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-03T19:46:50.390732] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-03T19:46:51.190738] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-03T19:46:51.400474] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-03T19:46:51.990713] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-03T19:46:52.790720] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-03T19:46:53.198860] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-03T19:46:53.274696] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-03T19:46:53.590706] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-03T19:46:53.667585] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:46:54.390697] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-03T19:46:54.441497] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-03T19:46:55.190726] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-03T19:46:55.839467] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-03T19:46:55.840317] [INFO ] [REMOTE ] KF: Full fetch complete (3601 records). [2025-10-03T19:46:55.840390] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-03T19:46:55.991040] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-03T19:46:56.256870] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-03T19:46:56.256964] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-03T19:46:56.257232] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-03T19:46:56.257434] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-03T19:46:56.258179] [DEBUG] [LOCAL ] KF: Trimmed 3601 records to 2509 (keeping 200 days of data) [2025-10-03T19:46:56.275396] [DEBUG] [LOCAL ] KF: Primary data saved (2509 records). [2025-10-03T19:46:56.275519] [INFO ] [MAIN ] KF: Full history saved. [2025-10-03T19:46:56.275677] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KF took 22.7s. Estimated remaining: 2h 46m 52s. Rate: 7.1 symbols/min [2025-10-03T19:46:56.428438] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-03T19:46:56.518693] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:46:56.528942] [DEBUG] [LOCAL ] KFS: Loaded 8523 existing records from primary storage. [2025-10-03T19:46:56.529186] [INFO ] [MAIN ] KFS: Loaded 8523 existing records. [2025-10-03T19:46:56.726938] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:46:56.727219] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-03T19:46:56.727274] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-03T19:46:56.727630] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-03T19:46:56.727734] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-03T19:46:56.801224] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-03T19:46:57.127863] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:46:57.592373] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-03T19:46:57.590805] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-03T19:46:58.390626] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-03T19:46:58.604258] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-03T19:46:58.603747] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-03T19:46:59.190732] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-03T19:46:59.671678] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-03T19:46:59.778497] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-03T19:46:59.990718] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-03T19:47:00.790697] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-03T19:47:01.576847] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:47:01.579676] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-03T19:47:01.579814] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-03T19:47:01.595798] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-03T19:47:01.820731] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T19:47:01.822609] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:47:01.823842] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:47:01.828885] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:47:01.829056] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-03T19:47:01.829132] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-03T19:47:01.829173] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-03T19:47:01.829248] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-03T19:47:01.829343] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEY took 39.3s. Estimated remaining: 2h 46m 40s. Rate: 7.1 symbols/min [2025-10-03T19:47:02.009252] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:02.049748] [DEBUG] [LOCAL ] KFY: Loaded 30268 existing records from primary storage. [2025-10-03T19:47:02.050100] [INFO ] [MAIN ] KFY: Loaded 30268 existing records. [2025-10-03T19:47:02.257215] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:02.257567] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-03T19:47:02.257671] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-03T19:47:02.259043] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-03T19:47:02.259127] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-03T19:47:02.392927] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-03T19:47:02.415844] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:47:02.731115] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:03.190683] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-03T19:47:03.572583] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-03T19:47:03.990695] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-03T19:47:04.502895] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-03T19:47:04.660741] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-03T19:47:04.790728] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-03T19:47:05.590738] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-03T19:47:06.395774] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-03T19:47:06.413268] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-03T19:47:06.600563] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:47:07.190735] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-03T19:47:07.851399] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-03T19:47:07.884774] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-03T19:47:07.990696] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-03T19:47:08.790719] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-03T19:47:09.312409] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:47:09.314884] [INFO ] [REMOTE ] KEYS: Full fetch complete (62865 records). [2025-10-03T19:47:09.314985] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-03T19:47:09.595759] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-03T19:47:09.747192] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-03T19:47:09.747459] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-03T19:47:09.748551] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-03T19:47:09.748619] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-03T19:47:09.750219] [DEBUG] [LOCAL ] KEYS: Trimmed 62865 records to 43769 (keeping 200 days of data) [2025-10-03T19:47:09.986827] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-03T19:47:10.048350] [DEBUG] [LOCAL ] KEYS: Primary data saved (43769 records). [2025-10-03T19:47:10.048514] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-03T19:47:10.048605] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KEYS took 40.6s. Estimated remaining: 2h 46m 32s. Rate: 7.1 symbols/min [2025-10-03T19:47:10.229129] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:10.284499] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-10-03T19:47:10.284959] [INFO ] [MAIN ] KGC: Loaded 54089 existing records. [2025-10-03T19:47:10.395186] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-03T19:47:10.406369] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-03T19:47:10.494817] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:10.495064] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-03T19:47:10.495131] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-03T19:47:10.496371] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-03T19:47:10.496436] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-03T19:47:10.882636] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:11.190707] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-03T19:47:11.674791] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:47:11.990782] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-03T19:47:12.544396] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-03T19:47:12.790704] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-03T19:47:13.567754] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:47:13.590717] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-03T19:47:13.914247] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-03T19:47:14.390661] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-03T19:47:14.555705] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:47:15.190711] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-03T19:47:15.991493] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-03T19:47:15.993526] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-03T19:47:16.086816] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-03T19:47:16.790680] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-03T19:47:16.846340] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-03T19:47:17.590738] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-03T19:47:18.366281] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:47:18.390720] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-03T19:47:18.554152] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-03T19:47:19.190673] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-03T19:47:19.331531] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-03T19:47:19.990732] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-03T19:47:20.790684] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-03T19:47:21.056913] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-03T19:47:21.537945] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-03T19:47:21.590694] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-03T19:47:21.867792] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-03T19:47:21.869283] [INFO ] [REMOTE ] KFRC: Full fetch complete (25756 records). [2025-10-03T19:47:21.869367] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-03T19:47:22.258754] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-03T19:47:22.258841] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-03T19:47:22.259365] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-03T19:47:22.259413] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-03T19:47:22.260196] [DEBUG] [LOCAL ] KFRC: Trimmed 25756 records to 19888 (keeping 200 days of data) [2025-10-03T19:47:22.386557] [DEBUG] [LOCAL ] KFRC: Primary data saved (19888 records). [2025-10-03T19:47:22.386737] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-03T19:47:22.386836] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KFRC took 34.6s. Estimated remaining: 2h 46m 27s. Rate: 7.1 symbols/min [2025-10-03T19:47:22.398353] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-03T19:47:22.572946] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:22.624310] [DEBUG] [LOCAL ] KGS: Loaded 46001 existing records from primary storage. [2025-10-03T19:47:22.624692] [INFO ] [MAIN ] KGS: Loaded 46001 existing records. [2025-10-03T19:47:22.813793] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:22.820043] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-03T19:47:22.829615] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-03T19:47:22.831263] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-03T19:47:22.831180] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-03T19:47:22.833950] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-03T19:47:23.040532] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-03T19:47:23.195817] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-03T19:47:23.255623] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:23.990689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-03T19:47:24.790735] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-03T19:47:25.202014] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-03T19:47:25.512426] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:47:25.562592] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-03T19:47:25.590668] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-03T19:47:26.214477] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-03T19:47:26.215415] [INFO ] [REMOTE ] KFS: Full fetch complete (10605 records). [2025-10-03T19:47:26.215503] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-03T19:47:26.393971] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-03T19:47:26.621333] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-03T19:47:26.621420] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-03T19:47:26.621709] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-03T19:47:26.621773] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-03T19:47:26.622338] [DEBUG] [LOCAL ] KFS: Trimmed 10605 records to 8567 (keeping 200 days of data) [2025-10-03T19:47:26.675742] [DEBUG] [LOCAL ] KFS: Primary data saved (8567 records). [2025-10-03T19:47:26.675922] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-03T19:47:26.676108] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 30.4s. Estimated remaining: 2h 46m 15s. Rate: 7.1 symbols/min [2025-10-03T19:47:26.863117] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:26.919585] [DEBUG] [LOCAL ] KIM: Loaded 53419 existing records from primary storage. [2025-10-03T19:47:26.920011] [INFO ] [MAIN ] KIM: Loaded 53419 existing records. [2025-10-03T19:47:27.124896] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:27.125188] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-03T19:47:27.125243] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-03T19:47:27.126730] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-03T19:47:27.126831] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-03T19:47:27.195781] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-03T19:47:27.505916] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:27.990637] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-03T19:47:28.072120] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-03T19:47:28.790717] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-03T19:47:29.479102] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-03T19:47:29.586964] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:47:29.597612] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-03T19:47:30.364775] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:47:30.390692] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-03T19:47:31.003130] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:47:31.190714] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-03T19:47:31.990713] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-03T19:47:32.123043] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:47:32.790692] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-03T19:47:32.846820] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-03T19:47:33.389758] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:47:33.590695] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-03T19:47:34.390684] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-03T19:47:35.019381] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-03T19:47:35.190742] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-03T19:47:35.342730] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:47:35.506571] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:47:35.990719] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-03T19:47:36.790711] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-03T19:47:37.006851] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-03T19:47:37.423482] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:47:37.590733] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-03T19:47:38.168791] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:47:38.390723] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-03T19:47:39.180955] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:47:39.190624] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-03T19:47:39.990729] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-03T19:47:40.378937] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-03T19:47:40.381075] [INFO ] [REMOTE ] KFY: Full fetch complete (43425 records). [2025-10-03T19:47:40.381193] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-03T19:47:40.809508] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-03T19:47:40.860575] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-03T19:47:40.833914] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-03T19:47:40.872005] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-03T19:47:40.873728] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-03T19:47:40.874159] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-03T19:47:40.875612] [DEBUG] [LOCAL ] KFY: Trimmed 43425 records to 30424 (keeping 200 days of data) [2025-10-03T19:47:41.078979] [DEBUG] [LOCAL ] KFY: Primary data saved (30424 records). [2025-10-03T19:47:41.079448] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-03T19:47:41.079724] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 39.3s. Estimated remaining: 2h 46m 12s. Rate: 7.1 symbols/min [2025-10-03T19:47:41.272803] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:41.297714] [DEBUG] [LOCAL ] KIO: Loaded 21442 existing records from primary storage. [2025-10-03T19:47:41.298004] [INFO ] [MAIN ] KIO: Loaded 21442 existing records. [2025-10-03T19:47:41.506416] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:41.506839] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-03T19:47:41.506935] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-03T19:47:41.516304] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-03T19:47:41.531463] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-03T19:47:41.609467] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-03T19:47:41.604240] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-03T19:47:41.948228] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:42.390720] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-03T19:47:42.573124] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-03T19:47:43.190732] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-03T19:47:43.774821] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-03T19:47:43.941982] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:47:43.990721] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-03T19:47:44.682048] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:47:44.790704] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-03T19:47:45.590689] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-03T19:47:45.607138] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T19:47:46.243887] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T19:47:46.390690] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-03T19:47:47.203715] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-03T19:47:47.213475] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:47:47.437621] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-03T19:47:47.990727] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-03T19:47:48.790740] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-03T19:47:48.933840] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:47:49.584927] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-03T19:47:49.595902] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-03T19:47:50.390723] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-03T19:47:50.537103] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-03T19:47:50.540760] [INFO ] [REMOTE ] KGC: Full fetch complete (77698 records). [2025-10-03T19:47:50.541179] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-03T19:47:50.979855] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-03T19:47:50.980004] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-03T19:47:50.981274] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-03T19:47:50.981360] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-03T19:47:50.983036] [DEBUG] [LOCAL ] KGC: Trimmed 77698 records to 54479 (keeping 200 days of data) [2025-10-03T19:47:51.106604] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:47:51.210283] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-03T19:47:51.383864] [DEBUG] [LOCAL ] KGC: Primary data saved (54479 records). [2025-10-03T19:47:51.384017] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-03T19:47:51.384131] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KGC took 41.3s. Estimated remaining: 2h 46m 5s. Rate: 7.1 symbols/min [2025-10-03T19:47:51.576824] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:51.634456] [DEBUG] [LOCAL ] KKR: Loaded 53890 existing records from primary storage. [2025-10-03T19:47:51.634832] [INFO ] [MAIN ] KKR: Loaded 53890 existing records. [2025-10-03T19:47:51.831552] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:51.831843] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-03T19:47:51.831894] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-03T19:47:51.833322] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-03T19:47:51.833389] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-03T19:47:51.949689] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:47:51.973321] [INFO ] [REMOTE ] KGS: Full fetch complete (66384 records). [2025-10-03T19:47:51.983817] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-03T19:47:51.998973] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-03T19:47:52.602017] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:52.702238] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-03T19:47:52.702325] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-03T19:47:52.703250] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-03T19:47:52.703316] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-03T19:47:52.704690] [DEBUG] [LOCAL ] KGS: Trimmed 66384 records to 46368 (keeping 200 days of data) [2025-10-03T19:47:52.806689] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-03T19:47:53.008766] [DEBUG] [LOCAL ] KGS: Primary data saved (46368 records). [2025-10-03T19:47:53.008925] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-03T19:47:53.009975] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGS took 30.6s. Estimated remaining: 2h 45m 50s. Rate: 7.1 symbols/min [2025-10-03T19:47:53.208943] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-03T19:47:53.240149] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:47:53.260977] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:47:53.275590] [DEBUG] [LOCAL ] KKRS: Loaded 5729 existing records from primary storage. [2025-10-03T19:47:53.275951] [INFO ] [MAIN ] KKRS: Loaded 5729 existing records. [2025-10-03T19:47:53.500131] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:47:53.500386] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-03T19:47:53.500441] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-03T19:47:53.500794] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-03T19:47:53.500855] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-03T19:47:53.595851] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-03T19:47:53.925602] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:47:54.390676] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-03T19:47:54.706164] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-03T19:47:54.849905] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-03T19:47:55.190709] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-03T19:47:55.507392] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T19:47:55.771474] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-03T19:47:55.990715] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-03T19:47:56.579264] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-03T19:47:56.790712] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-03T19:47:57.590747] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-03T19:47:58.390629] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-03T19:47:58.505033] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-03T19:47:59.190631] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-03T19:47:59.447400] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-03T19:47:59.990694] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-03T19:48:00.781325] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-03T19:48:00.786954] [INFO ] [REMOTE ] KIM: Full fetch complete (76830 records). [2025-10-03T19:48:00.787074] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-03T19:48:00.822097] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-03T19:48:01.212792] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:48:01.241201] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-03T19:48:01.241729] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-03T19:48:01.243033] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-03T19:48:01.243110] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-03T19:48:01.244725] [DEBUG] [LOCAL ] KIM: Trimmed 76830 records to 53806 (keeping 200 days of data) [2025-10-03T19:48:01.586801] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (4.00 seconds). [2025-10-03T19:48:01.590766] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-03T19:48:01.618433] [DEBUG] [LOCAL ] KIM: Primary data saved (53806 records). [2025-10-03T19:48:01.618636] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-03T19:48:01.618822] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KIM took 34.9s. Estimated remaining: 2h 45m 42s. Rate: 7.1 symbols/min [2025-10-03T19:48:01.804377] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:01.804579] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-03T19:48:01.804695] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-03T19:48:01.804825] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-03T19:48:01.804869] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-03T19:48:01.804912] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-03T19:48:01.804946] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-03T19:48:02.189062] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:02.390727] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-03T19:48:02.422432] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-03T19:48:02.679304] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:48:03.190708] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-03T19:48:03.440922] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:48:03.442528] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-03T19:48:03.442439] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:48:03.447717] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:03.448288] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-03T19:48:03.448812] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:03.448888] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-03T19:48:03.448961] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-03T19:48:03.449001] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-03T19:48:03.449060] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-03T19:48:03.449170] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KKRT took 1.8s. Estimated remaining: 2h 45m 27s. Rate: 7.1 symbols/min [2025-10-03T19:48:03.639533] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:03.639768] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-03T19:48:03.639830] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-03T19:48:03.639951] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-03T19:48:03.639998] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-03T19:48:03.640045] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-03T19:48:03.640081] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-03T19:48:03.995742] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-03T19:48:04.025967] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:04.790673] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-03T19:48:05.010506] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-03T19:48:05.590702] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-03T19:48:05.798306] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:48:05.798671] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-03T19:48:05.798764] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:05.798882] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-03T19:48:05.798952] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:05.799024] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-03T19:48:05.799089] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-03T19:48:05.799173] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-03T19:48:05.799247] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-03T19:48:05.799317] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KLAR took 2.4s. Estimated remaining: 2h 45m 13s. Rate: 7.1 symbols/min [2025-10-03T19:48:05.982778] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:06.018749] [DEBUG] [LOCAL ] KLC: Loaded 36984 existing records from primary storage. [2025-10-03T19:48:06.019081] [INFO ] [MAIN ] KLC: Loaded 36984 existing records. [2025-10-03T19:48:06.214741] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:06.215211] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-03T19:48:06.215345] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-03T19:48:06.216192] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-03T19:48:06.216257] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-03T19:48:06.393710] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-03T19:48:06.581513] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:48:06.670759] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:07.190705] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-03T19:48:07.211585] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:48:07.990677] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-03T19:48:08.141716] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:48:08.790731] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-03T19:48:09.409945] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-03T19:48:09.590746] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-03T19:48:10.071235] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-03T19:48:10.390764] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-03T19:48:10.671033] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-03T19:48:11.019507] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-03T19:48:11.190708] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-03T19:48:11.990706] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-03T19:48:12.213270] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:48:12.790703] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-03T19:48:13.590739] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-03T19:48:13.702916] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-03T19:48:13.704673] [INFO ] [REMOTE ] KIO: Full fetch complete (31358 records). [2025-10-03T19:48:13.704758] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-03T19:48:14.115220] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-03T19:48:14.115380] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-03T19:48:14.116235] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-03T19:48:14.116515] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-03T19:48:14.118727] [DEBUG] [LOCAL ] KIO: Trimmed 31358 records to 21612 (keeping 200 days of data) [2025-10-03T19:48:14.149902] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-03T19:48:14.256560] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-03T19:48:14.310693] [DEBUG] [LOCAL ] KIO: Primary data saved (21612 records). [2025-10-03T19:48:14.310851] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-03T19:48:14.310948] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KIO took 33.2s. Estimated remaining: 2h 45m 4s. Rate: 7.1 symbols/min [2025-10-03T19:48:14.395845] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-03T19:48:14.512464] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:14.569294] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-10-03T19:48:14.569673] [INFO ] [MAIN ] KMI: Loaded 54083 existing records. [2025-10-03T19:48:14.768500] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:14.769201] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-03T19:48:14.769266] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-03T19:48:14.770524] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-03T19:48:14.770593] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-03T19:48:15.157163] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:15.190703] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-03T19:48:15.930488] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:48:15.990703] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-03T19:48:16.790715] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-03T19:48:17.309500] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-03T19:48:17.357597] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-03T19:48:17.525367] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:48:17.590734] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-03T19:48:18.390684] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-03T19:48:18.957478] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-03T19:48:18.958515] [INFO ] [REMOTE ] KKRS: Full fetch complete (7863 records). [2025-10-03T19:48:18.958606] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-03T19:48:19.196216] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-03T19:48:19.389451] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-03T19:48:19.389731] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-03T19:48:19.390079] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-03T19:48:19.390194] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-03T19:48:19.391153] [DEBUG] [LOCAL ] KKRS: Trimmed 7863 records to 5753 (keeping 200 days of data) [2025-10-03T19:48:19.432419] [DEBUG] [LOCAL ] KKRS: Primary data saved (5753 records). [2025-10-03T19:48:19.432788] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-03T19:48:19.433029] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRS took 26.4s. Estimated remaining: 2h 44m 52s. Rate: 7.1 symbols/min [2025-10-03T19:48:19.466005] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-03T19:48:19.990687] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-03T19:48:20.519064] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-03T19:48:20.790707] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-03T19:48:21.590636] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-03T19:48:21.952427] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-03T19:48:22.070691] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-03T19:48:22.390634] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-03T19:48:23.190685] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-03T19:48:23.813801] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-03T19:48:23.990802] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-03T19:48:24.229981] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-03T19:48:24.699994] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-03T19:48:24.790705] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-03T19:48:25.557480] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:48:25.590631] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-03T19:48:26.220317] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:48:26.390717] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-03T19:48:27.190760] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-03T19:48:27.545743] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-03T19:48:27.864453] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:48:27.990689] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-03T19:48:28.790716] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-03T19:48:29.007117] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-03T19:48:29.590692] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-03T19:48:29.960926] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:48:30.071853] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-10-03T19:48:30.390684] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-03T19:48:31.190696] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-03T19:48:31.253003] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-03T19:48:31.255838] [INFO ] [REMOTE ] KKR: Full fetch complete (77447 records). [2025-10-03T19:48:31.255966] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-03T19:48:31.327238] [DEBUG] [REMOTE ] KMI: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-03T19:48:31.345527] [WARN ] [REMOTE ] KMI: No data returned for month 2025-05 [2025-10-03T19:48:31.370080] [FATAL] [REMOTE ] KMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:48:31.417682] [FATAL] [MAIN ] KMI: Failed to fetch primary data. [2025-10-03T19:48:31.453354] [WARN ] [MAIN ] KMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:48:31.464610] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-03T19:48:31.522513] [DEBUG] [LOCAL ] KMI: No primary data file found to delete. [2025-10-03T19:48:31.558605] [INFO ] [LOCAL ] KMI: Starting deletion of derivative data. [2025-10-03T19:48:31.613453] [DEBUG] [LOCAL ] KMI: Deleted derivative data file. [2025-10-03T19:48:31.634759] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KMI took 17.3s. Estimated remaining: 2h 44m 48s. Rate: 7.1 symbols/min [2025-10-03T19:48:31.734751] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-03T19:48:31.735468] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-03T19:48:31.738100] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-03T19:48:31.736640] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-03T19:48:31.746001] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-03T19:48:31.748343] [DEBUG] [LOCAL ] KKR: Trimmed 77447 records to 54280 (keeping 200 days of data) [2025-10-03T19:48:31.992228] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-03T19:48:32.106291] [DEBUG] [LOCAL ] KKR: Primary data saved (54280 records). [2025-10-03T19:48:32.106449] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-03T19:48:32.106538] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KKR took 40.7s. Estimated remaining: 2h 44m 32s. Rate: 7.1 symbols/min [2025-10-03T19:48:33.454743] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-03T19:48:33.463799] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-03T19:48:34.788494] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-03T19:48:34.797678] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-03T19:48:36.059501] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:48:36.061639] [INFO ] [REMOTE ] KLC: Full fetch complete (50743 records). [2025-10-03T19:48:36.061889] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-03T19:48:36.518336] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-03T19:48:36.518477] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-03T19:48:36.519567] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-03T19:48:36.519673] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-03T19:48:36.521552] [DEBUG] [LOCAL ] KLC: Trimmed 50743 records to 37278 (keeping 200 days of data) [2025-10-03T19:48:36.743793] [DEBUG] [LOCAL ] KLC: Primary data saved (37278 records). [2025-10-03T19:48:36.743944] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-03T19:48:36.744043] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KLC took 30.9s. Estimated remaining: 2h 44m 19s. Rate: 7.1 symbols/min [2025-10-03T19:48:37.454403] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.487314] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.477182] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.510255] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:48:37.524359] [DEBUG] [LOCAL ] KMPB: Loaded 3795 existing records from primary storage. [2025-10-03T19:48:37.524848] [INFO ] [MAIN ] KMPB: Loaded 3795 existing records. [2025-10-03T19:48:37.810342] [DEBUG] [LOCAL ] KMPR: Loaded 39204 existing records from primary storage. [2025-10-03T19:48:37.811214] [DEBUG] [LOCAL ] KMT: Loaded 43222 existing records from primary storage. [2025-10-03T19:48:37.808913] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:37.811669] [INFO ] [MAIN ] KMPR: Loaded 39204 existing records. [2025-10-03T19:48:37.817213] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-03T19:48:37.817308] [INFO ] [MAIN ] KMT: Loaded 43222 existing records. [2025-10-03T19:48:37.860962] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-03T19:48:37.964449] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-03T19:48:37.974672] [DEBUG] [LOCAL ] KMX: Loaded 53551 existing records from primary storage. [2025-10-03T19:48:38.000800] [INFO ] [MAIN ] KMX: Loaded 53551 existing records. [2025-10-03T19:48:37.995429] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-03T19:48:38.395935] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.523105] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.523275] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.592044] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-03T19:48:38.650473] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.650760] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-03T19:48:38.650322] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:48:38.650946] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-03T19:48:38.650996] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-03T19:48:38.651118] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-03T19:48:38.651201] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-03T19:48:38.670112] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-03T19:48:38.663999] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-03T19:48:38.741535] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-03T19:48:38.767368] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-03T19:48:39.336852] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:39.418927] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-03T19:48:40.030975] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:39.995161] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:40.042053] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-03T19:48:40.042371] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-03T19:48:40.118445] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:48:40.118920] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-03T19:48:40.316900] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-03T19:48:40.318442] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-03T19:48:40.762549] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-03T19:48:40.763840] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-03T19:48:41.314765] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-03T19:48:41.316460] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-03T19:48:41.577059] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:48:41.583572] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-03T19:48:41.745271] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-03T19:48:41.756793] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-03T19:48:41.782379] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:48:41.792034] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-03T19:48:41.984736] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:48:42.390740] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-03T19:48:42.609748] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-03T19:48:42.844373] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-03T19:48:43.190666] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-03T19:48:43.289274] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:48:43.499402] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:48:43.695603] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T19:48:43.990734] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-03T19:48:44.556870] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T19:48:44.790694] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-03T19:48:45.590706] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-03T19:48:46.402047] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-03T19:48:46.407493] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:48:46.763972] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:48:47.190686] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-03T19:48:47.708283] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-03T19:48:47.990729] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-03T19:48:48.592841] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:48:48.790742] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-03T19:48:49.218242] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:48:49.590637] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-03T19:48:50.390688] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-03T19:48:50.797785] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-03T19:48:50.865901] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-03T19:48:51.190732] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-03T19:48:51.499174] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-03T19:48:51.990725] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-03T19:48:52.184038] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-03T19:48:52.790734] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-03T19:48:53.590632] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-03T19:48:53.681926] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:48:54.066053] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-03T19:48:54.390735] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-03T19:48:54.908533] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-03T19:48:55.190705] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-03T19:48:55.377993] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-03T19:48:55.750923] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-03T19:48:55.990717] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-03T19:48:56.790724] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-03T19:48:57.547367] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:48:57.590627] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-03T19:48:58.332115] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T19:48:58.390698] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-03T19:48:59.039414] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:48:59.190698] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-03T19:48:59.990681] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-03T19:49:00.077686] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-03T19:49:00.790718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-03T19:49:01.081370] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-03T19:49:01.586805] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-03T19:49:01.599164] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-03T19:49:02.139824] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-03T19:49:02.390726] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-03T19:49:02.723957] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-03T19:49:03.192250] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:49:03.192335] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-03T19:49:03.748789] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:49:03.749560] [INFO ] [REMOTE ] KMPB: Full fetch complete (5132 records). [2025-10-03T19:49:03.749633] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-03T19:49:03.996230] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-03T19:49:04.142613] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-03T19:49:04.142726] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-03T19:49:04.142904] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-03T19:49:04.142984] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-03T19:49:04.143415] [DEBUG] [LOCAL ] KMPB: Trimmed 5132 records to 3810 (keeping 200 days of data) [2025-10-03T19:49:04.166825] [DEBUG] [LOCAL ] KMPB: Primary data saved (3810 records). [2025-10-03T19:49:04.166936] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-03T19:49:04.167045] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPB took 27.4s. Estimated remaining: 2h 44m 29s. Rate: 7.1 symbols/min [2025-10-03T19:49:04.341134] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:04.383288] [DEBUG] [LOCAL ] KN: Loaded 38880 existing records from primary storage. [2025-10-03T19:49:04.383608] [INFO ] [MAIN ] KN: Loaded 38880 existing records. [2025-10-03T19:49:04.580677] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:04.580979] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-03T19:49:04.581036] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-03T19:49:04.581467] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-03T19:49:04.581526] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-03T19:49:04.795879] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-03T19:49:04.979763] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:05.590697] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-03T19:49:05.693025] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:49:06.258930] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:49:06.261193] [INFO ] [REMOTE ] KMPR: Full fetch complete (51629 records). [2025-10-03T19:49:06.261283] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-03T19:49:06.395877] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-03T19:49:06.700288] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-03T19:49:06.700383] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-03T19:49:06.701353] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-03T19:49:06.701420] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-03T19:49:06.703030] [DEBUG] [LOCAL ] KMPR: Trimmed 51629 records to 39497 (keeping 200 days of data) [2025-10-03T19:49:06.962047] [DEBUG] [LOCAL ] KMPR: Primary data saved (39497 records). [2025-10-03T19:49:06.962618] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-03T19:49:06.962847] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPR took 30.2s. Estimated remaining: 2h 44m 16s. Rate: 7.1 symbols/min [2025-10-03T19:49:07.154460] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-03T19:49:07.193128] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-03T19:49:07.193038] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:07.236721] [DEBUG] [LOCAL ] KNF: Loaded 36189 existing records from primary storage. [2025-10-03T19:49:07.237076] [INFO ] [MAIN ] KNF: Loaded 36189 existing records. [2025-10-03T19:49:07.436742] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:07.437004] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-03T19:49:07.437059] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-03T19:49:07.437493] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-03T19:49:07.437551] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-03T19:49:07.838173] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:07.990668] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-03T19:49:08.307684] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-03T19:49:08.750670] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:49:08.790708] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-03T19:49:09.506304] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-03T19:49:09.590694] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-03T19:49:10.292350] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:49:10.390694] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-03T19:49:11.190632] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-03T19:49:11.322216] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-03T19:49:11.615202] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-03T19:49:11.990682] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-03T19:49:12.587225] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:49:12.589577] [INFO ] [REMOTE ] KMT: Full fetch complete (62141 records). [2025-10-03T19:49:12.589718] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-03T19:49:12.803016] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-03T19:49:13.017885] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-03T19:49:13.018024] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-03T19:49:13.019151] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-03T19:49:13.019222] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-03T19:49:13.020677] [DEBUG] [LOCAL ] KMT: Trimmed 62141 records to 43553 (keeping 200 days of data) [2025-10-03T19:49:13.294108] [DEBUG] [LOCAL ] KMT: Primary data saved (43553 records). [2025-10-03T19:49:13.294239] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-03T19:49:13.294327] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KMT took 36.5s. Estimated remaining: 2h 44m 5s. Rate: 7.1 symbols/min [2025-10-03T19:49:13.429827] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-03T19:49:13.510389] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:13.521808] [DEBUG] [LOCAL ] KNOP: Loaded 10514 existing records from primary storage. [2025-10-03T19:49:13.522029] [INFO ] [MAIN ] KNOP: Loaded 10514 existing records. [2025-10-03T19:49:13.599758] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-03T19:49:13.723872] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:13.724151] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-03T19:49:13.724224] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-03T19:49:13.724468] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-03T19:49:13.724527] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-03T19:49:14.120039] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:14.360874] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-03T19:49:14.390630] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-03T19:49:14.837275] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-03T19:49:15.190708] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-03T19:49:15.913024] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:49:15.990629] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-03T19:49:16.790673] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-03T19:49:16.970056] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-03T19:49:16.974756] [INFO ] [REMOTE ] KMX: Full fetch complete (76095 records). [2025-10-03T19:49:16.974896] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-03T19:49:17.392293] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-03T19:49:17.392378] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-03T19:49:17.393513] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-03T19:49:17.393583] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-03T19:49:17.396617] [DEBUG] [LOCAL ] KMX: Trimmed 76095 records to 53938 (keeping 200 days of data) [2025-10-03T19:49:17.609838] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-03T19:49:17.674488] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:49:17.777089] [DEBUG] [LOCAL ] KMX: Primary data saved (53938 records). [2025-10-03T19:49:17.777243] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-03T19:49:17.777355] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMX took 41.0s. Estimated remaining: 2h 43m 53s. Rate: 7.1 symbols/min [2025-10-03T19:49:17.962878] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:17.984635] [DEBUG] [LOCAL ] KNSL: Loaded 18336 existing records from primary storage. [2025-10-03T19:49:17.985097] [INFO ] [MAIN ] KNSL: Loaded 18336 existing records. [2025-10-03T19:49:18.180328] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:18.180739] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-03T19:49:18.180812] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-03T19:49:18.181224] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-03T19:49:18.181308] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-03T19:49:18.300477] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:49:18.392788] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-03T19:49:18.625337] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:18.626885] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:49:19.190695] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-03T19:49:19.984709] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:49:19.992712] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-03T19:49:20.061843] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-03T19:49:20.784377] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-03T19:49:20.790597] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-03T19:49:21.508801] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-03T19:49:21.590735] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-03T19:49:22.390688] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-03T19:49:23.050255] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-03T19:49:23.190687] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-03T19:49:23.386759] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T19:49:23.990695] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-03T19:49:24.724126] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-03T19:49:24.790624] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-03T19:49:24.952598] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:49:25.590712] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-03T19:49:26.390695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-03T19:49:27.190683] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-03T19:49:27.268583] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T19:49:27.729120] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-10-03T19:49:27.990691] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-03T19:49:28.310860] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-03T19:49:28.682357] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-03T19:49:28.790693] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-03T19:49:29.455615] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:49:29.590752] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-03T19:49:29.897457] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-03T19:49:30.390705] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-03T19:49:31.033022] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-03T19:49:31.035135] [INFO ] [REMOTE ] KNF: Full fetch complete (50830 records). [2025-10-03T19:49:31.035229] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-03T19:49:31.195741] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-03T19:49:31.395370] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-03T19:49:31.494283] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-03T19:49:31.494374] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-03T19:49:31.495243] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-03T19:49:31.495309] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-03T19:49:31.496798] [DEBUG] [LOCAL ] KNF: Trimmed 50830 records to 36421 (keeping 200 days of data) [2025-10-03T19:49:31.722728] [DEBUG] [LOCAL ] KNF: Primary data saved (36421 records). [2025-10-03T19:49:31.722873] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-03T19:49:31.722977] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KNF took 24.8s. Estimated remaining: 2h 43m 50s. Rate: 7.1 symbols/min [2025-10-03T19:49:31.899310] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:31.946019] [DEBUG] [LOCAL ] KNTK: Loaded 46533 existing records from primary storage. [2025-10-03T19:49:31.946332] [INFO ] [MAIN ] KNTK: Loaded 46533 existing records. [2025-10-03T19:49:31.995923] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-03T19:49:32.140250] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:32.140505] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-03T19:49:32.140559] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-03T19:49:32.141000] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-03T19:49:32.141061] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-03T19:49:32.567527] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:32.720143] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:49:32.790628] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-03T19:49:33.148722] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-03T19:49:33.590689] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-03T19:49:33.806004] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-03T19:49:34.390699] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-03T19:49:34.609131] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-03T19:49:35.190632] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-03T19:49:35.280210] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-03T19:49:35.990709] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-03T19:49:36.557440] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:49:36.790619] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-03T19:49:37.025026] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-03T19:49:37.590738] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-03T19:49:38.216145] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:49:38.361153] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-03T19:49:38.390689] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-03T19:49:39.106391] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-03T19:49:39.190679] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-03T19:49:39.974074] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-03T19:49:39.990606] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-03T19:49:40.720224] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-03T19:49:40.790664] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-03T19:49:41.590708] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-03T19:49:41.603762] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-03T19:49:42.390725] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-03T19:49:42.701308] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:49:42.703702] [INFO ] [REMOTE ] KN: Full fetch complete (56623 records). [2025-10-03T19:49:42.703834] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-03T19:49:43.128834] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-03T19:49:43.128930] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-03T19:49:43.129878] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-03T19:49:43.129945] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-03T19:49:43.131294] [DEBUG] [LOCAL ] KN: Trimmed 56623 records to 39160 (keeping 200 days of data) [2025-10-03T19:49:43.215768] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-03T19:49:43.364612] [DEBUG] [LOCAL ] KN: Primary data saved (39160 records). [2025-10-03T19:49:43.364789] [INFO ] [MAIN ] KN: Full history saved. [2025-10-03T19:49:43.365713] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 39.2s. Estimated remaining: 2h 43m 44s. Rate: 7.1 symbols/min [2025-10-03T19:49:43.544834] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:43.606103] [DEBUG] [LOCAL ] KNX: Loaded 52978 existing records from primary storage. [2025-10-03T19:49:43.606468] [INFO ] [MAIN ] KNX: Loaded 52978 existing records. [2025-10-03T19:49:43.801912] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:49:43.802223] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-03T19:49:43.802277] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-03T19:49:43.802823] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-03T19:49:43.802889] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-03T19:49:43.992254] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-03T19:49:44.020940] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:49:44.106074] [INFO ] [REMOTE ] KNOP: Full fetch complete (14733 records). [2025-10-03T19:49:44.144717] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-03T19:49:44.188607] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-03T19:49:44.369904] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:44.659904] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-03T19:49:44.659980] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-03T19:49:44.660296] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-03T19:49:44.660339] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-03T19:49:44.660882] [DEBUG] [LOCAL ] KNOP: Trimmed 14733 records to 10576 (keeping 200 days of data) [2025-10-03T19:49:44.722558] [DEBUG] [LOCAL ] KNOP: Primary data saved (10576 records). [2025-10-03T19:49:44.722742] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-03T19:49:44.722838] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KNOP took 31.4s. Estimated remaining: 2h 43m 29s. Rate: 7.1 symbols/min [2025-10-03T19:49:44.797779] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-03T19:49:44.925474] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:49:44.925692] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-03T19:49:44.925747] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-03T19:49:44.925859] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-03T19:49:44.925901] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-03T19:49:44.925942] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-03T19:49:44.925974] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-03T19:49:45.244834] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-03T19:49:45.362017] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:49:45.590744] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-03T19:49:46.390684] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-03T19:49:46.494734] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-03T19:49:47.190726] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-03T19:49:47.990708] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-03T19:49:48.129621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:49:48.790682] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-03T19:49:48.904749] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-03T19:49:49.151616] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:49:49.590695] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-03T19:49:50.074234] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (4.48 seconds). [2025-10-03T19:49:50.390732] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-03T19:49:50.455670] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:49:50.507571] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T19:49:51.190760] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-03T19:49:51.965085] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-03T19:49:51.990627] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-03T19:49:52.801635] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-03T19:49:52.809375] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:49:53.590741] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-03T19:49:53.799010] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-03T19:49:54.390792] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-03T19:49:55.196703] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-03T19:49:55.223861] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-10-03T19:49:55.280301] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-03T19:49:55.990735] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-03T19:49:56.092772] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-03T19:49:56.268736] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-03T19:49:56.790734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-03T19:49:57.541751] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-03T19:49:57.590688] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-03T19:49:58.390689] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-03T19:49:58.625756] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-03T19:49:59.190679] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-03T19:49:59.358438] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-03T19:49:59.360179] [INFO ] [REMOTE ] KNSL: Full fetch complete (26774 records). [2025-10-03T19:49:59.360435] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-03T19:49:59.741039] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-03T19:49:59.741152] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-03T19:49:59.742560] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-03T19:49:59.742630] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-03T19:49:59.743609] [DEBUG] [LOCAL ] KNSL: Trimmed 26774 records to 18503 (keeping 200 days of data) [2025-10-03T19:49:59.873337] [DEBUG] [LOCAL ] KNSL: Primary data saved (18503 records). [2025-10-03T19:49:59.873558] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-03T19:49:59.873696] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNSL took 42.1s. Estimated remaining: 2h 43m 27s. Rate: 7.1 symbols/min [2025-10-03T19:49:59.996376] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-03T19:50:00.068967] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-03T19:50:00.118831] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:00.171320] [DEBUG] [LOCAL ] KODK: Loaded 43779 existing records from primary storage. [2025-10-03T19:50:00.171794] [INFO ] [MAIN ] KODK: Loaded 43779 existing records. [2025-10-03T19:50:00.370043] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:00.370312] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-03T19:50:00.370364] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-03T19:50:00.370967] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-03T19:50:00.371030] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-03T19:50:00.795948] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-03T19:50:00.802852] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:01.590767] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-03T19:50:02.039187] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:50:02.043739] [INFO ] [REMOTE ] KNTK: Full fetch complete (64774 records). [2025-10-03T19:50:02.044223] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-03T19:50:02.491188] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-03T19:50:02.491410] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-03T19:50:02.493195] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-03T19:50:02.493276] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-03T19:50:02.495957] [DEBUG] [LOCAL ] KNTK: Trimmed 64774 records to 46914 (keeping 200 days of data) [2025-10-03T19:50:02.820090] [DEBUG] [LOCAL ] KNTK: Primary data saved (46914 records). [2025-10-03T19:50:02.820323] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-03T19:50:02.820561] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNTK took 31.1s. Estimated remaining: 2h 43m 13s. Rate: 7.1 symbols/min [2025-10-03T19:50:03.005628] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:03.036630] [DEBUG] [LOCAL ] KOF: Loaded 26353 existing records from primary storage. [2025-10-03T19:50:03.037002] [INFO ] [MAIN ] KOF: Loaded 26353 existing records. [2025-10-03T19:50:03.235756] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:03.269791] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-03T19:50:03.273665] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-03T19:50:03.276380] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (4.09 seconds). [2025-10-03T19:50:03.287511] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-03T19:50:03.288321] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-03T19:50:03.288815] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-03T19:50:03.716110] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:03.716946] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-03T19:50:03.974854] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-03T19:50:03.990612] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-03T19:50:05.809225] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-03T19:50:05.819180] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-03T19:50:05.957251] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-03T19:50:05.969456] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-03T19:50:07.133830] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (7.14 seconds). [2025-10-03T19:50:07.159327] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-03T19:50:07.175813] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:50:07.190607] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-03T19:50:08.679397] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-03T19:50:08.691477] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-03T19:50:08.820014] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-03T19:50:08.831253] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-03T19:50:08.969691] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:50:09.590700] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-03T19:50:10.075262] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (6.36 seconds). [2025-10-03T19:50:10.390679] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-03T19:50:10.518094] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-03T19:50:11.190678] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-03T19:50:11.332748] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-10-03T19:50:11.463566] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-03T19:50:11.608099] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-03T19:50:11.990683] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-03T19:50:12.790631] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-03T19:50:12.989131] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-03T19:50:13.193294] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-03T19:50:13.590705] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-03T19:50:14.225180] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:50:14.390722] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-03T19:50:15.190734] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-03T19:50:15.475284] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-03T19:50:15.990695] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-03T19:50:16.157103] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-10-03T19:50:16.790737] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-03T19:50:17.550727] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-03T19:50:17.554046] [INFO ] [REMOTE ] KNX: Full fetch complete (75853 records). [2025-10-03T19:50:17.554189] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-03T19:50:17.595856] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-03T19:50:18.009166] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-03T19:50:18.009332] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-03T19:50:18.010550] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-03T19:50:18.010684] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-03T19:50:18.042493] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.85 seconds). [2025-10-03T19:50:18.053784] [DEBUG] [LOCAL ] KNX: Trimmed 75853 records to 53368 (keeping 200 days of data) [2025-10-03T19:50:18.390633] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-03T19:50:18.411461] [DEBUG] [LOCAL ] KNX: Primary data saved (53368 records). [2025-10-03T19:50:18.411583] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-03T19:50:18.412303] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNX took 35.0s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-03T19:50:18.599772] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:18.636244] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-03T19:50:18.662449] [DEBUG] [LOCAL ] KOP: Loaded 17741 existing records from primary storage. [2025-10-03T19:50:18.662726] [INFO ] [MAIN ] KOP: Loaded 17741 existing records. [2025-10-03T19:50:18.861546] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:18.861865] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-03T19:50:18.861915] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-03T19:50:18.862246] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-03T19:50:18.862307] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-03T19:50:19.195761] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-03T19:50:19.267445] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:19.279884] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:50:19.990688] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-03T19:50:20.790632] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-03T19:50:20.976867] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-03T19:50:21.127016] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-03T19:50:21.411315] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-03T19:50:21.590761] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-03T19:50:22.017139] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-03T19:50:22.390685] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-03T19:50:22.581860] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:50:23.190669] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-03T19:50:23.990689] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-03T19:50:24.108585] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-03T19:50:24.790684] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-03T19:50:25.409283] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-03T19:50:25.590632] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-03T19:50:25.859483] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-03T19:50:25.907803] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-03T19:50:26.390629] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-03T19:50:26.920295] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:50:26.923504] [INFO ] [REMOTE ] KODK: Full fetch complete (63410 records). [2025-10-03T19:50:26.923670] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-03T19:50:27.197749] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-03T19:50:27.383038] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-03T19:50:27.383126] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-03T19:50:27.384139] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-03T19:50:27.384207] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-03T19:50:27.386279] [DEBUG] [LOCAL ] KODK: Trimmed 63410 records to 44096 (keeping 200 days of data) [2025-10-03T19:50:27.646355] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:50:27.670214] [DEBUG] [LOCAL ] KODK: Primary data saved (44096 records). [2025-10-03T19:50:27.670542] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-03T19:50:27.670629] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KODK took 27.8s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-10-03T19:50:27.872592] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:27.877256] [DEBUG] [LOCAL ] KORE: Loaded 2034 existing records from primary storage. [2025-10-03T19:50:27.877438] [INFO ] [MAIN ] KORE: Loaded 2034 existing records. [2025-10-03T19:50:27.994608] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-03T19:50:28.086814] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:28.087113] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-03T19:50:28.087182] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-03T19:50:28.087385] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-10-03T19:50:28.087447] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-03T19:50:28.517199] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:28.790700] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-03T19:50:29.131460] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-03T19:50:29.590739] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-03T19:50:29.752853] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-10-03T19:50:29.793770] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-03T19:50:30.390670] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-03T19:50:30.684295] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-03T19:50:31.190708] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-03T19:50:31.865389] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-03T19:50:31.990713] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-03T19:50:32.756750] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-03T19:50:32.790636] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-03T19:50:33.046915] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-03T19:50:33.590699] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-03T19:50:33.890540] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-03T19:50:33.894967] [INFO ] [REMOTE ] KOF: Full fetch complete (37405 records). [2025-10-03T19:50:33.895107] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-03T19:50:34.327470] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-03T19:50:34.327567] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-03T19:50:34.328539] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-03T19:50:34.328610] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-03T19:50:34.329883] [DEBUG] [LOCAL ] KOF: Trimmed 37405 records to 26587 (keeping 200 days of data) [2025-10-03T19:50:34.398715] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-03T19:50:34.510372] [DEBUG] [LOCAL ] KOF: Primary data saved (26587 records). [2025-10-03T19:50:34.510527] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-03T19:50:34.510626] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KOF took 31.7s. Estimated remaining: 2h 42m 54s. Rate: 7.1 symbols/min [2025-10-03T19:50:34.709010] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:34.767583] [DEBUG] [LOCAL ] KOS: Loaded 53441 existing records from primary storage. [2025-10-03T19:50:34.768019] [INFO ] [MAIN ] KOS: Loaded 53441 existing records. [2025-10-03T19:50:34.970390] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:34.970670] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-03T19:50:34.970736] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-03T19:50:34.972042] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-03T19:50:34.972106] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-03T19:50:35.199383] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-03T19:50:35.361883] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:35.407600] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-03T19:50:35.832401] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-03T19:50:35.847681] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-03T19:50:35.850469] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-03T19:50:35.850617] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-03T19:50:35.995867] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-03T19:50:36.078658] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-03T19:50:36.079628] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:50:36.079776] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:50:36.079853] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-03T19:50:36.079927] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-03T19:50:36.079966] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-03T19:50:36.080021] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-03T19:50:36.080137] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KO took 51.4s. Estimated remaining: 2h 42m 39s. Rate: 7.1 symbols/min [2025-10-03T19:50:36.267276] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:36.330227] [DEBUG] [LOCAL ] KR: Loaded 54071 existing records from primary storage. [2025-10-03T19:50:36.330617] [INFO ] [MAIN ] KR: Loaded 54071 existing records. [2025-10-03T19:50:36.524567] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:36.524880] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-03T19:50:36.524934] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-03T19:50:36.527122] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-03T19:50:36.527190] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-03T19:50:36.795843] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-03T19:50:36.907876] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:37.340192] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-03T19:50:37.590683] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-03T19:50:37.824070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:50:38.390694] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-03T19:50:38.852957] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-03T19:50:39.190710] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-03T19:50:39.285089] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:50:39.675801] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-03T19:50:39.990725] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-03T19:50:40.433936] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-03T19:50:40.790680] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-03T19:50:41.590708] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-03T19:50:42.390638] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-03T19:50:42.589822] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-03T19:50:42.921088] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-03T19:50:43.034198] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-03T19:50:43.190729] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-03T19:50:43.990739] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-03T19:50:44.790740] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-03T19:50:44.837473] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:50:45.243329] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-03T19:50:45.590639] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-03T19:50:45.772122] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-03T19:50:46.037707] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-03T19:50:46.390708] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-03T19:50:47.190732] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-03T19:50:47.659222] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-03T19:50:47.660156] [INFO ] [REMOTE ] KORE: Full fetch complete (5859 records). [2025-10-03T19:50:47.660231] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-03T19:50:47.990946] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-03T19:50:48.072484] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-03T19:50:48.072680] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-03T19:50:48.073049] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-03T19:50:48.073116] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-03T19:50:48.073630] [DEBUG] [LOCAL ] KORE: Trimmed 5859 records to 2043 (keeping 200 days of data) [2025-10-03T19:50:48.086509] [DEBUG] [LOCAL ] KORE: Primary data saved (2043 records). [2025-10-03T19:50:48.086612] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-03T19:50:48.086754] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KORE took 20.4s. Estimated remaining: 2h 42m 34s. Rate: 7.1 symbols/min [2025-10-03T19:50:48.278536] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:48.325285] [DEBUG] [LOCAL ] KRC: Loaded 48621 existing records from primary storage. [2025-10-03T19:50:48.325607] [INFO ] [MAIN ] KRC: Loaded 48621 existing records. [2025-10-03T19:50:48.521746] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:50:48.522272] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-03T19:50:48.522331] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-03T19:50:48.522831] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-03T19:50:48.522894] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-03T19:50:48.799567] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-03T19:50:48.933007] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:50:49.083494] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-03T19:50:49.590703] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-03T19:50:49.763599] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-03T19:50:50.122111] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-03T19:50:50.390735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-03T19:50:51.190632] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-03T19:50:51.351003] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:50:51.904012] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-03T19:50:51.990723] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-03T19:50:52.790732] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-03T19:50:53.003785] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-03T19:50:53.092368] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-03T19:50:53.590671] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-03T19:50:54.286158] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T19:50:54.390722] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-03T19:50:55.190699] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-03T19:50:55.455707] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-03T19:50:55.538306] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:50:55.990711] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-03T19:50:56.790632] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-03T19:50:57.196273] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:50:57.574128] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-03T19:50:57.590633] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-03T19:50:58.390751] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-03T19:50:58.816175] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T19:50:59.197931] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-03T19:50:59.221235] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:50:59.250360] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:50:59.252264] [INFO ] [REMOTE ] KOP: Full fetch complete (25547 records). [2025-10-03T19:50:59.252352] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-03T19:50:59.667587] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-03T19:50:59.667718] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-03T19:50:59.668472] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-03T19:50:59.668538] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-03T19:50:59.669345] [DEBUG] [LOCAL ] KOP: Trimmed 25547 records to 17879 (keeping 200 days of data) [2025-10-03T19:50:59.789289] [DEBUG] [LOCAL ] KOP: Primary data saved (17879 records). [2025-10-03T19:50:59.789693] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-03T19:50:59.789908] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KOP took 41.4s. Estimated remaining: 2h 42m 29s. Rate: 7.1 symbols/min [2025-10-03T19:50:59.979517] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:50:59.990704] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-03T19:51:00.026099] [DEBUG] [LOCAL ] KREF: Loaded 37907 existing records from primary storage. [2025-10-03T19:51:00.026450] [INFO ] [MAIN ] KREF: Loaded 37907 existing records. [2025-10-03T19:51:00.216110] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:00.216369] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-03T19:51:00.216420] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-03T19:51:00.216882] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-03T19:51:00.216955] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-03T19:51:00.607601] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:00.790636] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-03T19:51:01.262412] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-03T19:51:01.590639] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-03T19:51:01.762359] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:51:02.390695] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-03T19:51:02.750969] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:51:03.030455] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T19:51:03.190735] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-03T19:51:03.990741] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-03T19:51:04.128316] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:51:04.220247] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-03T19:51:04.790740] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-03T19:51:05.590687] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-03T19:51:05.932055] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-03T19:51:06.390732] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-03T19:51:06.614313] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:51:07.074414] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-03T19:51:07.190686] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-03T19:51:07.990677] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-03T19:51:08.254999] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-03T19:51:08.760684] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-03T19:51:08.790633] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-03T19:51:09.197997] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-03T19:51:09.590724] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-03T19:51:10.390630] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-03T19:51:10.474146] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:51:11.190731] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-03T19:51:11.376739] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:51:11.936702] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:51:11.939853] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-03T19:51:11.940043] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-03T19:51:12.002999] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-03T19:51:12.420303] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-03T19:51:12.420411] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-03T19:51:12.421785] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-03T19:51:12.421860] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-03T19:51:12.423771] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54461 (keeping 200 days of data) [2025-10-03T19:51:12.790784] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-03T19:51:12.810162] [DEBUG] [LOCAL ] KR: Primary data saved (54461 records). [2025-10-03T19:51:12.810384] [INFO ] [MAIN ] KR: Full history saved. [2025-10-03T19:51:12.810490] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KR took 36.7s. Estimated remaining: 2h 42m 25s. Rate: 7.1 symbols/min [2025-10-03T19:51:12.981513] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-03T19:51:13.058148] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:13.105573] [DEBUG] [LOCAL ] KRG: Loaded 49512 existing records from primary storage. [2025-10-03T19:51:13.105948] [INFO ] [MAIN ] KRG: Loaded 49512 existing records. [2025-10-03T19:51:13.295870] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:13.296089] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-03T19:51:13.296203] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-03T19:51:13.297544] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-03T19:51:13.297606] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-03T19:51:13.595854] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-03T19:51:13.747581] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:13.891262] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-03T19:51:14.141232] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-03T19:51:14.390694] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-03T19:51:15.190684] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-03T19:51:15.347494] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:51:15.989384] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-03T19:51:15.991883] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-03T19:51:15.992965] [INFO ] [REMOTE ] KOS: Full fetch complete (76883 records). [2025-10-03T19:51:15.993065] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-03T19:51:16.452122] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-03T19:51:16.452333] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-03T19:51:16.453485] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-03T19:51:16.453683] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-03T19:51:16.455623] [DEBUG] [LOCAL ] KOS: Trimmed 76883 records to 53828 (keeping 200 days of data) [2025-10-03T19:51:16.697808] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-03T19:51:16.794315] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-03T19:51:16.823389] [DEBUG] [LOCAL ] KOS: Primary data saved (53828 records). [2025-10-03T19:51:16.823552] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-03T19:51:16.823680] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KOS took 42.3s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-03T19:51:17.045448] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:17.046018] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-03T19:51:17.046080] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-03T19:51:17.046242] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-03T19:51:17.046300] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-03T19:51:17.046349] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-03T19:51:17.046385] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-03T19:51:17.447021] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:17.472072] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-03T19:51:17.474597] [INFO ] [REMOTE ] KRC: Full fetch complete (69856 records). [2025-10-03T19:51:17.474757] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-03T19:51:17.592625] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-03T19:51:17.915483] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-03T19:51:17.915583] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-03T19:51:17.916769] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-03T19:51:17.916848] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-03T19:51:17.918402] [DEBUG] [LOCAL ] KRC: Trimmed 69856 records to 48988 (keeping 200 days of data) [2025-10-03T19:51:18.250730] [DEBUG] [LOCAL ] KRC: Primary data saved (48988 records). [2025-10-03T19:51:18.250893] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-03T19:51:18.251058] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KRC took 30.2s. Estimated remaining: 2h 41m 57s. Rate: 7.1 symbols/min [2025-10-03T19:51:18.395611] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-03T19:51:18.452481] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:18.480751] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-03T19:51:18.517594] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-10-03T19:51:18.517958] [INFO ] [MAIN ] KRO: Loaded 26251 existing records. [2025-10-03T19:51:18.678911] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:51:18.709179] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-03T19:51:18.716026] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:51:18.716247] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-03T19:51:18.715864] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:18.716730] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-03T19:51:18.716384] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:51:18.716908] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-03T19:51:18.717030] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-03T19:51:18.717550] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-03T19:51:18.717768] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-03T19:51:18.717858] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-03T19:51:18.718078] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-03T19:51:18.718120] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-03T19:51:18.718294] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KRMN took 1.9s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-03T19:51:18.952938] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-03T19:51:19.196476] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-03T19:51:19.191125] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:19.356715] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:19.384421] [DEBUG] [LOCAL ] KRP: Loaded 37273 existing records from primary storage. [2025-10-03T19:51:19.384748] [INFO ] [MAIN ] KRP: Loaded 37273 existing records. [2025-10-03T19:51:19.579431] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:19.579737] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-03T19:51:19.579794] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-03T19:51:19.580244] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-03T19:51:19.580303] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-03T19:51:19.958178] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:19.990698] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-03T19:51:20.795191] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-03T19:51:20.800608] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:51:21.331546] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-03T19:51:21.590698] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-03T19:51:21.981144] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:51:22.390701] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-03T19:51:22.975375] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-03T19:51:23.190677] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-03T19:51:23.401882] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-03T19:51:23.990737] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-03T19:51:24.495040] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-03T19:51:24.790718] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-03T19:51:25.590673] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-03T19:51:26.052126] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-03T19:51:26.271547] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:51:26.390719] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-03T19:51:27.071779] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-03T19:51:27.190724] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-03T19:51:27.910026] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:51:27.990687] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-03T19:51:28.546242] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-03T19:51:28.790702] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-03T19:51:29.476249] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:51:29.590633] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-03T19:51:29.737421] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-03T19:51:30.390705] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-03T19:51:30.956710] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-03T19:51:31.190728] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-03T19:51:31.707864] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-03T19:51:31.990703] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-03T19:51:32.792560] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-03T19:51:32.795561] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-03T19:51:33.502507] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-03T19:51:33.590708] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-03T19:51:34.308925] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-03T19:51:34.390737] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-03T19:51:35.195778] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-03T19:51:35.209185] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-03T19:51:35.378905] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-03T19:51:35.381438] [INFO ] [REMOTE ] KREF: Full fetch complete (52660 records). [2025-10-03T19:51:35.381558] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-03T19:51:35.822679] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-03T19:51:35.822841] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-03T19:51:35.823788] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-03T19:51:35.823856] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-03T19:51:35.825180] [DEBUG] [LOCAL ] KREF: Trimmed 52660 records to 38174 (keeping 200 days of data) [2025-10-03T19:51:36.005948] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-03T19:51:36.082377] [DEBUG] [LOCAL ] KREF: Primary data saved (38174 records). [2025-10-03T19:51:36.082546] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-03T19:51:36.084865] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 36.3s. Estimated remaining: 2h 41m 41s. Rate: 7.1 symbols/min [2025-10-03T19:51:36.312684] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:36.371154] [DEBUG] [LOCAL ] KSS: Loaded 53992 existing records from primary storage. [2025-10-03T19:51:36.371527] [INFO ] [MAIN ] KSS: Loaded 53992 existing records. [2025-10-03T19:51:36.568585] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:36.568962] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-03T19:51:36.569080] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-03T19:51:36.569627] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-03T19:51:36.569779] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-03T19:51:36.801294] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:51:36.801430] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-03T19:51:37.013713] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:37.590690] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-03T19:51:38.141152] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-03T19:51:38.363285] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T19:51:38.390624] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-03T19:51:39.190714] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-03T19:51:39.575211] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-03T19:51:39.990635] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-03T19:51:40.226431] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-03T19:51:40.797197] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-03T19:51:40.817744] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:51:41.345827] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:51:41.590698] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-03T19:51:42.385262] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:51:42.395940] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-03T19:51:43.190692] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-03T19:51:43.244174] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-03T19:51:43.530813] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-03T19:51:43.990700] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-03T19:51:44.506716] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-03T19:51:44.790736] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-03T19:51:45.330294] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-03T19:51:45.333126] [INFO ] [REMOTE ] KRG: Full fetch complete (71148 records). [2025-10-03T19:51:45.333246] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-03T19:51:45.597336] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-03T19:51:45.769152] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-03T19:51:45.769240] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-03T19:51:45.770263] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-03T19:51:45.770331] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-03T19:51:45.771774] [DEBUG] [LOCAL ] KRG: Trimmed 71148 records to 49885 (keeping 200 days of data) [2025-10-03T19:51:46.018707] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-03T19:51:46.120364] [DEBUG] [LOCAL ] KRG: Primary data saved (49885 records). [2025-10-03T19:51:46.120513] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-03T19:51:46.120617] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRG took 33.3s. Estimated remaining: 2h 41m 34s. Rate: 7.1 symbols/min [2025-10-03T19:51:46.300938] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:46.346061] [DEBUG] [LOCAL ] KT: Loaded 46056 existing records from primary storage. [2025-10-03T19:51:46.346391] [INFO ] [MAIN ] KT: Loaded 46056 existing records. [2025-10-03T19:51:46.395906] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-03T19:51:46.539585] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:46.539885] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-03T19:51:46.539948] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-03T19:51:46.543007] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-03T19:51:46.543074] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-03T19:51:46.925575] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:47.190635] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-03T19:51:47.301388] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-03T19:51:47.334876] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-03T19:51:47.990700] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-03T19:51:48.708849] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-03T19:51:48.790690] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-03T19:51:49.188477] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:51:49.590724] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-03T19:51:50.390692] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-03T19:51:50.758682] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-03T19:51:50.947580] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:51:51.190694] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-03T19:51:51.294827] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:51:51.296364] [INFO ] [REMOTE ] KRO: Full fetch complete (34986 records). [2025-10-03T19:51:51.296439] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-03T19:51:51.701278] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-03T19:51:51.701375] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-03T19:51:51.702194] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-03T19:51:51.702279] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-03T19:51:51.703184] [DEBUG] [LOCAL ] KRO: Trimmed 34986 records to 26399 (keeping 200 days of data) [2025-10-03T19:51:51.857780] [DEBUG] [LOCAL ] KRO: Primary data saved (26399 records). [2025-10-03T19:51:51.857917] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-03T19:51:51.858035] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRO took 33.6s. Estimated remaining: 2h 41m 23s. Rate: 7.1 symbols/min [2025-10-03T19:51:51.995886] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-03T19:51:52.050891] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:52.094103] [DEBUG] [LOCAL ] KTB: Loaded 41321 existing records from primary storage. [2025-10-03T19:51:52.094437] [INFO ] [MAIN ] KTB: Loaded 41321 existing records. [2025-10-03T19:51:52.287240] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:52.287453] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-03T19:51:52.287503] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-03T19:51:52.288002] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-03T19:51:52.288080] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-03T19:51:52.406466] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:51:52.422606] [INFO ] [REMOTE ] KRP: Full fetch complete (54902 records). [2025-10-03T19:51:52.438159] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-03T19:51:52.809935] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-03T19:51:52.921139] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:53.126181] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-03T19:51:53.126278] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-03T19:51:53.127227] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-03T19:51:53.127301] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-03T19:51:53.128582] [DEBUG] [LOCAL ] KRP: Trimmed 54902 records to 37479 (keeping 200 days of data) [2025-10-03T19:51:53.377882] [DEBUG] [LOCAL ] KRP: Primary data saved (37479 records). [2025-10-03T19:51:53.378075] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-03T19:51:53.378213] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRP took 34.7s. Estimated remaining: 2h 41m 8s. Rate: 7.1 symbols/min [2025-10-03T19:51:53.567505] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:51:53.582284] [DEBUG] [LOCAL ] KTF: Loaded 12632 existing records from primary storage. [2025-10-03T19:51:53.582547] [INFO ] [MAIN ] KTF: Loaded 12632 existing records. [2025-10-03T19:51:53.618548] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-03T19:51:53.799864] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:51:53.800221] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-03T19:51:53.800329] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-03T19:51:53.801303] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-03T19:51:53.801367] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-03T19:51:54.211940] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:51:54.244599] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-03T19:51:54.390689] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-03T19:51:54.609061] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-03T19:51:54.695918] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-03T19:51:55.190681] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-03T19:51:55.323099] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-03T19:51:55.990741] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-03T19:51:56.790741] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-03T19:51:57.200282] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-03T19:51:57.363347] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-03T19:51:57.376964] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-03T19:51:57.590720] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-03T19:51:58.390710] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-03T19:51:59.043536] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:51:59.190628] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-03T19:51:59.345789] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:51:59.990727] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-03T19:52:00.656305] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-03T19:52:00.790740] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-03T19:52:01.590690] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-03T19:52:01.948067] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:52:02.171978] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:52:02.390687] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-03T19:52:02.605033] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T19:52:03.190714] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-03T19:52:03.990703] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-03T19:52:04.059619] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-03T19:52:04.790695] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-03T19:52:05.070365] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-03T19:52:05.590735] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-03T19:52:05.770597] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-03T19:52:05.950062] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:52:06.390696] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-03T19:52:07.167685] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-03T19:52:07.190632] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-03T19:52:07.231089] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-03T19:52:07.990696] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-03T19:52:08.790704] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-03T19:52:08.906240] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:52:09.413012] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-03T19:52:09.590710] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-03T19:52:10.174911] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-03T19:52:10.390689] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-03T19:52:10.904326] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-03T19:52:11.190688] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-03T19:52:11.921279] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:52:11.990731] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-03T19:52:12.790667] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-03T19:52:12.823711] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:52:12.843420] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-03T19:52:13.590700] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-03T19:52:14.147279] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-03T19:52:14.373008] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-03T19:52:14.390752] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-03T19:52:15.190673] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-03T19:52:15.983020] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-03T19:52:15.992485] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-03T19:52:16.756917] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-03T19:52:16.790621] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-03T19:52:16.913487] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-03T19:52:17.417665] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-03T19:52:17.418763] [INFO ] [REMOTE ] KTF: Full fetch complete (17769 records). [2025-10-03T19:52:17.418842] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-03T19:52:17.602627] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-03T19:52:17.848155] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-03T19:52:17.848239] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-03T19:52:17.848746] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-03T19:52:17.848828] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-03T19:52:17.849629] [DEBUG] [LOCAL ] KTF: Trimmed 17769 records to 12698 (keeping 200 days of data) [2025-10-03T19:52:17.933568] [DEBUG] [LOCAL ] KTF: Primary data saved (12698 records). [2025-10-03T19:52:17.933744] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-03T19:52:17.933841] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KTF took 24.6s. Estimated remaining: 2h 41m 15s. Rate: 7.1 symbols/min [2025-10-03T19:52:18.158437] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:18.158862] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-03T19:52:18.158926] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-03T19:52:18.159221] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-03T19:52:18.159289] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-03T19:52:18.159358] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-03T19:52:18.159398] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-03T19:52:18.395820] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-03T19:52:18.564779] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:19.190634] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-03T19:52:19.540964] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:52:19.995803] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-03T19:52:20.017118] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-03T19:52:20.777486] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:52:20.790611] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-03T19:52:21.410131] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-03T19:52:21.415988] [INFO ] [REMOTE ] KSS: Full fetch complete (77633 records). [2025-10-03T19:52:21.416288] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-03T19:52:21.591983] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-03T19:52:21.850976] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-03T19:52:21.851108] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-03T19:52:21.852396] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-03T19:52:21.852485] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-03T19:52:21.854462] [DEBUG] [LOCAL ] KSS: Trimmed 77633 records to 54381 (keeping 200 days of data) [2025-10-03T19:52:21.993870] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-03T19:52:22.237350] [DEBUG] [LOCAL ] KSS: Primary data saved (54381 records). [2025-10-03T19:52:22.237551] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-03T19:52:22.238396] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KSS took 46.2s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-10-03T19:52:22.395788] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-03T19:52:22.443319] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:22.512934] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-10-03T19:52:22.513382] [INFO ] [MAIN ] KVUE: Loaded 54057 existing records. [2025-10-03T19:52:22.724688] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:22.725008] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-03T19:52:22.725070] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-03T19:52:22.725681] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-03T19:52:22.725748] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-03T19:52:23.130908] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:23.190702] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-03T19:52:23.386909] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-03T19:52:23.660383] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:52:23.662526] [INFO ] [REMOTE ] KTB: Full fetch complete (57964 records). [2025-10-03T19:52:23.662787] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-03T19:52:23.995909] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-03T19:52:24.075639] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-03T19:52:24.075759] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-03T19:52:24.076779] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-03T19:52:24.076847] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-03T19:52:24.078175] [DEBUG] [LOCAL ] KTB: Trimmed 57964 records to 41546 (keeping 200 days of data) [2025-10-03T19:52:24.354823] [DEBUG] [LOCAL ] KTB: Primary data saved (41546 records). [2025-10-03T19:52:24.354961] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-03T19:52:24.355086] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KTB took 32.5s. Estimated remaining: 2h 40m 48s. Rate: 7.1 symbols/min [2025-10-03T19:52:24.535961] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:24.589228] [DEBUG] [LOCAL ] KVYO: Loaded 50458 existing records from primary storage. [2025-10-03T19:52:24.589560] [INFO ] [MAIN ] KVYO: Loaded 50458 existing records. [2025-10-03T19:52:24.786924] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:24.787266] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-03T19:52:24.787348] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-03T19:52:24.787905] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-03T19:52:24.787983] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-03T19:52:24.799559] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-03T19:52:25.205952] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:25.238196] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-03T19:52:25.238914] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-03T19:52:25.254505] [INFO ] [REMOTE ] KT: Full fetch complete (66637 records). [2025-10-03T19:52:25.254696] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-03T19:52:25.584680] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-03T19:52:25.598145] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-03T19:52:25.703265] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-03T19:52:25.703347] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-03T19:52:25.704348] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-03T19:52:25.704424] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-03T19:52:25.705892] [DEBUG] [LOCAL ] KT: Trimmed 66637 records to 46344 (keeping 200 days of data) [2025-10-03T19:52:26.000006] [DEBUG] [LOCAL ] KT: Primary data saved (46344 records). [2025-10-03T19:52:26.000147] [INFO ] [MAIN ] KT: Full history saved. [2025-10-03T19:52:26.000270] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KT took 39.9s. Estimated remaining: 2h 40m 33s. Rate: 7.1 symbols/min [2025-10-03T19:52:26.192959] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:26.234118] [DEBUG] [LOCAL ] KW: Loaded 40831 existing records from primary storage. [2025-10-03T19:52:26.234519] [INFO ] [MAIN ] KW: Loaded 40831 existing records. [2025-10-03T19:52:26.398351] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-03T19:52:26.444420] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:26.444735] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-03T19:52:26.444801] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-03T19:52:26.445277] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-03T19:52:26.445338] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-03T19:52:26.869976] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:27.190733] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-03T19:52:27.328408] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-03T19:52:27.387959] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:52:27.990701] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-03T19:52:28.539983] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-03T19:52:28.717942] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-03T19:52:28.790706] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-03T19:52:29.590737] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-03T19:52:30.390633] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-03T19:52:30.517078] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-03T19:52:31.190737] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-03T19:52:31.257504] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:52:31.377365] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:52:31.990632] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-03T19:52:32.071549] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-03T19:52:32.790702] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-03T19:52:33.340302] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-03T19:52:33.590720] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-03T19:52:33.695832] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-03T19:52:34.390681] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-03T19:52:34.831782] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-03T19:52:34.855356] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-03T19:52:35.190722] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-03T19:52:35.990694] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-03T19:52:36.790677] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-03T19:52:36.875079] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-03T19:52:37.365667] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-03T19:52:37.392328] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-03T19:52:37.590720] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-03T19:52:38.390675] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-03T19:52:39.158545] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:52:39.190634] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-03T19:52:39.990744] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-03T19:52:40.237699] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-03T19:52:40.790631] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-03T19:52:40.915787] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:52:41.548230] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-03T19:52:41.590636] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-03T19:52:42.390668] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-03T19:52:42.543996] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-03T19:52:43.118112] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-03T19:52:43.190668] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-03T19:52:43.990717] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-03T19:52:44.075552] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-03T19:52:44.602013] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-03T19:52:44.632463] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-03T19:52:44.790712] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-03T19:52:45.387614] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-03T19:52:45.590694] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-03T19:52:46.390680] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-03T19:52:47.190725] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-03T19:52:47.341174] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:52:47.798029] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-03T19:52:47.990760] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-03T19:52:48.780456] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-03T19:52:48.790676] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-03T19:52:49.132364] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-03T19:52:49.590728] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-03T19:52:49.600234] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-03T19:52:49.602041] [INFO ] [REMOTE ] KUKE: Full fetch complete (8552 records). [2025-10-03T19:52:49.602162] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-03T19:52:49.890449] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-03T19:52:49.890770] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-03T19:52:49.890833] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-03T19:52:49.890902] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-03T19:52:49.890970] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-03T19:52:49.891008] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-03T19:52:49.891052] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-03T19:52:49.891114] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KUKE took 32.0s. Estimated remaining: 2h 40m 39s. Rate: 7.1 symbols/min [2025-10-03T19:52:50.076183] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:50.098985] [DEBUG] [LOCAL ] KWR: Loaded 16654 existing records from primary storage. [2025-10-03T19:52:50.099232] [INFO ] [MAIN ] KWR: Loaded 16654 existing records. [2025-10-03T19:52:50.289041] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:50.289281] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-03T19:52:50.289332] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-03T19:52:50.289701] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-03T19:52:50.289762] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-03T19:52:50.395637] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-03T19:52:50.686118] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:51.019385] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-03T19:52:51.190711] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-03T19:52:51.990749] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-03T19:52:52.021289] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:52:52.790715] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-03T19:52:52.950164] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-03T19:52:52.973527] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:52:53.590709] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-03T19:52:54.390637] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-03T19:52:54.445398] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-03T19:52:54.551498] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-03T19:52:55.190700] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-03T19:52:55.990703] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-03T19:52:56.354463] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-03T19:52:56.790679] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-03T19:52:56.890323] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:52:57.215117] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-03T19:52:57.217512] [INFO ] [REMOTE ] KW: Full fetch complete (57110 records). [2025-10-03T19:52:57.217702] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-03T19:52:57.550611] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:52:57.595757] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-03T19:52:57.671789] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-03T19:52:57.671961] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-03T19:52:57.673086] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-03T19:52:57.673158] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-03T19:52:57.674992] [DEBUG] [LOCAL ] KW: Trimmed 57110 records to 41133 (keeping 200 days of data) [2025-10-03T19:52:57.932006] [DEBUG] [LOCAL ] KW: Primary data saved (41133 records). [2025-10-03T19:52:57.932136] [INFO ] [MAIN ] KW: Full history saved. [2025-10-03T19:52:57.932219] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KW took 31.9s. Estimated remaining: 2h 40m 31s. Rate: 7.1 symbols/min [2025-10-03T19:52:58.138790] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:52:58.172877] [DEBUG] [LOCAL ] KYN: Loaded 30181 existing records from primary storage. [2025-10-03T19:52:58.173224] [INFO ] [MAIN ] KYN: Loaded 30181 existing records. [2025-10-03T19:52:58.382124] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:52:58.382360] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-03T19:52:58.382410] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-03T19:52:58.382778] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-03T19:52:58.382852] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-03T19:52:58.395782] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-03T19:52:58.780774] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:52:59.190699] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-03T19:52:59.371737] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-03T19:52:59.905168] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-03T19:52:59.990720] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-03T19:53:00.083185] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-03T19:53:00.790716] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-03T19:53:01.015800] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-03T19:53:01.590680] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-03T19:53:02.055176] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-03T19:53:02.390687] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-03T19:53:02.851730] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-03T19:53:02.854273] [INFO ] [REMOTE ] KVYO: Full fetch complete (71720 records). [2025-10-03T19:53:02.854449] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-03T19:53:03.195739] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-03T19:53:03.307177] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-03T19:53:03.307276] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-03T19:53:03.308437] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-03T19:53:03.308522] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-03T19:53:03.310111] [DEBUG] [LOCAL ] KVYO: Trimmed 71720 records to 50847 (keeping 200 days of data) [2025-10-03T19:53:03.625223] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:53:03.644620] [DEBUG] [LOCAL ] KVYO: Primary data saved (50847 records). [2025-10-03T19:53:03.644808] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-03T19:53:03.644922] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KVYO took 39.3s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-03T19:53:03.832016] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:03.877143] [DEBUG] [LOCAL ] L: Loaded 41305 existing records from primary storage. [2025-10-03T19:53:03.877570] [INFO ] [MAIN ] L: Loaded 41305 existing records. [2025-10-03T19:53:03.995857] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-03T19:53:04.070875] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:04.071114] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-03T19:53:04.071166] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-03T19:53:04.071504] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-03T19:53:04.071578] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-03T19:53:04.457483] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:04.475089] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-03T19:53:04.790695] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-03T19:53:05.100129] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-03T19:53:05.590684] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-03T19:53:06.390701] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-03T19:53:07.116059] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-03T19:53:07.155703] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-03T19:53:07.190615] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-03T19:53:07.770583] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-03T19:53:07.990712] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-03T19:53:08.790718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-03T19:53:09.417837] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-03T19:53:09.457434] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-03T19:53:09.460847] [INFO ] [REMOTE ] KVUE: Full fetch complete (77674 records). [2025-10-03T19:53:09.460988] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-03T19:53:09.596703] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-03T19:53:09.913020] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-03T19:53:09.912586] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-03T19:53:09.917097] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-03T19:53:09.918764] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-03T19:53:09.919196] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-03T19:53:09.920631] [DEBUG] [LOCAL ] KVUE: Trimmed 77674 records to 54447 (keeping 200 days of data) [2025-10-03T19:53:10.271798] [DEBUG] [LOCAL ] KVUE: Primary data saved (54447 records). [2025-10-03T19:53:10.271955] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-03T19:53:10.272633] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KVUE took 48.0s. Estimated remaining: 2h 40m 10s. Rate: 7.1 symbols/min [2025-10-03T19:53:10.395723] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-03T19:53:10.466275] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:10.521140] [DEBUG] [LOCAL ] LAC: Loaded 52752 existing records from primary storage. [2025-10-03T19:53:10.521474] [INFO ] [MAIN ] LAC: Loaded 52752 existing records. [2025-10-03T19:53:10.712707] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:10.712960] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-03T19:53:10.713147] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-03T19:53:10.713679] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-03T19:53:10.713753] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-03T19:53:11.083932] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:53:11.148700] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:11.190610] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-03T19:53:11.521520] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-03T19:53:11.990707] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-03T19:53:12.790699] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-03T19:53:13.246476] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-03T19:53:13.281147] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-03T19:53:13.590696] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-03T19:53:14.235853] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-03T19:53:14.390707] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-03T19:53:15.190638] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-03T19:53:15.286808] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:53:15.659760] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-03T19:53:15.990724] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-03T19:53:16.256469] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-03T19:53:16.790700] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-03T19:53:17.590680] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-03T19:53:17.833357] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:53:18.348415] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-03T19:53:18.390739] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-03T19:53:18.408513] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-03T19:53:19.190717] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-03T19:53:19.905070] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-03T19:53:19.907582] [INFO ] [REMOTE ] KWR: Full fetch complete (23960 records). [2025-10-03T19:53:19.908070] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-03T19:53:19.999387] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-03T19:53:20.428246] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-03T19:53:20.428516] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-03T19:53:20.429638] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-03T19:53:20.429782] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-03T19:53:20.431164] [DEBUG] [LOCAL ] KWR: Trimmed 23960 records to 16741 (keeping 200 days of data) [2025-10-03T19:53:20.548265] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-03T19:53:20.591604] [DEBUG] [LOCAL ] KWR: Primary data saved (16741 records). [2025-10-03T19:53:20.591850] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-03T19:53:20.591985] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KWR took 30.7s. Estimated remaining: 2h 40m 3s. Rate: 7.1 symbols/min [2025-10-03T19:53:20.778433] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:20.796391] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-03T19:53:20.810102] [DEBUG] [LOCAL ] LAD: Loaded 23644 existing records from primary storage. [2025-10-03T19:53:20.810554] [INFO ] [MAIN ] LAD: Loaded 23644 existing records. [2025-10-03T19:53:21.007949] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:21.008313] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-03T19:53:21.008367] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-03T19:53:21.008768] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-03T19:53:21.008836] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-03T19:53:21.391458] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:21.590765] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-03T19:53:21.620572] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-03T19:53:22.199576] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-03T19:53:22.390766] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-03T19:53:23.190744] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-03T19:53:23.502838] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-03T19:53:23.656397] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-03T19:53:23.990635] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-03T19:53:24.457620] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-03T19:53:24.790757] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-03T19:53:24.977546] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-03T19:53:25.590726] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-03T19:53:26.152929] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-03T19:53:26.350136] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:53:26.390767] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-03T19:53:27.190737] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-03T19:53:27.615122] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-03T19:53:27.990766] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-03T19:53:28.220819] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-03T19:53:28.222567] [INFO ] [REMOTE ] KYN: Full fetch complete (44551 records). [2025-10-03T19:53:28.222690] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-03T19:53:28.635895] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-03T19:53:28.636084] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-03T19:53:28.637059] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-03T19:53:28.637127] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-03T19:53:28.638365] [DEBUG] [LOCAL ] KYN: Trimmed 44551 records to 30355 (keeping 200 days of data) [2025-10-03T19:53:28.791421] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-03T19:53:28.834904] [DEBUG] [LOCAL ] KYN: Primary data saved (30355 records). [2025-10-03T19:53:28.835112] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-03T19:53:28.835279] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KYN took 30.9s. Estimated remaining: 2h 39m 54s. Rate: 7.1 symbols/min [2025-10-03T19:53:29.033236] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:29.074282] [DEBUG] [LOCAL ] LADR: Loaded 39182 existing records from primary storage. [2025-10-03T19:53:29.074598] [INFO ] [MAIN ] LADR: Loaded 39182 existing records. [2025-10-03T19:53:29.276777] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:29.277126] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-03T19:53:29.277189] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-03T19:53:29.277736] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-03T19:53:29.277799] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-03T19:53:29.595749] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-03T19:53:29.662883] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:29.691768] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-03T19:53:30.390741] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-03T19:53:30.526232] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-03T19:53:31.090348] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-03T19:53:31.190692] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-03T19:53:31.892320] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-03T19:53:31.990681] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-03T19:53:32.647576] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-03T19:53:32.790740] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-03T19:53:33.158489] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-03T19:53:33.590725] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-03T19:53:34.390631] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-03T19:53:34.650461] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:53:34.708678] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T19:53:35.190726] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-03T19:53:35.751852] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:53:35.990688] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-03T19:53:36.790673] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-03T19:53:36.984419] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-03T19:53:37.336543] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-03T19:53:37.590741] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-03T19:53:38.162779] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-03T19:53:38.390689] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-03T19:53:39.118203] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-03T19:53:39.190703] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-03T19:53:39.822893] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-03T19:53:39.990749] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-03T19:53:40.688226] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:53:40.790688] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-03T19:53:41.590983] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-03T19:53:41.595425] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-03T19:53:42.017582] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:53:42.020142] [INFO ] [REMOTE ] L: Full fetch complete (59503 records). [2025-10-03T19:53:42.020296] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-03T19:53:42.395828] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-03T19:53:42.536286] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-03T19:53:42.536424] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-03T19:53:42.538216] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-03T19:53:42.538301] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-03T19:53:42.540230] [DEBUG] [LOCAL ] L: Trimmed 59503 records to 41625 (keeping 200 days of data) [2025-10-03T19:53:42.861105] [DEBUG] [LOCAL ] L: Primary data saved (41625 records). [2025-10-03T19:53:42.861278] [INFO ] [MAIN ] L: Full history saved. [2025-10-03T19:53:42.861556] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. L took 39.2s. Estimated remaining: 2h 39m 51s. Rate: 7.1 symbols/min [2025-10-03T19:53:43.056430] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:43.063024] [DEBUG] [LOCAL ] LANV: Loaded 2845 existing records from primary storage. [2025-10-03T19:53:43.063215] [INFO ] [MAIN ] LANV: Loaded 2845 existing records. [2025-10-03T19:53:43.195815] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-03T19:53:43.263141] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:43.263476] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-03T19:53:43.263532] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-03T19:53:43.264083] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-03T19:53:43.264175] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-03T19:53:43.679944] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:43.697613] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-03T19:53:43.906795] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-10-03T19:53:43.990633] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-03T19:53:44.721308] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-03T19:53:44.790685] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-03T19:53:45.590704] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-03T19:53:46.207116] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-03T19:53:46.252376] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-03T19:53:46.390694] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-03T19:53:46.629296] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-03T19:53:46.798804] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-03T19:53:47.190727] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-03T19:53:47.990725] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-03T19:53:48.415320] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-03T19:53:48.790699] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-03T19:53:49.590718] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-03T19:53:50.084973] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-03T19:53:50.087887] [INFO ] [REMOTE ] LAC: Full fetch complete (75992 records). [2025-10-03T19:53:50.088133] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-03T19:53:50.401084] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-03T19:53:50.558445] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-03T19:53:50.589533] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-03T19:53:50.589784] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-03T19:53:50.600142] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-03T19:53:50.601578] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-03T19:53:50.601702] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-03T19:53:50.603555] [DEBUG] [LOCAL ] LAC: Trimmed 75992 records to 53142 (keeping 200 days of data) [2025-10-03T19:53:50.917395] [DEBUG] [LOCAL ] LAC: Primary data saved (53142 records). [2025-10-03T19:53:50.917543] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-03T19:53:50.918910] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. LAC took 40.6s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-10-03T19:53:51.013154] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-03T19:53:51.135806] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:51.136028] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-03T19:53:51.136085] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-03T19:53:51.136204] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-03T19:53:51.136248] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-03T19:53:51.136290] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-03T19:53:51.136327] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-03T19:53:51.195873] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-03T19:53:51.517714] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:51.710609] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-03T19:53:51.990711] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-03T19:53:52.466774] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-03T19:53:52.790724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-03T19:53:53.590762] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-03T19:53:54.175120] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-03T19:53:54.355114] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-03T19:53:54.357152] [INFO ] [REMOTE ] LAD: Full fetch complete (35397 records). [2025-10-03T19:53:54.357276] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-03T19:53:54.395771] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-03T19:53:54.680567] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-03T19:53:54.680981] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-03T19:53:54.686736] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-03T19:53:54.697060] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-03T19:53:54.702305] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-03T19:53:54.733387] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-03T19:53:54.765270] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-03T19:53:54.774927] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-03T19:53:54.775032] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-03T19:53:54.775179] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-03T19:53:54.775129] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-03T19:53:54.776010] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-03T19:53:54.776091] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-03T19:53:54.776470] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LAR took 3.9s. Estimated remaining: 2h 39m 29s. Rate: 7.1 symbols/min [2025-10-03T19:53:54.867089] [DEBUG] [LOCAL ] LAD: Trimmed 35397 records to 23804 (keeping 200 days of data) [2025-10-03T19:53:55.062427] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:53:55.120948] [DEBUG] [LOCAL ] LAW: Loaded 14185 existing records from primary storage. [2025-10-03T19:53:55.129083] [INFO ] [MAIN ] LAW: Loaded 14185 existing records. [2025-10-03T19:53:55.190740] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-03T19:53:55.263702] [DEBUG] [LOCAL ] LAD: Primary data saved (23804 records). [2025-10-03T19:53:55.279262] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-03T19:53:55.279424] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. LAD took 34.7s. Estimated remaining: 2h 39m 14s. Rate: 7.1 symbols/min [2025-10-03T19:53:55.335572] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:53:55.335810] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-03T19:53:55.335861] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-03T19:53:55.336091] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-03T19:53:55.336150] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-03T19:53:55.669711] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-03T19:53:55.794122] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:53:55.990717] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-03T19:53:56.790690] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-03T19:53:56.978898] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-03T19:53:57.268755] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-03T19:53:57.590691] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-03T19:53:58.058794] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-03T19:53:58.390685] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-03T19:53:59.190693] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-03T19:53:59.270053] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-03T19:53:59.990683] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-03T19:54:00.581619] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-03T19:54:00.618466] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-03T19:54:00.790685] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-03T19:54:01.366272] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T19:54:01.590722] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-03T19:54:02.390722] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-03T19:54:02.990168] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-03T19:54:02.992475] [INFO ] [REMOTE ] LADR: Full fetch complete (55473 records). [2025-10-03T19:54:02.992574] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-03T19:54:03.058127] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:54:03.092212] [INFO ] [REMOTE ] LANV: Full fetch complete (4463 records). [2025-10-03T19:54:03.106737] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-03T19:54:03.196907] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-03T19:54:03.797103] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-03T19:54:03.818163] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-03T19:54:03.834536] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-03T19:54:03.860175] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-03T19:54:03.892427] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-03T19:54:03.892829] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-03T19:54:03.892995] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-03T19:54:03.893101] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-03T19:54:03.893773] [DEBUG] [LOCAL ] LANV: Trimmed 4463 records to 2868 (keeping 200 days of data) [2025-10-03T19:54:03.894608] [DEBUG] [LOCAL ] LADR: Trimmed 55473 records to 39456 (keeping 200 days of data) [2025-10-03T19:54:03.911034] [DEBUG] [LOCAL ] LANV: Primary data saved (2868 records). [2025-10-03T19:54:03.911146] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-03T19:54:03.911234] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. LANV took 21.0s. Estimated remaining: 2h 39m 6s. Rate: 7.1 symbols/min [2025-10-03T19:54:04.158545] [DEBUG] [LOCAL ] LADR: Primary data saved (39456 records). [2025-10-03T19:54:04.158729] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-03T19:54:04.158848] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LADR took 35.3s. Estimated remaining: 2h 38m 50s. Rate: 7.1 symbols/min [2025-10-03T19:54:04.192446] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-03T19:54:04.196203] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-03T19:54:04.757708] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-03T19:54:04.790743] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-03T19:54:05.584666] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-03T19:54:05.590601] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-03T19:54:06.595154] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:54:06.601010] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-03T19:54:07.516415] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-03T19:54:07.520394] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-03T19:54:08.438806] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-03T19:54:08.442714] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-03T19:54:09.406288] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-03T19:54:09.413074] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-03T19:54:10.345486] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-03T19:54:10.349886] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-03T19:54:11.252984] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-03T19:54:11.254579] [INFO ] [REMOTE ] LAW: Full fetch complete (20674 records). [2025-10-03T19:54:11.254721] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-03T19:54:11.662381] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-03T19:54:11.662461] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-03T19:54:11.662954] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-03T19:54:11.663017] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-03T19:54:11.663601] [DEBUG] [LOCAL ] LAW: Trimmed 20674 records to 14355 (keeping 200 days of data) [2025-10-03T19:54:11.748730] [DEBUG] [LOCAL ] LAW: Primary data saved (14355 records). [2025-10-03T19:54:11.748886] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-03T19:54:11.748975] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LAW took 17.0s. Estimated remaining: 2h 38m 40s. Rate: 7.1 symbols/min [2025-10-03T19:54:12.460181] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.499453] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.521561] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.554006] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:12.664634] [DEBUG] [LOCAL ] LC: Loaded 48187 existing records from primary storage. [2025-10-03T19:54:12.667021] [DEBUG] [LOCAL ] LB: Loaded 37995 existing records from primary storage. [2025-10-03T19:54:12.667424] [INFO ] [MAIN ] LC: Loaded 48187 existing records. [2025-10-03T19:54:12.668350] [DEBUG] [LOCAL ] LBRT: Loaded 53299 existing records from primary storage. [2025-10-03T19:54:12.668568] [INFO ] [MAIN ] LB: Loaded 37995 existing records. [2025-10-03T19:54:12.743155] [DEBUG] [LOCAL ] LAZ: Loaded 45182 existing records from primary storage. [2025-10-03T19:54:12.719960] [INFO ] [MAIN ] LBRT: Loaded 53299 existing records. [2025-10-03T19:54:12.824419] [INFO ] [MAIN ] LAZ: Loaded 45182 existing records. [2025-10-03T19:54:13.338049] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.430756] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.395802] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.472629] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.468884] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-03T19:54:13.472797] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-03T19:54:13.502811] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.506314] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:13.506664] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.506902] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-03T19:54:13.507057] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-03T19:54:13.507184] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-03T19:54:13.506860] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-03T19:54:13.507538] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-03T19:54:13.507394] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-03T19:54:13.524528] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-03T19:54:13.536707] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-03T19:54:13.631299] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-03T19:54:13.564611] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-03T19:54:13.647037] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-03T19:54:14.991069] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.047379] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.076219] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.076845] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-03T19:54:15.077406] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-03T19:54:15.077147] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-03T19:54:15.168124] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:15.168445] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-03T19:54:16.660464] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:54:16.670512] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-03T19:54:16.773800] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:54:16.786030] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-03T19:54:16.816127] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-03T19:54:16.828274] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-03T19:54:16.864316] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-03T19:54:16.873679] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-03T19:54:18.292697] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-03T19:54:18.305825] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-03T19:54:18.340486] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-03T19:54:18.353493] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-03T19:54:18.385036] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-03T19:54:18.398003] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-03T19:54:18.468369] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-03T19:54:19.190745] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-03T19:54:19.652420] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-03T19:54:19.990632] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-03T19:54:20.068708] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-03T19:54:20.094210] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-03T19:54:20.697916] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-03T19:54:20.790754] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-03T19:54:21.505878] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-03T19:54:21.590619] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-03T19:54:22.391157] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-03T19:54:22.398377] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-03T19:54:23.167746] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:54:23.190615] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-03T19:54:23.990682] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-03T19:54:24.027962] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:54:24.779270] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-03T19:54:24.790611] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-03T19:54:25.590684] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-03T19:54:25.756092] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-03T19:54:26.236804] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-03T19:54:26.390710] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-03T19:54:27.190728] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-03T19:54:27.261945] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-03T19:54:27.862592] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:54:27.990723] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-03T19:54:28.707055] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-03T19:54:28.790721] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-03T19:54:29.590671] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-03T19:54:29.885978] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:54:29.981551] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:54:30.390694] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-03T19:54:30.723174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-03T19:54:31.190699] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-03T19:54:31.990633] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-03T19:54:32.230476] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-03T19:54:32.563769] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-03T19:54:32.790693] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-03T19:54:33.393509] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-03T19:54:33.590691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-03T19:54:34.393683] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-03T19:54:34.403151] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-03T19:54:35.190753] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-03T19:54:35.335923] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-03T19:54:35.693113] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-03T19:54:35.695604] [INFO ] [REMOTE ] LAZ: Full fetch complete (65877 records). [2025-10-03T19:54:35.695824] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-03T19:54:35.995965] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-03T19:54:36.143814] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-03T19:54:36.143913] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-03T19:54:36.145059] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-03T19:54:36.145133] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-03T19:54:36.146778] [DEBUG] [LOCAL ] LAZ: Trimmed 65877 records to 45487 (keeping 200 days of data) [2025-10-03T19:54:36.438467] [DEBUG] [LOCAL ] LAZ: Primary data saved (45487 records). [2025-10-03T19:54:36.438639] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-03T19:54:36.438806] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LAZ took 24.7s. Estimated remaining: 2h 38m 47s. Rate: 7.1 symbols/min [2025-10-03T19:54:36.627309] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:36.658007] [DEBUG] [LOCAL ] LCII: Loaded 28181 existing records from primary storage. [2025-10-03T19:54:36.658634] [INFO ] [MAIN ] LCII: Loaded 28181 existing records. [2025-10-03T19:54:36.784916] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-03T19:54:36.793552] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-03T19:54:36.889742] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:36.890028] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-03T19:54:36.890077] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-03T19:54:36.890353] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-03T19:54:36.890412] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-03T19:54:37.274746] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:37.590719] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-03T19:54:37.822798] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-03T19:54:38.298981] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-03T19:54:38.390666] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-03T19:54:38.632250] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-03T19:54:39.190722] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-03T19:54:39.837105] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T19:54:39.990718] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-03T19:54:40.790635] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-03T19:54:40.996315] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-03T19:54:41.541685] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-03T19:54:41.590726] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-03T19:54:41.893383] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-03T19:54:42.390721] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-03T19:54:43.093858] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-03T19:54:43.152274] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-03T19:54:43.190627] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-03T19:54:43.990702] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-03T19:54:44.660512] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:54:44.790713] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-03T19:54:45.440265] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-03T19:54:45.590704] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-03T19:54:46.362723] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:54:46.390706] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-03T19:54:46.836514] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-03T19:54:46.838874] [INFO ] [REMOTE ] LB: Full fetch complete (55934 records). [2025-10-03T19:54:46.839036] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-03T19:54:47.196676] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-03T19:54:47.256412] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-03T19:54:47.256511] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-03T19:54:47.257452] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-03T19:54:47.257533] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-03T19:54:47.258821] [DEBUG] [LOCAL ] LB: Trimmed 55934 records to 38337 (keeping 200 days of data) [2025-10-03T19:54:47.500321] [DEBUG] [LOCAL ] LB: Primary data saved (38337 records). [2025-10-03T19:54:47.500476] [INFO ] [MAIN ] LB: Full history saved. [2025-10-03T19:54:47.500609] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LB took 35.7s. Estimated remaining: 2h 38m 41s. Rate: 7.1 symbols/min [2025-10-03T19:54:47.683457] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:47.725224] [DEBUG] [LOCAL ] LDI: Loaded 44523 existing records from primary storage. [2025-10-03T19:54:47.725546] [INFO ] [MAIN ] LDI: Loaded 44523 existing records. [2025-10-03T19:54:47.914019] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:47.914274] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-03T19:54:47.914334] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-03T19:54:47.914699] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-03T19:54:47.914758] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-03T19:54:47.992973] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-03T19:54:48.299559] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:48.335778] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-03T19:54:48.498575] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-03T19:54:48.790691] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-03T19:54:49.311700] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-03T19:54:49.316395] [INFO ] [REMOTE ] LC: Full fetch complete (70566 records). [2025-10-03T19:54:49.316516] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-03T19:54:49.596424] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-03T19:54:49.744596] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-03T19:54:49.744713] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-03T19:54:49.745805] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-03T19:54:49.745879] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-03T19:54:49.747439] [DEBUG] [LOCAL ] LC: Trimmed 70566 records to 48516 (keeping 200 days of data) [2025-10-03T19:54:50.047165] [DEBUG] [LOCAL ] LC: Primary data saved (48516 records). [2025-10-03T19:54:50.047335] [INFO ] [MAIN ] LC: Full history saved. [2025-10-03T19:54:50.048200] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LC took 38.3s. Estimated remaining: 2h 38m 27s. Rate: 7.1 symbols/min [2025-10-03T19:54:50.237509] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:50.286689] [DEBUG] [LOCAL ] LDOS: Loaded 45923 existing records from primary storage. [2025-10-03T19:54:50.287017] [INFO ] [MAIN ] LDOS: Loaded 45923 existing records. [2025-10-03T19:54:50.397284] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-03T19:54:50.485398] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:50.485677] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-03T19:54:50.485740] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-03T19:54:50.485992] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-03T19:54:50.486052] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-03T19:54:50.935023] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:50.970159] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-03T19:54:51.130605] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-03T19:54:51.190689] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-03T19:54:51.560837] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:54:51.990790] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-03T19:54:52.460858] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-03T19:54:52.790773] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-03T19:54:53.403747] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-03T19:54:53.590697] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-03T19:54:54.144301] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:54:54.147170] [INFO ] [REMOTE ] LBRT: Full fetch complete (76543 records). [2025-10-03T19:54:54.147288] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-03T19:54:54.395756] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-03T19:54:54.579277] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-03T19:54:54.579370] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-03T19:54:54.580602] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-03T19:54:54.580693] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-03T19:54:54.582254] [DEBUG] [LOCAL ] LBRT: Trimmed 76543 records to 53687 (keeping 200 days of data) [2025-10-03T19:54:54.928131] [DEBUG] [LOCAL ] LBRT: Primary data saved (53687 records). [2025-10-03T19:54:54.928280] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-03T19:54:54.928394] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LBRT took 43.2s. Estimated remaining: 2h 38m 15s. Rate: 7.1 symbols/min [2025-10-03T19:54:55.113904] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:54:55.130693] [DEBUG] [LOCAL ] LDP: Loaded 13028 existing records from primary storage. [2025-10-03T19:54:55.130949] [INFO ] [MAIN ] LDP: Loaded 13028 existing records. [2025-10-03T19:54:55.192460] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-03T19:54:55.333226] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:54:55.333478] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-03T19:54:55.333617] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-03T19:54:55.334009] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-03T19:54:55.334081] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-03T19:54:55.446930] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-03T19:54:55.828589] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:54:55.830613] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-03T19:54:55.990678] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-03T19:54:56.574584] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-03T19:54:56.790709] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-03T19:54:57.176301] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-03T19:54:57.590690] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-03T19:54:58.083046] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-03T19:54:58.390689] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-03T19:54:59.190676] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-03T19:54:59.238602] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:54:59.329618] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:54:59.990702] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-03T19:55:00.665961] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-03T19:55:00.790671] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-03T19:55:01.177732] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-03T19:55:01.590741] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-03T19:55:02.390707] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-03T19:55:02.432426] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:55:02.633088] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-03T19:55:02.634660] [INFO ] [REMOTE ] LCII: Full fetch complete (39170 records). [2025-10-03T19:55:02.634748] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-03T19:55:03.061428] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-03T19:55:03.061537] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-03T19:55:03.062373] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-03T19:55:03.062440] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-03T19:55:03.064025] [DEBUG] [LOCAL ] LCII: Trimmed 39170 records to 28309 (keeping 200 days of data) [2025-10-03T19:55:03.192045] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-03T19:55:03.252852] [DEBUG] [LOCAL ] LCII: Primary data saved (28309 records). [2025-10-03T19:55:03.253006] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-03T19:55:03.253126] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LCII took 26.8s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-03T19:55:03.438475] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:03.483562] [DEBUG] [LOCAL ] LEA: Loaded 42058 existing records from primary storage. [2025-10-03T19:55:03.483915] [INFO ] [MAIN ] LEA: Loaded 42058 existing records. [2025-10-03T19:55:03.677930] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:03.678227] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-03T19:55:03.678292] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-03T19:55:03.678741] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-03T19:55:03.678802] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-03T19:55:03.998034] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-03T19:55:04.119399] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:04.123376] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-03T19:55:04.128604] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-03T19:55:04.790688] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-03T19:55:05.590732] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-03T19:55:05.864300] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-03T19:55:06.236303] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-03T19:55:06.390735] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-03T19:55:07.192314] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-03T19:55:07.195770] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-03T19:55:07.779799] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-03T19:55:07.990639] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-03T19:55:08.131924] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-03T19:55:08.790688] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-03T19:55:09.589974] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-03T19:55:09.598838] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-03T19:55:09.739731] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-03T19:55:10.390699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-03T19:55:11.023028] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-03T19:55:11.190674] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-03T19:55:11.443923] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:55:11.990672] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-03T19:55:12.790692] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-03T19:55:12.874242] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-03T19:55:12.900143] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-03T19:55:13.590691] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-03T19:55:14.390674] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-03T19:55:14.483693] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:55:15.115843] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-03T19:55:15.151171] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-03T19:55:15.190675] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-03T19:55:15.990699] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-03T19:55:16.790678] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-03T19:55:16.941684] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-03T19:55:17.126498] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-03T19:55:17.590722] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-03T19:55:18.390735] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-03T19:55:18.534154] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-03T19:55:18.569275] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-03T19:55:19.190731] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-03T19:55:19.990710] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-03T19:55:20.456800] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-03T19:55:20.460725] [INFO ] [REMOTE ] LDI: Full fetch complete (60709 records). [2025-10-03T19:55:20.460931] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-03T19:55:20.795509] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-03T19:55:20.923927] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-03T19:55:20.924075] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-03T19:55:20.925194] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-03T19:55:20.925283] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-03T19:55:20.947630] [DEBUG] [LOCAL ] LDI: Trimmed 60709 records to 44902 (keeping 200 days of data) [2025-10-03T19:55:20.952904] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:55:21.227707] [DEBUG] [LOCAL ] LDI: Primary data saved (44902 records). [2025-10-03T19:55:21.227852] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-03T19:55:21.227943] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LDI took 33.7s. Estimated remaining: 2h 38m 7s. Rate: 7.1 symbols/min [2025-10-03T19:55:21.434873] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:21.489304] [DEBUG] [LOCAL ] LEG: Loaded 50600 existing records from primary storage. [2025-10-03T19:55:21.489739] [INFO ] [MAIN ] LEG: Loaded 50600 existing records. [2025-10-03T19:55:21.601667] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-03T19:55:21.694434] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:21.694763] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-03T19:55:21.694877] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-03T19:55:21.703600] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-03T19:55:21.716112] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-03T19:55:21.752690] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-03T19:55:21.799057] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-03T19:55:22.169865] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:22.390692] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-03T19:55:23.074394] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:55:23.180151] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-03T19:55:23.181364] [INFO ] [REMOTE ] LDP: Full fetch complete (19390 records). [2025-10-03T19:55:23.181500] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-03T19:55:23.195798] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-03T19:55:23.589091] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-03T19:55:23.589178] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-03T19:55:23.589795] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-03T19:55:23.589864] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-03T19:55:23.590685] [DEBUG] [LOCAL ] LDP: Trimmed 19390 records to 13110 (keeping 200 days of data) [2025-10-03T19:55:23.678514] [DEBUG] [LOCAL ] LDP: Primary data saved (13110 records). [2025-10-03T19:55:23.678704] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-03T19:55:23.678825] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDP took 28.8s. Estimated remaining: 2h 37m 53s. Rate: 7.1 symbols/min [2025-10-03T19:55:23.854129] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:23.911689] [DEBUG] [LOCAL ] LEN: Loaded 53562 existing records from primary storage. [2025-10-03T19:55:23.912076] [INFO ] [MAIN ] LEN: Loaded 53562 existing records. [2025-10-03T19:55:23.995879] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-03T19:55:24.132420] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:24.132691] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-03T19:55:24.132760] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-03T19:55:24.133325] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-03T19:55:24.133389] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-03T19:55:24.575591] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:24.792397] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-03T19:55:24.805873] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-03T19:55:25.165162] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:55:25.590737] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-03T19:55:26.390717] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-03T19:55:26.753919] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-03T19:55:27.190699] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-03T19:55:27.241204] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-03T19:55:27.990682] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-03T19:55:28.090007] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:55:28.697046] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-03T19:55:28.790615] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-03T19:55:29.595813] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-03T19:55:29.610838] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:55:29.788555] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-03T19:55:30.390712] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-03T19:55:31.190727] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-03T19:55:31.233901] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-03T19:55:31.548829] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-03T19:55:31.990716] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-03T19:55:32.790721] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-03T19:55:33.077553] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-03T19:55:33.452885] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-03T19:55:33.455338] [INFO ] [REMOTE ] LDOS: Full fetch complete (67588 records). [2025-10-03T19:55:33.455472] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-03T19:55:33.595853] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-03T19:55:33.911886] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-03T19:55:33.912049] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-03T19:55:33.913321] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-03T19:55:33.913394] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-03T19:55:33.915281] [DEBUG] [LOCAL ] LDOS: Trimmed 67588 records to 46250 (keeping 200 days of data) [2025-10-03T19:55:34.163223] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-03T19:55:34.167388] [INFO ] [REMOTE ] LEA: Full fetch complete (60901 records). [2025-10-03T19:55:34.168530] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-03T19:55:34.395567] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-03T19:55:34.722100] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-03T19:55:34.722799] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-03T19:55:34.724924] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-03T19:55:34.725042] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-03T19:55:34.728954] [DEBUG] [LOCAL ] LEA: Trimmed 60901 records to 42367 (keeping 200 days of data) [2025-10-03T19:55:34.913891] [DEBUG] [LOCAL ] LDOS: Primary data saved (46250 records). [2025-10-03T19:55:34.914827] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-03T19:55:34.915862] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LDOS took 44.9s. Estimated remaining: 2h 37m 47s. Rate: 7.1 symbols/min [2025-10-03T19:55:35.131665] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:35.255063] [DEBUG] [LOCAL ] LEO: Loaded 17395 existing records from primary storage. [2025-10-03T19:55:35.256463] [INFO ] [MAIN ] LEO: Loaded 17395 existing records. [2025-10-03T19:55:35.432512] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-03T19:55:35.520426] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:35.521064] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-03T19:55:35.524381] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-03T19:55:35.524795] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-03T19:55:35.525635] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-03T19:55:35.526514] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-03T19:55:35.900908] [DEBUG] [LOCAL ] LEA: Primary data saved (42367 records). [2025-10-03T19:55:35.916541] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-03T19:55:35.945230] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LEA took 32.7s. Estimated remaining: 2h 37m 32s. Rate: 7.1 symbols/min [2025-10-03T19:55:35.992795] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:36.035501] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-03T19:55:36.183184] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:36.248031] [DEBUG] [LOCAL ] LEVI: Loaded 51949 existing records from primary storage. [2025-10-03T19:55:36.264972] [INFO ] [MAIN ] LEVI: Loaded 51949 existing records. [2025-10-03T19:55:36.328922] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-03T19:55:36.473259] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:36.473543] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-03T19:55:36.473593] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-03T19:55:36.474250] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-03T19:55:36.474313] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-03T19:55:36.795770] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-03T19:55:36.866421] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:37.105578] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-03T19:55:37.280350] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:55:37.590716] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-03T19:55:38.390707] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-03T19:55:38.840345] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-03T19:55:39.190732] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-03T19:55:39.277214] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-03T19:55:39.990717] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-03T19:55:40.051753] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-03T19:55:40.790748] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-03T19:55:40.918304] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-03T19:55:41.007602] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:55:41.590736] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-03T19:55:42.014054] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-03T19:55:42.390732] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-03T19:55:43.190725] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-03T19:55:43.328696] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-03T19:55:43.990700] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-03T19:55:44.093982] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-03T19:55:44.263546] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-03T19:55:44.790722] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-03T19:55:45.590738] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-03T19:55:45.804290] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-03T19:55:45.884205] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-03T19:55:46.390703] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-03T19:55:47.190689] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-03T19:55:47.242911] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:55:47.484994] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:55:47.990716] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-03T19:55:48.790709] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-03T19:55:49.258574] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-03T19:55:49.331735] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-03T19:55:49.590639] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-03T19:55:49.687579] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-03T19:55:50.390685] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-03T19:55:51.190722] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-03T19:55:51.491867] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-03T19:55:51.562162] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-03T19:55:51.564798] [INFO ] [REMOTE ] LEG: Full fetch complete (73055 records). [2025-10-03T19:55:51.564926] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-03T19:55:52.001518] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-03T19:55:52.005325] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-03T19:55:52.006624] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-03T19:55:52.007751] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-03T19:55:52.007924] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-03T19:55:52.009607] [DEBUG] [LOCAL ] LEG: Trimmed 73055 records to 50956 (keeping 200 days of data) [2025-10-03T19:55:52.158882] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-03T19:55:52.377771] [DEBUG] [LOCAL ] LEG: Primary data saved (50956 records). [2025-10-03T19:55:52.377978] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-03T19:55:52.378117] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LEG took 31.2s. Estimated remaining: 2h 37m 31s. Rate: 7.1 symbols/min [2025-10-03T19:55:52.571561] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:55:52.591434] [DEBUG] [LOCAL ] LFT: Loaded 18394 existing records from primary storage. [2025-10-03T19:55:52.591792] [INFO ] [MAIN ] LFT: Loaded 18394 existing records. [2025-10-03T19:55:52.789451] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:55:52.789722] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-03T19:55:52.789794] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-03T19:55:52.790155] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-03T19:55:52.790215] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-03T19:55:52.795794] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-03T19:55:53.225284] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:55:53.502942] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:55:53.590669] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-03T19:55:54.390736] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-03T19:55:55.072162] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-03T19:55:55.148286] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-10-03T19:55:55.190690] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-03T19:55:55.357761] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-03T19:55:55.990634] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-03T19:55:56.054550] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-03T19:55:56.790694] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-03T19:55:57.590700] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-03T19:55:57.794313] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:55:58.390694] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-03T19:55:58.531628] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-03T19:55:59.041380] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-03T19:55:59.190723] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-03T19:55:59.990677] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-03T19:56:00.106223] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-03T19:56:00.154401] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-03T19:56:00.790695] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-03T19:56:01.541682] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:56:01.590671] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-03T19:56:01.808710] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-03T19:56:01.811943] [INFO ] [REMOTE ] LEN: Full fetch complete (77044 records). [2025-10-03T19:56:01.812072] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-03T19:56:02.250178] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-03T19:56:02.250273] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-03T19:56:02.251697] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-03T19:56:02.251789] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-03T19:56:02.253631] [DEBUG] [LOCAL ] LEN: Trimmed 77044 records to 53950 (keeping 200 days of data) [2025-10-03T19:56:02.445886] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-03T19:56:02.442265] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-03T19:56:02.457380] [INFO ] [REMOTE ] LEO: Full fetch complete (26897 records). [2025-10-03T19:56:02.466709] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-03T19:56:03.072563] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-03T19:56:03.073857] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-03T19:56:03.075283] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-03T19:56:03.075671] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-03T19:56:03.085225] [DEBUG] [LOCAL ] LEO: Trimmed 26897 records to 17457 (keeping 200 days of data) [2025-10-03T19:56:03.089787] [DEBUG] [LOCAL ] LEN: Primary data saved (53950 records). [2025-10-03T19:56:03.090209] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-03T19:56:03.090343] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEN took 39.4s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-03T19:56:03.200427] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-03T19:56:03.369553] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:03.396621] [DEBUG] [LOCAL ] LGI: Loaded 9893 existing records from primary storage. [2025-10-03T19:56:03.397734] [INFO ] [MAIN ] LGI: Loaded 9893 existing records. [2025-10-03T19:56:03.511052] [DEBUG] [LOCAL ] LEO: Primary data saved (17457 records). [2025-10-03T19:56:03.511608] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-03T19:56:03.527687] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEO took 28.6s. Estimated remaining: 2h 37m 9s. Rate: 7.1 symbols/min [2025-10-03T19:56:03.689355] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:03.717677] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-03T19:56:03.721394] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-03T19:56:03.727255] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-03T19:56:03.732588] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-03T19:56:03.895834] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:04.163784] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-03T19:56:04.223322] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:04.224110] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-03T19:56:04.237700] [DEBUG] [LOCAL ] LH: Loaded 38094 existing records from primary storage. [2025-10-03T19:56:04.238067] [INFO ] [MAIN ] LH: Loaded 38094 existing records. [2025-10-03T19:56:04.412259] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-03T19:56:04.490579] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:04.490971] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-03T19:56:04.491056] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-03T19:56:04.491873] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-03T19:56:04.491935] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-03T19:56:04.796439] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-03T19:56:04.885105] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:05.067746] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-03T19:56:05.590669] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-03T19:56:05.659596] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-03T19:56:06.390679] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-03T19:56:07.064360] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-03T19:56:07.190702] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-03T19:56:07.947431] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-03T19:56:07.990677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-03T19:56:08.266477] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:56:08.505136] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-03T19:56:08.790727] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-03T19:56:09.590686] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-03T19:56:10.390696] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-03T19:56:10.464484] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-03T19:56:10.676978] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-03T19:56:11.190680] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-03T19:56:11.888379] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-03T19:56:11.990682] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-03T19:56:12.192281] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-03T19:56:12.790707] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-03T19:56:13.461624] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-03T19:56:13.488637] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-03T19:56:13.590673] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-03T19:56:14.390676] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-03T19:56:15.138019] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-03T19:56:15.190712] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-03T19:56:15.464578] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-03T19:56:15.990744] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-03T19:56:16.790677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-03T19:56:16.986255] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-03T19:56:17.571863] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-03T19:56:17.590634] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-03T19:56:17.738076] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-03T19:56:18.390735] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-03T19:56:18.413576] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-03T19:56:19.190698] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-03T19:56:19.945727] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-03T19:56:19.948417] [INFO ] [REMOTE ] LEVI: Full fetch complete (74495 records). [2025-10-03T19:56:19.948566] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-03T19:56:19.995771] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-03T19:56:20.395925] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-03T19:56:20.396124] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-03T19:56:20.397537] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-03T19:56:20.397751] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-03T19:56:20.399464] [DEBUG] [LOCAL ] LEVI: Trimmed 74495 records to 52330 (keeping 200 days of data) [2025-10-03T19:56:20.666203] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-03T19:56:20.794303] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-03T19:56:20.800451] [DEBUG] [LOCAL ] LEVI: Primary data saved (52330 records). [2025-10-03T19:56:20.801158] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-03T19:56:20.802559] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-03T19:56:20.806105] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LEVI took 44.8s. Estimated remaining: 2h 37m 8s. Rate: 7.1 symbols/min [2025-10-03T19:56:21.004867] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:21.069975] [DEBUG] [LOCAL ] LHX: Loaded 49032 existing records from primary storage. [2025-10-03T19:56:21.070330] [INFO ] [MAIN ] LHX: Loaded 49032 existing records. [2025-10-03T19:56:21.272969] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:21.273212] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-03T19:56:21.273263] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-03T19:56:21.273751] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-03T19:56:21.273811] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-03T19:56:21.595870] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-03T19:56:21.670932] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:22.199566] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-03T19:56:22.390670] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-03T19:56:22.426707] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:56:23.190716] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-03T19:56:23.288177] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-03T19:56:23.990729] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-03T19:56:24.725747] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-03T19:56:24.790674] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-03T19:56:25.150510] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-03T19:56:25.331984] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-03T19:56:25.590678] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-03T19:56:26.390688] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-03T19:56:26.979040] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-03T19:56:27.190711] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-03T19:56:27.510363] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:56:27.990733] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-03T19:56:28.586622] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-03T19:56:28.790826] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-03T19:56:29.042455] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-03T19:56:29.380550] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-03T19:56:29.381494] [INFO ] [REMOTE ] LGI: Full fetch complete (14269 records). [2025-10-03T19:56:29.381567] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-03T19:56:29.601023] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-03T19:56:29.781170] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-03T19:56:29.781255] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-03T19:56:29.781638] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-03T19:56:29.781721] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-03T19:56:29.782264] [DEBUG] [LOCAL ] LGI: Trimmed 14269 records to 9934 (keeping 200 days of data) [2025-10-03T19:56:29.845636] [DEBUG] [LOCAL ] LGI: Primary data saved (9934 records). [2025-10-03T19:56:29.845821] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-03T19:56:29.845960] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LGI took 26.8s. Estimated remaining: 2h 37m 0s. Rate: 7.1 symbols/min [2025-10-03T19:56:30.030431] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:30.059429] [DEBUG] [LOCAL ] LII: Loaded 28170 existing records from primary storage. [2025-10-03T19:56:30.059740] [INFO ] [MAIN ] LII: Loaded 28170 existing records. [2025-10-03T19:56:30.255281] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:30.255536] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-03T19:56:30.255591] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-03T19:56:30.255900] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-03T19:56:30.255961] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-03T19:56:30.395926] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-03T19:56:30.661678] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:31.190721] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-03T19:56:31.346123] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-03T19:56:31.793018] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-03T19:56:31.990749] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-03T19:56:32.499143] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-03T19:56:32.790746] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-03T19:56:33.590704] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-03T19:56:33.642186] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-03T19:56:33.828939] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-03T19:56:34.367015] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-03T19:56:34.368310] [INFO ] [REMOTE ] LFT: Full fetch complete (24056 records). [2025-10-03T19:56:34.368399] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-03T19:56:34.398937] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-03T19:56:34.779285] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-03T19:56:34.779377] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-03T19:56:34.779953] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-03T19:56:34.780024] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-03T19:56:34.780862] [DEBUG] [LOCAL ] LFT: Trimmed 24056 records to 18523 (keeping 200 days of data) [2025-10-03T19:56:34.893269] [DEBUG] [LOCAL ] LFT: Primary data saved (18523 records). [2025-10-03T19:56:34.893424] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-03T19:56:34.893544] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LFT took 42.5s. Estimated remaining: 2h 36m 49s. Rate: 7.1 symbols/min [2025-10-03T19:56:35.089509] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:35.089759] [DEBUG] [LOCAL ] LION: No existing data file found in primary storage. [2025-10-03T19:56:35.089836] [WARN ] [MAIN ] LION: No existing data found, performing full refresh instead. [2025-10-03T19:56:35.089989] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-03T19:56:35.090053] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-03T19:56:35.090123] [DEBUG] [LOCAL ] LION: No primary data file found to delete. [2025-10-03T19:56:35.090179] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-03T19:56:35.195740] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-03T19:56:35.512012] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:35.990692] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-03T19:56:36.178121] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:56:36.228985] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-03T19:56:36.790685] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-03T19:56:37.124793] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-03T19:56:37.590730] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-03T19:56:38.113068] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-03T19:56:38.390740] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-03T19:56:38.729684] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-03T19:56:38.732204] [INFO ] [REMOTE ] LH: Full fetch complete (55026 records). [2025-10-03T19:56:38.732357] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-03T19:56:39.157589] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-03T19:56:39.157775] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-03T19:56:39.158882] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-03T19:56:39.158950] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-03T19:56:39.160281] [DEBUG] [LOCAL ] LH: Trimmed 55026 records to 38370 (keeping 200 days of data) [2025-10-03T19:56:39.217461] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-03T19:56:39.409786] [DEBUG] [LOCAL ] LH: Primary data saved (38370 records). [2025-10-03T19:56:39.409975] [INFO ] [MAIN ] LH: Full history saved. [2025-10-03T19:56:39.410089] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LH took 35.9s. Estimated remaining: 2h 36m 37s. Rate: 7.1 symbols/min [2025-10-03T19:56:39.606561] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:56:39.613402] [DEBUG] [LOCAL ] LITB: Loaded 4368 existing records from primary storage. [2025-10-03T19:56:39.613611] [INFO ] [MAIN ] LITB: Loaded 4368 existing records. [2025-10-03T19:56:39.815413] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:56:39.815704] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-03T19:56:39.815858] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-03T19:56:39.816119] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-03T19:56:39.816180] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-03T19:56:39.991981] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-03T19:56:40.166432] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-03T19:56:40.267620] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:56:40.790716] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-03T19:56:41.107565] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:56:41.139137] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-03T19:56:41.236296] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-03T19:56:41.590675] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-03T19:56:42.390719] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-03T19:56:42.643975] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:56:43.190697] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-03T19:56:43.722131] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-03T19:56:43.990705] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-03T19:56:44.292941] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-03T19:56:44.790713] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-03T19:56:45.008887] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-03T19:56:45.590671] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-03T19:56:46.022202] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-03T19:56:46.390708] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-03T19:56:46.752947] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-03T19:56:47.190693] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-03T19:56:47.360601] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-03T19:56:47.827484] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:56:47.990716] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-03T19:56:48.790679] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-03T19:56:48.809141] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-03T19:56:49.590636] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-03T19:56:50.013261] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-03T19:56:50.390697] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-03T19:56:50.893776] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-03T19:56:51.190667] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-03T19:56:51.458630] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-03T19:56:51.990707] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-03T19:56:52.798994] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-03T19:56:52.804764] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:56:53.147118] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:56:53.590677] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-03T19:56:54.390727] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-03T19:56:54.604090] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-03T19:56:54.785244] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-03T19:56:54.956705] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-03T19:56:55.190737] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-03T19:56:55.990687] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-03T19:56:56.468596] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-03T19:56:56.790691] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-03T19:56:57.573257] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:56:57.590626] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-03T19:56:58.071767] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-03T19:56:58.390719] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-03T19:56:59.190636] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-03T19:56:59.277605] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-03T19:56:59.504877] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-03T19:56:59.507138] [INFO ] [REMOTE ] LII: Full fetch complete (41476 records). [2025-10-03T19:56:59.507283] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-03T19:56:59.640934] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-03T19:56:59.940400] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-03T19:56:59.940482] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-03T19:56:59.941304] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-03T19:56:59.941368] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-03T19:56:59.942297] [DEBUG] [LOCAL ] LII: Trimmed 41476 records to 28404 (keeping 200 days of data) [2025-10-03T19:57:00.006632] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-03T19:57:00.141535] [DEBUG] [LOCAL ] LII: Primary data saved (28404 records). [2025-10-03T19:57:00.141761] [INFO ] [MAIN ] LII: Full history saved. [2025-10-03T19:57:00.141887] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LII took 30.3s. Estimated remaining: 2h 36m 39s. Rate: 7.1 symbols/min [2025-10-03T19:57:00.333247] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:00.389781] [DEBUG] [LOCAL ] LLY: Loaded 53674 existing records from primary storage. [2025-10-03T19:57:00.390151] [INFO ] [MAIN ] LLY: Loaded 53674 existing records. [2025-10-03T19:57:00.581071] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:00.581310] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-03T19:57:00.581359] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-03T19:57:00.581623] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-03T19:57:00.581717] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-03T19:57:00.797099] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-03T19:57:00.962580] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:01.276927] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-03T19:57:01.588797] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-03T19:57:01.590710] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-03T19:57:01.592772] [INFO ] [REMOTE ] LHX: Full fetch complete (70767 records). [2025-10-03T19:57:01.592870] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-03T19:57:02.046727] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-03T19:57:02.046914] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-03T19:57:02.048509] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-03T19:57:02.048592] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-03T19:57:02.050724] [DEBUG] [LOCAL ] LHX: Trimmed 70767 records to 49316 (keeping 200 days of data) [2025-10-03T19:57:02.295200] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-03T19:57:02.390743] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-03T19:57:02.397692] [DEBUG] [LOCAL ] LHX: Primary data saved (49316 records). [2025-10-03T19:57:02.397874] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-03T19:57:02.398051] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LHX took 41.6s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-03T19:57:02.580317] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:02.645796] [DEBUG] [LOCAL ] LMND: Loaded 52254 existing records from primary storage. [2025-10-03T19:57:02.646148] [INFO ] [MAIN ] LMND: Loaded 52254 existing records. [2025-10-03T19:57:02.846365] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:02.846694] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-03T19:57:02.846778] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-03T19:57:02.847104] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-03T19:57:02.847181] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-03T19:57:03.056911] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-03T19:57:03.124499] [INFO ] [REMOTE ] LITB: Full fetch complete (5642 records). [2025-10-03T19:57:03.153431] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-03T19:57:03.218498] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-03T19:57:03.352445] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:03.631885] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-03T19:57:03.631973] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-03T19:57:03.632228] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-03T19:57:03.632286] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-03T19:57:03.632818] [DEBUG] [LOCAL ] LITB: Trimmed 5642 records to 4388 (keeping 200 days of data) [2025-10-03T19:57:03.660733] [DEBUG] [LOCAL ] LITB: Primary data saved (4388 records). [2025-10-03T19:57:03.660883] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-03T19:57:03.661014] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LITB took 24.3s. Estimated remaining: 2h 36m 11s. Rate: 7.1 symbols/min [2025-10-03T19:57:03.849040] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:03.912046] [DEBUG] [LOCAL ] LMT: Loaded 50172 existing records from primary storage. [2025-10-03T19:57:03.912419] [INFO ] [MAIN ] LMT: Loaded 50172 existing records. [2025-10-03T19:57:03.995847] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-03T19:57:04.104002] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:04.104333] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-03T19:57:04.104396] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-03T19:57:04.105076] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-03T19:57:04.105139] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-03T19:57:04.493410] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:04.790694] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-03T19:57:05.094169] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-03T19:57:05.590719] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-03T19:57:06.052095] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-03T19:57:06.390690] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-03T19:57:07.041435] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-03T19:57:07.190699] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-03T19:57:07.245278] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-03T19:57:07.990693] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-03T19:57:08.217458] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-03T19:57:08.790679] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-03T19:57:09.329978] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-03T19:57:09.547684] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-03T19:57:09.590630] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-03T19:57:10.398457] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-03T19:57:10.408340] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:57:11.190714] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-03T19:57:11.726563] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-03T19:57:11.990738] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-03T19:57:12.781024] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-10-03T19:57:12.791409] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-03T19:57:12.883182] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-03T19:57:13.590631] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-03T19:57:13.895287] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:57:14.257024] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-03T19:57:14.261376] [INFO ] [REMOTE ] LION: Full fetch complete (55435 records). [2025-10-03T19:57:14.261502] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-03T19:57:14.395782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-03T19:57:14.681190] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-03T19:57:14.681280] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-03T19:57:14.682207] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-03T19:57:14.682279] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-03T19:57:14.683739] [DEBUG] [LOCAL ] LION: Trimmed 55435 records to 45007 (keeping 200 days of data) [2025-10-03T19:57:14.966464] [DEBUG] [LOCAL ] LION: Primary data saved (45007 records). [2025-10-03T19:57:14.966622] [INFO ] [MAIN ] LION: Full history saved. [2025-10-03T19:57:14.966769] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LION took 40.1s. Estimated remaining: 2h 36m 5s. Rate: 7.1 symbols/min [2025-10-03T19:57:15.163917] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:15.193572] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-03T19:57:15.216417] [DEBUG] [LOCAL ] LNC: Loaded 51991 existing records from primary storage. [2025-10-03T19:57:15.216787] [INFO ] [MAIN ] LNC: Loaded 51991 existing records. [2025-10-03T19:57:15.414111] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:15.414482] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-03T19:57:15.414670] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-03T19:57:15.415166] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-03T19:57:15.415288] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-03T19:57:15.589021] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-03T19:57:15.871805] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:15.990706] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-03T19:57:16.597408] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-03T19:57:16.790706] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-03T19:57:17.590732] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-03T19:57:17.630350] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-03T19:57:17.698773] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-03T19:57:18.390633] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-03T19:57:18.740747] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-03T19:57:18.876036] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-03T19:57:19.190722] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-03T19:57:19.990628] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-03T19:57:20.417325] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-03T19:57:20.790684] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-03T19:57:21.590721] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-03T19:57:21.819900] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-03T19:57:22.112834] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-03T19:57:22.390634] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-03T19:57:22.917882] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-03T19:57:23.054428] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-03T19:57:23.190746] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-03T19:57:23.990689] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-03T19:57:24.454875] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-03T19:57:24.790692] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-03T19:57:24.915275] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-03T19:57:25.592950] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-03T19:57:25.596419] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-03T19:57:26.390689] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-03T19:57:27.047054] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-03T19:57:27.190695] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-03T19:57:27.926121] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-03T19:57:27.990679] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-03T19:57:28.511780] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-03T19:57:28.790673] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-03T19:57:28.922080] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-03T19:57:29.590734] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-03T19:57:30.390743] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-03T19:57:30.471118] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-03T19:57:31.154630] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-03T19:57:31.190619] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-03T19:57:31.566581] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-03T19:57:31.573188] [INFO ] [REMOTE ] LMND: Full fetch complete (75322 records). [2025-10-03T19:57:31.573395] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-03T19:57:31.993944] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-03T19:57:32.021888] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-03T19:57:32.022980] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-03T19:57:32.024244] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-03T19:57:32.024581] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-03T19:57:32.026695] [DEBUG] [LOCAL ] LMND: Trimmed 75322 records to 52640 (keeping 200 days of data) [2025-10-03T19:57:32.150397] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-03T19:57:32.398849] [DEBUG] [LOCAL ] LMND: Primary data saved (52640 records). [2025-10-03T19:57:32.398998] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-03T19:57:32.399097] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LMND took 30.0s. Estimated remaining: 2h 36m 4s. Rate: 7.1 symbols/min [2025-10-03T19:57:32.603184] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:32.610988] [DEBUG] [LOCAL ] LND: Loaded 4941 existing records from primary storage. [2025-10-03T19:57:32.611245] [INFO ] [MAIN ] LND: Loaded 4941 existing records. [2025-10-03T19:57:32.795773] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-03T19:57:32.801727] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:32.802752] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-03T19:57:32.802822] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-03T19:57:32.803007] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-03T19:57:32.803066] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-03T19:57:33.238303] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:33.490601] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-03T19:57:33.590730] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-03T19:57:34.390742] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-03T19:57:34.619669] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-03T19:57:34.653536] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-10-03T19:57:35.190706] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-03T19:57:35.214862] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-03T19:57:35.625001] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-03T19:57:35.990695] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-03T19:57:36.790742] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-03T19:57:37.590688] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-03T19:57:37.762785] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-03T19:57:37.929010] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-10-03T19:57:38.187742] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-03T19:57:38.390689] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-03T19:57:38.473809] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-03T19:57:38.477042] [INFO ] [REMOTE ] LMT: Full fetch complete (72440 records). [2025-10-03T19:57:38.477234] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-03T19:57:38.920095] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-03T19:57:38.920223] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-03T19:57:38.921561] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-03T19:57:38.921637] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-03T19:57:38.923305] [DEBUG] [LOCAL ] LMT: Trimmed 72440 records to 50509 (keeping 200 days of data) [2025-10-03T19:57:39.157766] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-03T19:57:39.190849] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-03T19:57:39.272775] [DEBUG] [LOCAL ] LMT: Primary data saved (50509 records). [2025-10-03T19:57:39.272935] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-03T19:57:39.273786] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LMT took 35.6s. Estimated remaining: 2h 35m 55s. Rate: 7.1 symbols/min [2025-10-03T19:57:39.465156] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:39.523994] [DEBUG] [LOCAL ] LNG: Loaded 51737 existing records from primary storage. [2025-10-03T19:57:39.524399] [INFO ] [MAIN ] LNG: Loaded 51737 existing records. [2025-10-03T19:57:39.742767] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:39.743010] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-03T19:57:39.743068] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-03T19:57:39.743732] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-03T19:57:39.743833] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-03T19:57:40.002034] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-03T19:57:40.137486] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:40.790715] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-03T19:57:41.590698] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-03T19:57:41.712743] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-03T19:57:41.844367] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-10-03T19:57:41.981858] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-03T19:57:42.390678] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-03T19:57:42.701615] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-03T19:57:42.952706] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-03T19:57:42.955781] [INFO ] [REMOTE ] LLY: Full fetch complete (77277 records). [2025-10-03T19:57:42.955923] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-03T19:57:43.198409] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-03T19:57:43.390757] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-03T19:57:43.390865] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-03T19:57:43.392226] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-03T19:57:43.392292] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-03T19:57:43.393878] [DEBUG] [LOCAL ] LLY: Trimmed 77277 records to 54064 (keeping 200 days of data) [2025-10-03T19:57:43.753707] [DEBUG] [LOCAL ] LLY: Primary data saved (54064 records). [2025-10-03T19:57:43.753858] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-03T19:57:43.753966] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LLY took 43.6s. Estimated remaining: 2h 35m 43s. Rate: 7.1 symbols/min [2025-10-03T19:57:43.935408] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:43.942306] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T19:57:43.956446] [DEBUG] [LOCAL ] LNN: Loaded 11250 existing records from primary storage. [2025-10-03T19:57:43.956699] [INFO ] [MAIN ] LNN: Loaded 11250 existing records. [2025-10-03T19:57:43.996168] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-03T19:57:44.151496] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:44.151990] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-03T19:57:44.152064] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-03T19:57:44.152295] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-03T19:57:44.152383] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-03T19:57:44.543706] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:44.790683] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-03T19:57:45.362482] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-03T19:57:45.590624] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-03T19:57:45.695052] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-03T19:57:46.390672] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-03T19:57:46.399112] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-03T19:57:47.190697] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-03T19:57:47.990705] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-03T19:57:48.287891] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-03T19:57:48.657319] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:57:48.790663] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-03T19:57:48.955935] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:57:49.590677] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-03T19:57:49.614152] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-03T19:57:50.390725] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-03T19:57:51.120992] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-03T19:57:51.124620] [INFO ] [REMOTE ] LNC: Full fetch complete (74290 records). [2025-10-03T19:57:51.124882] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-03T19:57:51.195881] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-03T19:57:51.591193] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-03T19:57:51.591295] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-03T19:57:51.592457] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-03T19:57:51.592525] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-03T19:57:51.594214] [DEBUG] [LOCAL ] LNC: Trimmed 74290 records to 52378 (keeping 200 days of data) [2025-10-03T19:57:51.870561] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-03T19:57:51.953397] [DEBUG] [LOCAL ] LNC: Primary data saved (52378 records). [2025-10-03T19:57:51.953663] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-03T19:57:51.953827] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LNC took 37.0s. Estimated remaining: 2h 35m 34s. Rate: 7.1 symbols/min [2025-10-03T19:57:51.992249] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-03T19:57:52.151021] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:57:52.193847] [DEBUG] [LOCAL ] LOAR: Loaded 41885 existing records from primary storage. [2025-10-03T19:57:52.194255] [INFO ] [MAIN ] LOAR: Loaded 41885 existing records. [2025-10-03T19:57:52.385503] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:57:52.385853] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-03T19:57:52.401584] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-03T19:57:52.412857] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-03T19:57:52.413956] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-03T19:57:52.414066] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-03T19:57:52.793528] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-03T19:57:52.821366] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:57:52.846739] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-03T19:57:53.590731] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-03T19:57:54.202680] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-03T19:57:54.390687] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-03T19:57:54.691930] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-03T19:57:55.190700] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-03T19:57:55.818677] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-03T19:57:55.833703] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-03T19:57:55.990698] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-03T19:57:56.790688] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-03T19:57:57.590700] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-03T19:57:57.705187] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-03T19:57:57.735145] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-03T19:57:58.390714] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-03T19:57:58.599699] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-03T19:57:59.190715] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-03T19:57:59.751275] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-03T19:57:59.934937] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-03T19:57:59.990685] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-03T19:58:00.790727] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-03T19:58:00.872822] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-03T19:58:01.374922] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-03T19:58:01.590742] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-03T19:58:02.390635] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-03T19:58:02.552478] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-03T19:58:03.029855] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-03T19:58:03.031002] [INFO ] [REMOTE ] LND: Full fetch complete (8331 records). [2025-10-03T19:58:03.031075] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-03T19:58:03.214244] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-03T19:58:03.419621] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-03T19:58:03.419737] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-03T19:58:03.420145] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-03T19:58:03.420233] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-03T19:58:03.421064] [DEBUG] [LOCAL ] LND: Trimmed 8331 records to 4994 (keeping 200 days of data) [2025-10-03T19:58:03.451488] [DEBUG] [LOCAL ] LND: Primary data saved (4994 records). [2025-10-03T19:58:03.451633] [INFO ] [MAIN ] LND: Full history saved. [2025-10-03T19:58:03.451766] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LND took 31.1s. Estimated remaining: 2h 35m 28s. Rate: 7.1 symbols/min [2025-10-03T19:58:03.644783] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:03.674123] [DEBUG] [LOCAL ] LOB: Loaded 27571 existing records from primary storage. [2025-10-03T19:58:03.674442] [INFO ] [MAIN ] LOB: Loaded 27571 existing records. [2025-10-03T19:58:03.867242] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:03.867478] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-03T19:58:03.867527] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-03T19:58:03.867837] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-03T19:58:03.867897] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-03T19:58:03.995877] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-03T19:58:04.260763] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:04.790688] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-03T19:58:05.071096] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-03T19:58:05.423142] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-03T19:58:05.577300] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-03T19:58:05.590607] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-03T19:58:06.343532] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-03T19:58:06.390637] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-03T19:58:07.190682] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-03T19:58:07.219824] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-03T19:58:07.220921] [INFO ] [REMOTE ] LNN: Full fetch complete (15651 records). [2025-10-03T19:58:07.220996] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-03T19:58:07.639535] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-03T19:58:07.639616] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-03T19:58:07.640065] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-03T19:58:07.640128] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-03T19:58:07.640742] [DEBUG] [LOCAL ] LNN: Trimmed 15651 records to 11340 (keeping 200 days of data) [2025-10-03T19:58:07.720400] [DEBUG] [LOCAL ] LNN: Primary data saved (11340 records). [2025-10-03T19:58:07.720562] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-03T19:58:07.720693] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNN took 24.0s. Estimated remaining: 2h 35m 16s. Rate: 7.1 symbols/min [2025-10-03T19:58:07.914162] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:07.921218] [DEBUG] [LOCAL ] LOCL: Loaded 3642 existing records from primary storage. [2025-10-03T19:58:07.921400] [INFO ] [MAIN ] LOCL: Loaded 3642 existing records. [2025-10-03T19:58:07.995874] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-03T19:58:08.124567] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:08.124807] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-03T19:58:08.124857] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-03T19:58:08.125116] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-03T19:58:08.125177] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-03T19:58:08.549301] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:08.790730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-03T19:58:09.227991] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-03T19:58:09.408295] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-03T19:58:09.590721] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-03T19:58:09.774403] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-03T19:58:10.390703] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-03T19:58:11.190723] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-03T19:58:11.345763] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-03T19:58:11.971543] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-03T19:58:11.990701] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-03T19:58:12.274410] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-03T19:58:12.790698] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-03T19:58:13.590730] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-03T19:58:13.764578] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-03T19:58:14.390620] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-03T19:58:14.501235] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-03T19:58:14.638766] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-03T19:58:15.190685] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-03T19:58:15.930907] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-03T19:58:15.933734] [INFO ] [REMOTE ] LNG: Full fetch complete (74681 records). [2025-10-03T19:58:15.933871] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-03T19:58:15.995894] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-03T19:58:16.377116] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-03T19:58:16.377216] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-03T19:58:16.378473] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-03T19:58:16.378546] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-03T19:58:16.380037] [DEBUG] [LOCAL ] LNG: Trimmed 74681 records to 52089 (keeping 200 days of data) [2025-10-03T19:58:16.769158] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-03T19:58:16.773901] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-03T19:58:16.788975] [DEBUG] [LOCAL ] LNG: Primary data saved (52089 records). [2025-10-03T19:58:16.790182] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-03T19:58:16.791744] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LNG took 37.5s. Estimated remaining: 2h 35m 8s. Rate: 7.1 symbols/min [2025-10-03T19:58:16.791933] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-03T19:58:16.986890] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:17.026707] [DEBUG] [LOCAL ] LOMA: Loaded 32305 existing records from primary storage. [2025-10-03T19:58:17.026993] [INFO ] [MAIN ] LOMA: Loaded 32305 existing records. [2025-10-03T19:58:17.219958] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:17.220216] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-03T19:58:17.220268] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-03T19:58:17.220683] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-03T19:58:17.220744] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-03T19:58:17.330475] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-03T19:58:17.595203] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-03T19:58:17.600614] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:17.941300] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-03T19:58:18.390715] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-03T19:58:19.190692] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-03T19:58:19.668122] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-03T19:58:19.855573] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-03T19:58:19.990734] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-03T19:58:20.790708] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-03T19:58:21.485967] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-03T19:58:21.534748] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-03T19:58:21.590730] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-03T19:58:22.390695] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-03T19:58:22.677789] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-03T19:58:23.195845] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-03T19:58:23.220374] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:58:23.990719] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-03T19:58:24.555141] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:58:24.790728] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-03T19:58:25.255774] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:58:25.590714] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-03T19:58:26.037528] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-03T19:58:26.195914] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-03T19:58:26.390708] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-03T19:58:27.190722] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-03T19:58:27.747208] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-03T19:58:27.816110] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-03T19:58:27.990717] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-03T19:58:28.507863] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-03T19:58:28.790699] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-03T19:58:29.413717] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-03T19:58:29.590685] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-03T19:58:30.142108] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-03T19:58:30.142893] [INFO ] [REMOTE ] LOCL: Full fetch complete (4680 records). [2025-10-03T19:58:30.142965] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-03T19:58:30.395851] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-03T19:58:30.552707] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-03T19:58:30.552797] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-03T19:58:30.552978] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-03T19:58:30.553056] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-03T19:58:30.553535] [DEBUG] [LOCAL ] LOCL: Trimmed 4680 records to 3659 (keeping 200 days of data) [2025-10-03T19:58:30.576537] [DEBUG] [LOCAL ] LOCL: Primary data saved (3659 records). [2025-10-03T19:58:30.576713] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-03T19:58:30.576832] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LOCL took 22.9s. Estimated remaining: 2h 35m 4s. Rate: 7.1 symbols/min [2025-10-03T19:58:30.760085] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:30.824163] [DEBUG] [LOCAL ] LOW: Loaded 53319 existing records from primary storage. [2025-10-03T19:58:30.824509] [INFO ] [MAIN ] LOW: Loaded 53319 existing records. [2025-10-03T19:58:31.042762] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:31.043039] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-03T19:58:31.043099] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-03T19:58:31.043840] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-03T19:58:31.043904] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-03T19:58:31.197944] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-03T19:58:31.440401] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:31.744735] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-03T19:58:31.750016] [INFO ] [REMOTE ] LOAR: Full fetch complete (56166 records). [2025-10-03T19:58:31.750160] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-03T19:58:31.996249] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-03T19:58:32.240922] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-03T19:58:32.241293] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-03T19:58:32.244029] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-03T19:58:32.242922] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-03T19:58:32.251239] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-03T19:58:32.253217] [DEBUG] [LOCAL ] LOAR: Trimmed 56166 records to 42186 (keeping 200 days of data) [2025-10-03T19:58:32.512157] [DEBUG] [LOCAL ] LOAR: Primary data saved (42186 records). [2025-10-03T19:58:32.512300] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-03T19:58:32.512409] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOAR took 40.6s. Estimated remaining: 2h 34m 50s. Rate: 7.1 symbols/min [2025-10-03T19:58:32.706227] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:32.748861] [DEBUG] [LOCAL ] LPG: Loaded 40198 existing records from primary storage. [2025-10-03T19:58:32.749254] [INFO ] [MAIN ] LPG: Loaded 40198 existing records. [2025-10-03T19:58:32.795790] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-03T19:58:32.997256] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:32.997521] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-03T19:58:32.997586] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-03T19:58:32.998094] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-03T19:58:32.998170] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-03T19:58:33.389303] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:33.590729] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-03T19:58:33.826140] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-03T19:58:33.871946] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-03T19:58:34.390677] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-03T19:58:34.674762] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-03T19:58:35.190711] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-03T19:58:35.990785] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-03T19:58:35.998126] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-03T19:58:36.366672] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-03T19:58:36.790627] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-03T19:58:37.256586] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-03T19:58:37.590722] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-03T19:58:38.390743] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-03T19:58:38.630201] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-03T19:58:38.820194] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-03T19:58:39.190728] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-03T19:58:39.991472] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-03T19:58:40.092056] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:58:40.659855] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-03T19:58:40.790692] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-03T19:58:41.590635] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-03T19:58:41.903044] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-03T19:58:41.983761] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:58:42.390632] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-03T19:58:43.200757] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-03T19:58:43.206372] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-03T19:58:43.990693] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-03T19:58:44.410450] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:58:44.569389] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-03T19:58:44.790702] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-03T19:58:45.432425] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-03T19:58:45.590702] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-03T19:58:45.973348] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-03T19:58:46.390712] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-03T19:58:47.193835] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-03T19:58:47.198140] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-03T19:58:47.990729] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-03T19:58:48.343185] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-03T19:58:48.408526] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-03T19:58:48.790680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-03T19:58:49.190491] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-03T19:58:49.590699] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-03T19:58:50.397066] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-03T19:58:50.420965] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-03T19:58:50.708470] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-03T19:58:51.190715] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-03T19:58:51.941437] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-03T19:58:51.990711] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-03T19:58:52.790626] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-03T19:58:53.125321] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-03T19:58:53.216890] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-03T19:58:53.590735] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-03T19:58:53.961143] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-03T19:58:54.390706] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-03T19:58:55.190638] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-03T19:58:55.516872] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-03T19:58:55.617538] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-03T19:58:55.619687] [INFO ] [REMOTE ] LOMA: Full fetch complete (47827 records). [2025-10-03T19:58:55.619785] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-03T19:58:55.991462] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-03T19:58:56.037448] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-03T19:58:56.037539] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-03T19:58:56.038498] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-03T19:58:56.038570] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-03T19:58:56.039830] [DEBUG] [LOCAL ] LOMA: Trimmed 47827 records to 32578 (keeping 200 days of data) [2025-10-03T19:58:56.249134] [DEBUG] [LOCAL ] LOMA: Primary data saved (32578 records). [2025-10-03T19:58:56.249313] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-03T19:58:56.250007] [INFO ] [MAIN ] Update Progress: 1270/2370 symbols completed. LOMA took 39.5s. Estimated remaining: 2h 34m 55s. Rate: 7.1 symbols/min [2025-10-03T19:58:56.449266] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:56.480450] [DEBUG] [LOCAL ] LPL: Loaded 26772 existing records from primary storage. [2025-10-03T19:58:56.480812] [INFO ] [MAIN ] LPL: Loaded 26772 existing records. [2025-10-03T19:58:56.643605] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-03T19:58:56.705078] [INFO ] [REMOTE ] LOB: Full fetch complete (37957 records). [2025-10-03T19:58:56.712159] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-03T19:58:56.736898] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:56.737279] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-03T19:58:56.737343] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-03T19:58:56.799286] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-03T19:58:56.814423] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-03T19:58:56.829280] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-03T19:58:57.560686] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-03T19:58:57.588201] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-03T19:58:57.612921] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-03T19:58:57.613754] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-03T19:58:57.637741] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:57.638368] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-10-03T19:58:57.639861] [DEBUG] [LOCAL ] LOB: Trimmed 37957 records to 27738 (keeping 200 days of data) [2025-10-03T19:58:57.832532] [DEBUG] [LOCAL ] LOB: Primary data saved (27738 records). [2025-10-03T19:58:57.832702] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-03T19:58:57.832820] [INFO ] [MAIN ] Update Progress: 1271/2370 symbols completed. LOB took 54.4s. Estimated remaining: 2h 34m 41s. Rate: 7.1 symbols/min [2025-10-03T19:58:58.052540] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:58:58.077735] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-03T19:58:58.126941] [DEBUG] [LOCAL ] LPX: Loaded 39976 existing records from primary storage. [2025-10-03T19:58:58.127241] [INFO ] [MAIN ] LPX: Loaded 39976 existing records. [2025-10-03T19:58:58.320846] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:58:58.321075] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-03T19:58:58.321123] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-03T19:58:58.321422] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-03T19:58:58.321481] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-03T19:58:58.399961] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-03T19:58:58.727809] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:58:58.775899] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-03T19:58:58.905618] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-03T19:58:59.190707] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-03T19:58:59.990680] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-03T19:59:00.031205] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-03T19:59:00.215330] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-03T19:59:00.790701] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-03T19:59:01.590712] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-10-03T19:59:01.748529] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-03T19:59:01.751133] [INFO ] [REMOTE ] LOW: Full fetch complete (76504 records). [2025-10-03T19:59:01.751245] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-03T19:59:02.187762] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-03T19:59:02.187856] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-03T19:59:02.189143] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-03T19:59:02.189212] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-03T19:59:02.191276] [DEBUG] [LOCAL ] LOW: Trimmed 76504 records to 53704 (keeping 200 days of data) [2025-10-03T19:59:02.392698] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-03T19:59:02.489195] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-03T19:59:02.605436] [DEBUG] [LOCAL ] LOW: Primary data saved (53704 records). [2025-10-03T19:59:02.605619] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-03T19:59:02.605762] [INFO ] [MAIN ] Update Progress: 1272/2370 symbols completed. LOW took 32.0s. Estimated remaining: 2h 34m 29s. Rate: 7.1 symbols/min [2025-10-03T19:59:02.804799] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:02.849116] [DEBUG] [LOCAL ] LRN: Loaded 40020 existing records from primary storage. [2025-10-03T19:59:02.849451] [INFO ] [MAIN ] LRN: Loaded 40020 existing records. [2025-10-03T19:59:03.070574] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:03.070998] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-03T19:59:03.071082] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-03T19:59:03.071427] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-03T19:59:03.071546] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-03T19:59:03.199298] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-03T19:59:03.272825] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-03T19:59:03.508815] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:03.561639] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-03T19:59:03.990701] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-03T19:59:04.627338] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-03T19:59:04.629925] [INFO ] [REMOTE ] LPG: Full fetch complete (59571 records). [2025-10-03T19:59:04.630044] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-03T19:59:04.795831] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-10-03T19:59:05.071134] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-03T19:59:05.071228] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-03T19:59:05.072187] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-03T19:59:05.072251] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-03T19:59:05.073595] [DEBUG] [LOCAL ] LPG: Trimmed 59571 records to 40441 (keeping 200 days of data) [2025-10-03T19:59:05.320953] [DEBUG] [LOCAL ] LPG: Primary data saved (40441 records). [2025-10-03T19:59:05.321225] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-03T19:59:05.321337] [INFO ] [MAIN ] Update Progress: 1273/2370 symbols completed. LPG took 32.8s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-03T19:59:05.503112] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:05.530398] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-03T19:59:05.577782] [DEBUG] [LOCAL ] LSPD: Loaded 43183 existing records from primary storage. [2025-10-03T19:59:05.578153] [INFO ] [MAIN ] LSPD: Loaded 43183 existing records. [2025-10-03T19:59:05.601132] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-03T19:59:05.772981] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:05.773197] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-03T19:59:05.773247] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-03T19:59:05.773554] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-03T19:59:05.773615] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-03T19:59:06.161041] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:06.373317] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-03T19:59:06.390609] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-03T19:59:06.814338] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-03T19:59:07.190726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-03T19:59:07.990709] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-10-03T19:59:08.095370] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-03T19:59:08.383267] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-03T19:59:08.790717] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-03T19:59:09.149910] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-03T19:59:09.590677] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-03T19:59:10.057618] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-03T19:59:10.390630] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-03T19:59:10.710264] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-03T19:59:11.190684] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-03T19:59:11.752750] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-03T19:59:11.863224] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-03T19:59:11.990708] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-03T19:59:12.790733] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-03T19:59:13.465518] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-03T19:59:13.590844] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-03T19:59:14.275055] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-03T19:59:14.390711] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-03T19:59:15.077516] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-03T19:59:15.190716] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-03T19:59:15.990632] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-03T19:59:16.022520] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-03T19:59:16.704442] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-03T19:59:16.790701] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-03T19:59:17.250700] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-03T19:59:17.590697] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-03T19:59:18.390680] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-03T19:59:18.435584] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-03T19:59:18.997959] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-03T19:59:19.190704] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-03T19:59:19.971465] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-03T19:59:19.990629] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-03T19:59:20.762007] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-03T19:59:20.790697] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-03T19:59:21.455113] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:59:21.590720] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-03T19:59:21.799873] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-03T19:59:22.390735] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-03T19:59:22.825424] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-03T19:59:23.190717] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-03T19:59:23.720121] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-03T19:59:23.722448] [INFO ] [REMOTE ] LPL: Full fetch complete (35682 records). [2025-10-03T19:59:23.722636] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-03T19:59:23.998798] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-03T19:59:24.130105] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-03T19:59:24.130194] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-03T19:59:24.130959] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-03T19:59:24.131039] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-03T19:59:24.132057] [DEBUG] [LOCAL ] LPL: Trimmed 35682 records to 27029 (keeping 200 days of data) [2025-10-03T19:59:24.295772] [DEBUG] [LOCAL ] LPL: Primary data saved (27029 records). [2025-10-03T19:59:24.295989] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-03T19:59:24.296119] [INFO ] [MAIN ] Update Progress: 1274/2370 symbols completed. LPL took 28.0s. Estimated remaining: 2h 34m 16s. Rate: 7.1 symbols/min [2025-10-03T19:59:24.482424] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-25 to 2025-10-03. [2025-10-03T19:59:24.515860] [DEBUG] [LOCAL ] LTC: Loaded 30459 existing records from primary storage. [2025-10-03T19:59:24.516211] [INFO ] [MAIN ] LTC: Loaded 30459 existing records. [2025-10-03T19:59:24.720707] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-16 for 200 day retention. Performing full refresh. [2025-10-03T19:59:24.721373] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-03T19:59:24.721489] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-03T19:59:24.722290] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-03T19:59:24.722354] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-03T19:59:24.795763] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-03T19:59:25.079085] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-03T19:59:25.176414] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-16 to 2025-10-03 (requires 11 months of data pull). [2025-10-03T19:59:25.590637] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-10-03T19:59:25.679761] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-03T19:59:26.390692] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-03T19:59:26.478712] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-03T19:59:26.791487] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-03T19:59:27.190715] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-03T19:59:27.575847] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-03T19:59:27.990693] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-03T19:59:28.793058] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-03T19:59:28.799289] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-03T19:59:29.303393] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-03T19:59:29.590720] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-03T19:59:30.289968] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-03T19:59:30.390710] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-03T19:59:30.568525] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-03T19:59:31.190704] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-03T19:59:31.973091] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-03T19:59:31.990671] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-03T19:59:32.355354] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-03T19:59:32.790732] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-03T19:59:33.528202] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-03T19:59:33.590675] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-03T19:59:34.039154] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-03T19:59:34.390712] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-03T19:59:35.055500] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-03T19:59:35.190732] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10.